-- Logs begin at Wed 2021-09-15 01:52:42 UTC, end at Wed 2021-09-15 03:46:01 UTC. -- Sep 15 02:16:49.567753 dv-cinder-759955-25-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Sep 15 02:16:49.575079 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 15 02:16:49.582431 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 15 02:16:49 2021] *** Sep 15 02:16:49.582431 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 02:16:49.582431 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 02:16:49.582431 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: nodename: dv-cinder-759955-25-iscsi Sep 15 02:16:49.582431 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: machine: x86_64 Sep 15 02:16:49.582431 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: clock source: unix Sep 15 02:16:49.582431 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: pcre jit disabled Sep 15 02:16:49.582431 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: detected number of CPU cores: 4 Sep 15 02:16:49.582431 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: current working directory: / Sep 15 02:16:49.582431 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: detected binary path: /usr/bin/uwsgi-core Sep 15 02:16:49.582431 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: your processes number limit is 47680 Sep 15 02:16:49.582431 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: your memory page size is 4096 bytes Sep 15 02:16:49.582431 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: detected max file descriptor number: 2048 Sep 15 02:16:49.582431 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: lock engine: pthread robust mutexes Sep 15 02:16:49.582431 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: thunder lock: enabled Sep 15 02:16:49.582431 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 15 02:16:49.582431 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 15 02:16:49.622706 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: Python main interpreter initialized at 0x5594b01f69c0 Sep 15 02:16:49.622706 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: python threads support enabled Sep 15 02:16:49.622706 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: your server socket listen backlog is limited to 100 connections Sep 15 02:16:49.622706 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: your mercy for graceful operations on workers is 90 seconds Sep 15 02:16:49.623062 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 02:16:49.623133 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: *** Operational MODE: preforking *** Sep 15 02:16:49.623410 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: *** uWSGI is running in multiple interpreter mode *** Sep 15 02:16:49.623410 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: spawned uWSGI master process (pid: 73388) Sep 15 02:16:49.623628 dv-cinder-759955-25-iscsi systemd[1]: Started Devstack devstack@keystone.service. Sep 15 02:16:49.624193 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: spawned uWSGI worker 1 (pid: 73403, cores: 1) Sep 15 02:16:49.625167 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: spawned uWSGI worker 2 (pid: 73404, cores: 1) Sep 15 02:16:49.625418 dv-cinder-759955-25-iscsi devstack@keystone.service[73388]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 02:16:54.630393 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 02:16:54.630393 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: from cryptography.utils import int_from_bytes Sep 15 02:16:54.631184 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 02:16:54.631184 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: from cryptography.utils import int_from_bytes Sep 15 02:16:54.631610 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 02:16:54.631610 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: from cryptography.utils import int_from_bytes Sep 15 02:16:54.631719 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 02:16:54.631719 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: from cryptography.utils import int_from_bytes Sep 15 02:16:54.679843 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 02:16:54.680023 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 02:16:54.680208 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] command line args: [] {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 02:16:54.680478 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 02:16:54.680655 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ================================================================================ {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 02:16:54.680740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 02:16:54.680899 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 02:16:54.680991 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] admin_token = **** {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.681096 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] command line args: [] {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 02:16:54.681182 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] config_dir = [] {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.681340 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.681432 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 02:16:54.681511 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] config_source = [] {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.681588 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ================================================================================ {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 02:16:54.681690 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] debug = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.681776 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] admin_token = **** {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.681887 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.682141 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] config_dir = [] {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.682141 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.682264 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.682328 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] config_source = [] {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.682392 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.682546 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] debug = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.682655 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.682760 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.682891 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.682996 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.683105 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.683207 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] list_limit = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.683311 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] log_config_append = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.683418 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.683521 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.683624 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.683731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] log_dir = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.683731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] log_file = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.683926 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] list_limit = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.683926 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] log_config_append = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.684119 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.684231 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.684359 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.684437 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] log_dir = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.684437 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] log_file = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.684626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.684704 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.684827 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.684827 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.685026 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.685157 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.685236 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.685359 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.685442 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.685528 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.685607 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.685732 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.685814 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.685891 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.686021 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.686138 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.686224 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.686368 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.686446 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.686599 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.686685 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.686832 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.686924 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.687066 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.687150 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.687311 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.687557 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.687679 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.687763 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] publish_errors = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.687879 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.687966 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.688169 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.688295 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.688381 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.688464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] publish_errors = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.688578 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.688698 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.688814 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.688955 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.689113 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] standard_threads = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.689201 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.689296 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.689376 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.689538 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.689625 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.689705 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.689811 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] standard_threads = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.689896 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] use_journal = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.690037 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] use_json = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.690120 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.690205 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] use_stderr = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.690283 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.690361 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] use_syslog = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.690433 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.690586 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.690672 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] use_journal = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.690755 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] use_json = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.690832 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.690910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] use_stderr = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.691063 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.691143 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] use_syslog = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.691295 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 02:16:54.691382 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.691549 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.691629 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.692549 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.692638 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.692718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.692802 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.692895 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.692982 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.693098 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.693179 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.693340 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.693495 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.693572 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.693648 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.693809 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.693894 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.694042 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.694129 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.694287 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.694371 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.694520 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.694599 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.694749 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.694843 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.694994 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.695080 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.695226 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.695305 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.695467 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.695553 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.695710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.695794 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.695942 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.696027 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.696193 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.696282 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.696433 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.696510 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.696666 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.696751 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.696934 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.697019 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.697168 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.697256 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.697399 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.697480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.697629 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.697716 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.697862 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.697947 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.698100 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.698178 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.698330 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.698410 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.698561 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.698640 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.698791 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.698876 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.699027 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.699109 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.699256 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.699340 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.699485 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.699574 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.699728 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.699807 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.699958 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.700037 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.700191 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.700270 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.700420 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.700501 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.700652 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.700729 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.700912 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.701004 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.701128 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.701209 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.701356 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.701436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.701583 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.701660 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.701814 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.701894 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.702048 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.702179 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.702257 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.702361 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.702489 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.702593 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.702721 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.702826 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.702954 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.703056 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.703184 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.703292 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.703430 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.703546 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.703654 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.703793 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.703969 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.704109 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.704229 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.704356 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.704485 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.704610 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.704742 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.704868 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.705013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.705136 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.705136 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.705383 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.705383 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.705653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.705653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.705885 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.705885 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.706131 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.706131 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.706385 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.706513 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.706644 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.706769 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.706891 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.706891 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.707138 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.707271 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.707408 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.707408 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.707642 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.707764 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.707899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.708031 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.708166 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.708298 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.708429 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.708559 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.708691 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.708691 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.709030 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.709110 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.709193 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.709273 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.709349 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.709423 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.709497 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.709567 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.709638 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.709714 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.709794 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.709794 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.709923 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.710001 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.710073 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.710143 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.710294 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.710294 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.710433 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.710510 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.710588 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.710661 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.710744 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.710896 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.710976 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.711125 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.711204 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.711361 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.711448 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.711593 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.711672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.711823 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.711902 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.712055 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.712142 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.712285 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.712372 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.712530 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.712617 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.712765 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.712846 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.713017 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] auth.external = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.713099 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.713248 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.713328 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.713512 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.713590 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.713742 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] auth.external = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.713824 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.713970 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.714049 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] auth.password = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.714198 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] auth.token = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.714276 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.714438 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.714519 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.714674 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.714753 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] auth.password = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.714909 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] auth.token = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.715153 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.715390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.715752 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.715986 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.716216 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.716302 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.716468 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.716556 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.716700 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.716780 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.716957 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] credential.caching = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.717051 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.717207 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.717321 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.717456 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.717547 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] credential.caching = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.717704 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.717784 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.717942 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.718023 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.718187 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.718275 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.718421 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.718501 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.718668 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.718749 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.718920 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.719015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.719155 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.719236 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.719408 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.719489 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.719646 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.719733 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.719903 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.719983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.720170 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.720248 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.720414 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.720503 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.720669 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.720751 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.720922 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] federation.caching = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.721004 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.721162 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.721255 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.721410 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] federation.caching = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.721495 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.721653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.721732 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.721883 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.721971 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.722128 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.722211 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.722365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.722445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.722609 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.722700 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.722857 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.722937 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.723122 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.723202 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.723357 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.723438 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.723603 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.723683 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.723839 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] identity.caching = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.723919 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.724085 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.724166 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.724318 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] identity.caching = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.724405 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.724550 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.724632 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.724778 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.724855 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.725040 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.725122 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.725274 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.725364 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.725507 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.725596 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.725738 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.725817 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.725976 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.726056 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.726207 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.726288 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.726436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.726518 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.726665 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.726752 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.726902 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.726984 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.727134 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.727214 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.727374 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.727459 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.727617 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.727736 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.727859 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.727940 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.728110 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.728191 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.728356 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.728438 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.728595 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.728681 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.728826 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.728925 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.729086 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.729169 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.729315 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.729394 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.729545 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.729624 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.729773 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.729860 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.730007 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.730088 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.730250 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.730330 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.730478 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.730559 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.730722 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.730802 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.730951 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.731036 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.731187 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.731268 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.731433 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.731513 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.731668 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.731748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.731895 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.731976 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.732130 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.732207 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.732359 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.732439 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.732594 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.732674 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.732824 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.732958 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.733087 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.733167 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.733323 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.733404 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.733557 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.733636 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.733791 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.733869 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.734028 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.734109 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.734255 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.734333 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.734484 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.734573 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.734728 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.734807 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.734961 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.735040 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.735198 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.735284 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.735430 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.735510 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.735663 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.735743 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.735890 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.user = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.735978 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.736122 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.736201 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.736352 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.user = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.736432 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.736587 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.736675 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.736831 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.736929 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.737351 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.737442 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.737592 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.737680 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.737824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.737908 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.738052 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.738131 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.738283 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.738371 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.739029 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.739148 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.739262 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.739341 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.739491 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.739584 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.739725 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.739810 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.739954 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.740035 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.740199 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.740286 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.740442 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.740520 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.740681 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.740759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.740932 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.741028 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.741180 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.741262 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.741416 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.741497 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.741652 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.741741 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.741886 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.741967 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.742121 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.742201 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.742364 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.742453 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.742595 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.742674 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.742831 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.742910 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.743075 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.743163 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.743302 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.743382 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.743543 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.743623 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.743768 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.743856 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.744002 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.744081 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.744234 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.744313 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.744468 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.744558 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.744704 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.744784 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.744953 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.745036 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.745195 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.745293 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.745425 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.745504 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] resource.caching = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.745660 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.745747 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.745900 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] resource.caching = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.745989 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.746131 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.746211 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.746377 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.746457 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.746611 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.746699 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.746848 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.746927 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.747091 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.747171 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.747325 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.747413 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.747559 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.747638 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.747791 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] role.caching = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.747871 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.748026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.748176 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] role.driver = sql {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.748253 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.748323 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] role.caching = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.748483 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.748564 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] role.driver = sql {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.748711 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.748799 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.748983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.749065 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.749229 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.749311 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.749472 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.749553 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.749714 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.749793 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.749958 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.750036 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.750199 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.750279 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.750428 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.750506 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.750673 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.750759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.750901 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.750996 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.751147 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.751228 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.751390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.751470 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.751638 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.751776 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.751883 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.752012 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.752259 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.752338 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.752491 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.752572 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.752739 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.752819 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.753011 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.753095 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.753497 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.753594 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.753670 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.753742 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.753742 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.753881 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.753956 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.754027 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.754201 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.754800 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.754960 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.755051 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.755198 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.755278 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.755448 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.755528 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.755687 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.755774 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.755932 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.756011 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.756166 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.756246 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.756400 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.756488 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.756629 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.756710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.756862 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] token.caching = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.756961 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.757123 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.757216 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.757357 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] token.caching = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.757437 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.757594 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.757673 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.757838 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.757925 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.758074 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.758155 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.758310 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.758389 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.758553 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.758642 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.758789 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.758869 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.759033 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.759113 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.759266 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.759359 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.759505 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.759587 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.759740 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.759820 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.759982 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.760072 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.760217 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.760298 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.760445 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.760525 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.760686 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.760775 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.760938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.761024 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.761175 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.761257 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] database.connection = **** {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.761439 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.761533 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.761683 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.761763 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] database.connection = **** {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.761921 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.762002 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.762160 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.762249 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.762392 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.762473 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.762627 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.762707 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.762858 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.762946 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.763090 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.763170 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.763322 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.763401 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.763558 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.763647 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.763804 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.763885 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.764036 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.764126 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.764282 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.764364 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.764515 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.764606 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.764757 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.764840 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.765006 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.765092 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.765251 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.765330 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.765483 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.765565 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.765638 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 02:16:54.765719 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.765936 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 02:16:54.766108 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 02:16:54.793811 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:54.794038 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:54.794125 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:54.794263 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:54.794351 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:54.794550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:54.803162 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:54.803444 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:54.831592 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:54.831795 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:54.831967 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:54.832049 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:54.884734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:54.884926 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:54.933531 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:54.933721 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:54.933818 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:54.933954 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.081657 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.081829 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.082193 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.082975 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.083196 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.083414 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.085343 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.085578 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.085802 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.086018 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.086233 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.086447 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.106274 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.106445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.106598 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.106731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.106860 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.106989 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.107127 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.107268 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.107397 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.107524 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.107652 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.107780 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.107917 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.108048 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.118746 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.118986 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.132001 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.132177 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.132350 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.132480 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.132611 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.132738 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.132900 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.133042 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.133171 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.133298 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.133425 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.133553 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.133701 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.133830 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73403) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 02:16:55.150299 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.150452 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.150558 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 02:16:55.150699 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 02:16:55.150827 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.150956 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.151085 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 02:16:55.151212 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 02:16:55.151349 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.151477 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.151615 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.151743 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.151870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.151997 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.152133 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.152261 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.162949 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.163222 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.163352 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.163490 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.163625 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.163768 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.163901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.164127 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.171823 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.172010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.175032 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.175207 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.175338 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.175466 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.175607 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.175743 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.175882 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.176562 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.176702 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.176840 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.176991 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.177116 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.177243 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.177375 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.177508 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.177650 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.177784 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.177930 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.178062 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.178194 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.178336 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.178469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.203962 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.204109 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.205569 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.205716 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.205846 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.205985 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.210995 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.211132 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.211373 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.211512 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.211646 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.211778 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.218699 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.218834 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.218972 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.219105 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.223835 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.223975 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.224105 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.224244 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.224375 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.224504 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.224631 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.224759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.224904 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.225044 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.225178 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.225320 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.225452 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.225584 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.225724 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.225856 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.244029 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.244183 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.244313 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.244452 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.248696 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.248965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.252208 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.252495 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.252636 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.252790 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.257979 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.258329 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.261555 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.262092 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.265116 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.265413 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.265654 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.265785 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.265950 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.266081 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.266209 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.266338 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.266466 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.267929 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.268218 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.268507 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.285247 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.286050 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.286327 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.286585 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.287674 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.287955 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.288222 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.288483 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.294207 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.295865 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.296137 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.296266 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.297911 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.298404 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.300439 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.300716 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.301625 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.301765 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.301916 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.302079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.302217 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.302348 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.302481 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.302770 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.315103 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.315380 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.315659 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.315936 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.316306 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.316581 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.316907 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.318797 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.319074 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.319352 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.319631 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.319910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.320182 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.320453 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.335001 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.338711 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.341726 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.341986 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.343667 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.345030 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.345300 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.345572 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.345846 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.348871 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.350481 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.352074 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.352357 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.352656 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.353553 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.355130 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.358267 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.358552 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.358935 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.359209 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.362500 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.364651 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.368222 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.368627 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.369071 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.369221 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.369351 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.369479 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.369617 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.377229 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73403) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.377505 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.377784 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.378058 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.378341 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.378705 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.378996 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.379291 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.379564 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.379834 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.380125 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.380387 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.380668 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.380962 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73403) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.381471 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.381885 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.382253 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.392148 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 02:16:55.392430 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.392707 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.393005 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.393288 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.393562 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.393840 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.394109 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.394388 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.394670 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.395469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.395741 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.396013 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.396278 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 02:16:55.418661 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5594b01f69c0 pid: 73403 (default app) Sep 15 02:16:55.422086 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379f04c-234c-49ef-9a1e-7aed37d32f6c None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:16:55.422373 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379f04c-234c-49ef-9a1e-7aed37d32f6c None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:16:55.422650 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379f04c-234c-49ef-9a1e-7aed37d32f6c None None] PATH_INFO: `/v3` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:16:55.426813 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 792 bytes} [Wed Sep 15 02:16:55 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:16:55.433961 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5594b01f69c0 pid: 73404 (default app) Sep 15 02:17:02.979042 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72750418-a2b3-4710-bffe-0f2d569c887e None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:02.979583 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72750418-a2b3-4710-bffe-0f2d569c887e None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:02.979583 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72750418-a2b3-4710-bffe-0f2d569c887e None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:02.981708 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 2/2] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:17:02.990728 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fda7e5-5e36-4b01-941f-bc06b4271f1f None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:02.991138 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fda7e5-5e36-4b01-941f-bc06b4271f1f None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:02.991278 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fda7e5-5e36-4b01-941f-bc06b4271f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:03.021678 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG oslo_db.sqlalchemy.engines [None req-b7fda7e5-5e36-4b01-941f-bc06b4271f1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73404) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 02:17:03.210163 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG passlib.handlers.bcrypt [None req-b7fda7e5-5e36-4b01-941f-bc06b4271f1f None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73404) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 15 02:17:03.210569 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG passlib.handlers.bcrypt [None req-b7fda7e5-5e36-4b01-941f-bc06b4271f1f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73404) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 15 02:17:03.265395 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-b7fda7e5-5e36-4b01-941f-bc06b4271f1f None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:03.266920 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b7fda7e5-5e36-4b01-941f-bc06b4271f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:03.406449 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1/3] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:03.544618 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72750418-a2b3-4710-bffe-0f2d569c887e None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:03.578549 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG oslo_db.sqlalchemy.engines [None req-72750418-a2b3-4710-bffe-0f2d569c887e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73403) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 02:17:03.709418 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72750418-a2b3-4710-bffe-0f2d569c887e None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:03.713708 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd86bb-05fc-4a2b-87f1-ed3646b232d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:03.714369 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd86bb-05fc-4a2b-87f1-ed3646b232d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:03.714658 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd86bb-05fc-4a2b-87f1-ed3646b232d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:03.714940 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd86bb-05fc-4a2b-87f1-ed3646b232d9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:03.722905 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd86bb-05fc-4a2b-87f1-ed3646b232d9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:03.773198 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7cdd86bb-05fc-4a2b-87f1-ed3646b232d9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 15 02:17:03.773556 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd86bb-05fc-4a2b-87f1-ed3646b232d9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:03.782739 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 3/4] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:03.789934 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fda7e5-5e36-4b01-941f-bc06b4271f1f None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:03.803833 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fda7e5-5e36-4b01-941f-bc06b4271f1f None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:03.808139 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6efe2-227f-4e08-9268-e1569b124229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:03.809243 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6efe2-227f-4e08-9268-e1569b124229 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:03.809524 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6efe2-227f-4e08-9268-e1569b124229 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:03.809815 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6efe2-227f-4e08-9268-e1569b124229 admin admin] PATH_INFO: `/v3/projects/2c09835f6deb405b989b793378de873e` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:03.811395 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6efe2-227f-4e08-9268-e1569b124229 admin admin] RBAC: Authorizing `identity:get_project(project_id=2c09835f6deb405b989b793378de873e)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:03.863455 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b4f6efe2-227f-4e08-9268-e1569b124229 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 15 02:17:03.863798 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6efe2-227f-4e08-9268-e1569b124229 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:03.868236 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 2/5] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:03 2021] GET /identity/v3/projects/2c09835f6deb405b989b793378de873e => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:05.959666 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cf972-d8b4-4fe3-8940-38b41b5a3f95 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:05.960286 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cf972-d8b4-4fe3-8940-38b41b5a3f95 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:05.960286 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cf972-d8b4-4fe3-8940-38b41b5a3f95 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:05.964823 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 4/6] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:05 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:05.971903 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f34755-7201-469c-b1b6-e89d40296f91 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:05.972312 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f34755-7201-469c-b1b6-e89d40296f91 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:05.972449 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f34755-7201-469c-b1b6-e89d40296f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:05.991385 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-77f34755-7201-469c-b1b6-e89d40296f91 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:05.992897 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-77f34755-7201-469c-b1b6-e89d40296f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:06.000488 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 3/7] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:06.023744 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cf972-d8b4-4fe3-8940-38b41b5a3f95 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:06.036402 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cf972-d8b4-4fe3-8940-38b41b5a3f95 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:06.040804 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307674e7-9c51-423f-ad5d-dd8f1376a879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:06.041494 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307674e7-9c51-423f-ad5d-dd8f1376a879 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:06.041783 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307674e7-9c51-423f-ad5d-dd8f1376a879 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:06.042064 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307674e7-9c51-423f-ad5d-dd8f1376a879 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:06.049683 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307674e7-9c51-423f-ad5d-dd8f1376a879 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:06.051458 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307674e7-9c51-423f-ad5d-dd8f1376a879 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:06.060030 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 5/8] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:06.065802 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f34755-7201-469c-b1b6-e89d40296f91 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:06.074532 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f34755-7201-469c-b1b6-e89d40296f91 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:06.078937 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f2ae8-1738-432e-b9a9-83d83de9cd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:06.079781 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f2ae8-1738-432e-b9a9-83d83de9cd39 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:06.080064 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f2ae8-1738-432e-b9a9-83d83de9cd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:06.080340 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f2ae8-1738-432e-b9a9-83d83de9cd39 admin admin] PATH_INFO: `/v3/users/a88ff9155434478bafd7ce991d7c4650` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:06.081734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f2ae8-1738-432e-b9a9-83d83de9cd39 admin admin] RBAC: Authorizing `identity:get_user(user_id=a88ff9155434478bafd7ce991d7c4650)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:06.084060 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f2ae8-1738-432e-b9a9-83d83de9cd39 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:06.085625 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 4/9] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:06 2021] GET /identity/v3/users/a88ff9155434478bafd7ce991d7c4650 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:08.265156 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57e0a8-6538-4ec9-9b37-8ae038b635f6 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:08.265703 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57e0a8-6538-4ec9-9b37-8ae038b635f6 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:08.265703 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57e0a8-6538-4ec9-9b37-8ae038b635f6 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:08.267431 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 6/10] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:08.274942 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6517454-85b0-4bb5-8498-acefb5834940 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:08.275330 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6517454-85b0-4bb5-8498-acefb5834940 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:08.275493 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6517454-85b0-4bb5-8498-acefb5834940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:08.293105 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-c6517454-85b0-4bb5-8498-acefb5834940 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:08.294293 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-c6517454-85b0-4bb5-8498-acefb5834940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:08.301776 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 5/11] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:08.302121 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95b95d-2f05-4619-8f46-fcd6cd1b6e45 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:08.302414 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95b95d-2f05-4619-8f46-fcd6cd1b6e45 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:08.302692 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95b95d-2f05-4619-8f46-fcd6cd1b6e45 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:08.304499 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 7/12] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:17:08.311586 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b281e-ba95-471f-95aa-a56ddffb70b4 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:08.311880 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b281e-ba95-471f-95aa-a56ddffb70b4 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:08.312162 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b281e-ba95-471f-95aa-a56ddffb70b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:08.325267 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95b95d-2f05-4619-8f46-fcd6cd1b6e45 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:08.329220 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-0f2b281e-ba95-471f-95aa-a56ddffb70b4 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:08.330417 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-0f2b281e-ba95-471f-95aa-a56ddffb70b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:08.337624 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95b95d-2f05-4619-8f46-fcd6cd1b6e45 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:08.338469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 6/13] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:08.342098 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed6f06-7af7-42df-a565-768beb4d2153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:08.342865 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed6f06-7af7-42df-a565-768beb4d2153 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:08.343154 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed6f06-7af7-42df-a565-768beb4d2153 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:08.343431 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed6f06-7af7-42df-a565-768beb4d2153 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:08.360138 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed6f06-7af7-42df-a565-768beb4d2153 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:08.361685 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b281e-ba95-471f-95aa-a56ddffb70b4 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:08.367717 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-39ed6f06-7af7-42df-a565-768beb4d2153 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:17:08.368935 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 8/14] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:17:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:17:08.370680 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b281e-ba95-471f-95aa-a56ddffb70b4 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:08.374924 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed6f06-7af7-42df-a565-768beb4d2153 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:08.375383 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091bd00-8f87-4b21-9b4c-0cd5630388f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:08.376016 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091bd00-8f87-4b21-9b4c-0cd5630388f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:08.376303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091bd00-8f87-4b21-9b4c-0cd5630388f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:08.376579 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091bd00-8f87-4b21-9b4c-0cd5630388f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:08.384337 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed6f06-7af7-42df-a565-768beb4d2153 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:08.384467 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0091bd00-8f87-4b21-9b4c-0cd5630388f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:08.386286 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0091bd00-8f87-4b21-9b4c-0cd5630388f9 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:08.388715 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283da848-6290-423f-80d7-fe2c9ef60603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:08.389364 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283da848-6290-423f-80d7-fe2c9ef60603 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:08.389653 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283da848-6290-423f-80d7-fe2c9ef60603 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:08.389936 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283da848-6290-423f-80d7-fe2c9ef60603 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:08.390672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283da848-6290-423f-80d7-fe2c9ef60603 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:08.390982 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283da848-6290-423f-80d7-fe2c9ef60603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:08.392683 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING py.warnings [None req-283da848-6290-423f-80d7-fe2c9ef60603 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:17:08.392683 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: warnings.warn(msg) Sep 15 02:17:08.392683 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: Sep 15 02:17:08.393615 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283da848-6290-423f-80d7-fe2c9ef60603 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:08.395518 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 7/15] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:08 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:08.401304 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091bd00-8f87-4b21-9b4c-0cd5630388f9 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:08.407940 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 9/16] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:08.409526 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091bd00-8f87-4b21-9b4c-0cd5630388f9 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:08.414327 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283da848-6290-423f-80d7-fe2c9ef60603 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:08.414551 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d9fda-397a-4f7f-9ff9-abac66acaebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:08.415310 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d9fda-397a-4f7f-9ff9-abac66acaebf admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:08.415593 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d9fda-397a-4f7f-9ff9-abac66acaebf admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:08.415865 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d9fda-397a-4f7f-9ff9-abac66acaebf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:08.417079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d9fda-397a-4f7f-9ff9-abac66acaebf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:08.418764 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d9fda-397a-4f7f-9ff9-abac66acaebf admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:08.420300 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 8/17] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:08 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:08.423652 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283da848-6290-423f-80d7-fe2c9ef60603 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:08.428221 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08838397-884c-46fd-8860-c0ab8a6e2dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:08.429141 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08838397-884c-46fd-8860-c0ab8a6e2dca admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:08.429428 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08838397-884c-46fd-8860-c0ab8a6e2dca admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:08.429706 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08838397-884c-46fd-8860-c0ab8a6e2dca admin admin] PATH_INFO: `/v3/users/a88ff9155434478bafd7ce991d7c4650` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:08.431508 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08838397-884c-46fd-8860-c0ab8a6e2dca admin admin] RBAC: Authorizing `identity:get_user(user_id=a88ff9155434478bafd7ce991d7c4650)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:08.433420 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08838397-884c-46fd-8860-c0ab8a6e2dca admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:08.435129 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 10/18] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:08 2021] GET /identity/v3/users/a88ff9155434478bafd7ce991d7c4650 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:08.441462 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d9fda-397a-4f7f-9ff9-abac66acaebf admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:08.451578 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d9fda-397a-4f7f-9ff9-abac66acaebf admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:08.456153 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832f02a-4f6d-431f-b454-4f7809c53713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:08.456995 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832f02a-4f6d-431f-b454-4f7809c53713 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:08.457817 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832f02a-4f6d-431f-b454-4f7809c53713 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:08.458090 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832f02a-4f6d-431f-b454-4f7809c53713 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:08.459343 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832f02a-4f6d-431f-b454-4f7809c53713 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:08.461110 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832f02a-4f6d-431f-b454-4f7809c53713 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:08.462754 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 9/19] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:08 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:08.470638 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08838397-884c-46fd-8860-c0ab8a6e2dca admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:08.482202 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08838397-884c-46fd-8860-c0ab8a6e2dca admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:08.486737 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27736ac-e087-47d2-b715-b02f3c9aa427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:08.487657 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27736ac-e087-47d2-b715-b02f3c9aa427 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:08.487942 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27736ac-e087-47d2-b715-b02f3c9aa427 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:08.488230 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27736ac-e087-47d2-b715-b02f3c9aa427 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:08.489174 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27736ac-e087-47d2-b715-b02f3c9aa427 admin admin] RBAC: Adding query filter params (role.id=19308d3515f546e9a04e44ae278cd111, scope.domain.id=default, user.id=a88ff9155434478bafd7ce991d7c4650) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:08.489489 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27736ac-e087-47d2-b715-b02f3c9aa427 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:08.490518 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING py.warnings [None req-a27736ac-e087-47d2-b715-b02f3c9aa427 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:17:08.490518 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: warnings.warn(msg) Sep 15 02:17:08.490518 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: Sep 15 02:17:08.491723 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27736ac-e087-47d2-b715-b02f3c9aa427 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:08.501191 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 11/20] 10.222.0.32 () {56 vars in 1344 bytes} [Wed Sep 15 02:17:08 2021] GET /identity/v3/role_assignments?user.id=a88ff9155434478bafd7ce991d7c4650&scope.domain.id=default&role.id=19308d3515f546e9a04e44ae278cd111 => generated 233 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:10.945860 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5620f-3266-4627-8394-594cf9f7764c None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:10.946899 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5620f-3266-4627-8394-594cf9f7764c None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:10.947384 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5620f-3266-4627-8394-594cf9f7764c None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:10.949972 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 10/21] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:10.958156 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58078a11-922f-46dd-90ef-39053b82ea09 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:10.959085 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58078a11-922f-46dd-90ef-39053b82ea09 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:10.959581 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58078a11-922f-46dd-90ef-39053b82ea09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:11.010146 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG passlib.handlers.bcrypt [None req-58078a11-922f-46dd-90ef-39053b82ea09 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73403) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 15 02:17:11.010942 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG passlib.handlers.bcrypt [None req-58078a11-922f-46dd-90ef-39053b82ea09 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73403) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 15 02:17:11.059809 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-58078a11-922f-46dd-90ef-39053b82ea09 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:11.061779 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-58078a11-922f-46dd-90ef-39053b82ea09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:11.091960 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b8418-cd83-424c-9f85-ca93ec752173 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:11.092564 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b8418-cd83-424c-9f85-ca93ec752173 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:11.093104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b8418-cd83-424c-9f85-ca93ec752173 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:11.095357 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 11/22] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:17:11.103052 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57987f-4231-42b2-9bec-3c28e19cb977 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:11.103599 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57987f-4231-42b2-9bec-3c28e19cb977 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:11.104066 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57987f-4231-42b2-9bec-3c28e19cb977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:11.105775 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 12/23] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:11.122952 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-fd57987f-4231-42b2-9bec-3c28e19cb977 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:11.124473 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-fd57987f-4231-42b2-9bec-3c28e19cb977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:11.145570 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 12/24] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:11.147340 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58078a11-922f-46dd-90ef-39053b82ea09 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:11.164857 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58078a11-922f-46dd-90ef-39053b82ea09 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:11.173120 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57987f-4231-42b2-9bec-3c28e19cb977 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:11.177583 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30969843-433c-45da-8790-3374a5e9a529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:11.178611 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30969843-433c-45da-8790-3374a5e9a529 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:11.178897 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30969843-433c-45da-8790-3374a5e9a529 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:11.179175 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30969843-433c-45da-8790-3374a5e9a529 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:11.180080 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30969843-433c-45da-8790-3374a5e9a529 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:11.181500 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING py.warnings [None req-30969843-433c-45da-8790-3374a5e9a529 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:17:11.181500 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: warnings.warn(msg) Sep 15 02:17:11.181500 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: Sep 15 02:17:11.182700 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30969843-433c-45da-8790-3374a5e9a529 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:11.190548 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57987f-4231-42b2-9bec-3c28e19cb977 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:11.195922 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3af100-2172-4804-ba29-46b834c98a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:11.197047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3af100-2172-4804-ba29-46b834c98a33 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:11.197526 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3af100-2172-4804-ba29-46b834c98a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:11.198018 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3af100-2172-4804-ba29-46b834c98a33 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:11.224902 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3af100-2172-4804-ba29-46b834c98a33 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:11.232207 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-ae3af100-2172-4804-ba29-46b834c98a33 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:17:11.234053 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 13/25] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:17:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:17:11.246117 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3af100-2172-4804-ba29-46b834c98a33 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:11.257965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3af100-2172-4804-ba29-46b834c98a33 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:11.268564 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6562b3-ec8f-4fa6-8c02-be3c3577205c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:11.270131 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6562b3-ec8f-4fa6-8c02-be3c3577205c admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:11.270609 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6562b3-ec8f-4fa6-8c02-be3c3577205c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:11.271073 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6562b3-ec8f-4fa6-8c02-be3c3577205c admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:11.272014 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6562b3-ec8f-4fa6-8c02-be3c3577205c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:11.272508 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6562b3-ec8f-4fa6-8c02-be3c3577205c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:11.274538 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING py.warnings [None req-cb6562b3-ec8f-4fa6-8c02-be3c3577205c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:17:11.274538 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: warnings.warn(msg) Sep 15 02:17:11.274538 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: Sep 15 02:17:11.275747 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6562b3-ec8f-4fa6-8c02-be3c3577205c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:11.298213 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 14/26] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:11.304714 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6562b3-ec8f-4fa6-8c02-be3c3577205c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:11.317768 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6562b3-ec8f-4fa6-8c02-be3c3577205c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:11.328871 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a550b0-b58e-4989-98c1-6bc279800eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:11.330111 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a550b0-b58e-4989-98c1-6bc279800eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:11.330582 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a550b0-b58e-4989-98c1-6bc279800eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:11.331044 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a550b0-b58e-4989-98c1-6bc279800eb7 admin admin] PATH_INFO: `/v3/users/a88ff9155434478bafd7ce991d7c4650` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:11.333043 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a550b0-b58e-4989-98c1-6bc279800eb7 admin admin] RBAC: Authorizing `identity:get_user(user_id=a88ff9155434478bafd7ce991d7c4650)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:11.335053 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a550b0-b58e-4989-98c1-6bc279800eb7 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:11.341218 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 15/27] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:11 2021] GET /identity/v3/users/a88ff9155434478bafd7ce991d7c4650 => generated 247 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:11.343303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a550b0-b58e-4989-98c1-6bc279800eb7 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:11.357001 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a550b0-b58e-4989-98c1-6bc279800eb7 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:11.368816 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1e375-bff3-4c73-8a0c-6744acf6ac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:11.369980 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1e375-bff3-4c73-8a0c-6744acf6ac62 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:11.370453 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1e375-bff3-4c73-8a0c-6744acf6ac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:11.370915 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1e375-bff3-4c73-8a0c-6744acf6ac62 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:11.372273 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1e375-bff3-4c73-8a0c-6744acf6ac62 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:11.374279 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1e375-bff3-4c73-8a0c-6744acf6ac62 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:11.376587 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 16/28] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:11 2021] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:11.383201 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1e375-bff3-4c73-8a0c-6744acf6ac62 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:11.393352 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1e375-bff3-4c73-8a0c-6744acf6ac62 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:11.405833 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5618325-8b39-4e4c-acea-65a0be881839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:11.407060 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5618325-8b39-4e4c-acea-65a0be881839 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:11.407530 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5618325-8b39-4e4c-acea-65a0be881839 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:11.407992 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5618325-8b39-4e4c-acea-65a0be881839 admin admin] PATH_INFO: `/v3/domains/default/users/a88ff9155434478bafd7ce991d7c4650/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:11.410787 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5618325-8b39-4e4c-acea-65a0be881839 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a88ff9155434478bafd7ce991d7c4650, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:11.412033 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING py.warnings [None req-e5618325-8b39-4e4c-acea-65a0be881839 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:17:11.412033 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: warnings.warn(msg) Sep 15 02:17:11.412033 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: Sep 15 02:17:11.420901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5618325-8b39-4e4c-acea-65a0be881839 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:11.432946 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 13/29] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:17:11 2021] POST /identity/v3/roles => generated 219 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:17:11.539795 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53725bc7-2af5-4d93-bd01-ff7eec13360c None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:11.540097 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53725bc7-2af5-4d93-bd01-ff7eec13360c None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:11.540364 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53725bc7-2af5-4d93-bd01-ff7eec13360c None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:11.542377 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 14/30] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:17:11.556611 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdecda9-2979-4430-b55f-848efe561f88 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:11.556945 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdecda9-2979-4430-b55f-848efe561f88 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:11.557190 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdecda9-2979-4430-b55f-848efe561f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:11.602775 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-0fdecda9-2979-4430-b55f-848efe561f88 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:11.604403 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-0fdecda9-2979-4430-b55f-848efe561f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:11.674935 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 17/31] 10.222.0.32 () {58 vars in 1383 bytes} [Wed Sep 15 02:17:11 2021] PUT /identity/v3/domains/default/users/a88ff9155434478bafd7ce991d7c4650/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:17:11.744991 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 15/32] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:11.790583 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5618325-8b39-4e4c-acea-65a0be881839 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:11.807340 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5618325-8b39-4e4c-acea-65a0be881839 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:11.817930 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576de7ce-21de-4664-bee2-b71b03ca746b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:11.818764 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576de7ce-21de-4664-bee2-b71b03ca746b admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:11.819054 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576de7ce-21de-4664-bee2-b71b03ca746b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:11.819340 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576de7ce-21de-4664-bee2-b71b03ca746b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:11.836746 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576de7ce-21de-4664-bee2-b71b03ca746b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:11.838897 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576de7ce-21de-4664-bee2-b71b03ca746b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:11.856841 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-576de7ce-21de-4664-bee2-b71b03ca746b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:11.859213 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 18/33] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:11.865271 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdecda9-2979-4430-b55f-848efe561f88 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:11.879819 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdecda9-2979-4430-b55f-848efe561f88 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:11.890624 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f2e0b-9f3d-4fba-bb2f-45e154f95625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:11.891379 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f2e0b-9f3d-4fba-bb2f-45e154f95625 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:11.891672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f2e0b-9f3d-4fba-bb2f-45e154f95625 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:11.891951 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f2e0b-9f3d-4fba-bb2f-45e154f95625 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:11.892708 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f2e0b-9f3d-4fba-bb2f-45e154f95625 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:11.893047 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f2e0b-9f3d-4fba-bb2f-45e154f95625 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:11.894343 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING py.warnings [None req-eb3f2e0b-9f3d-4fba-bb2f-45e154f95625 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:17:11.894343 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: warnings.warn(msg) Sep 15 02:17:11.894343 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: Sep 15 02:17:11.895317 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f2e0b-9f3d-4fba-bb2f-45e154f95625 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:11.923298 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 16/34] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:11.929984 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576de7ce-21de-4664-bee2-b71b03ca746b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:11.943392 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576de7ce-21de-4664-bee2-b71b03ca746b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:11.949448 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cf91d-55b8-41e6-9331-d753fcbb1aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:11.950181 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf91d-55b8-41e6-9331-d753fcbb1aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:11.950407 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf91d-55b8-41e6-9331-d753fcbb1aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:11.950682 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf91d-55b8-41e6-9331-d753fcbb1aa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:11.951414 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cf91d-55b8-41e6-9331-d753fcbb1aa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:11.952552 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING py.warnings [None req-d14cf91d-55b8-41e6-9331-d753fcbb1aa6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:17:11.952552 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: warnings.warn(msg) Sep 15 02:17:11.952552 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: Sep 15 02:17:11.953816 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cf91d-55b8-41e6-9331-d753fcbb1aa6 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:11.994545 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 19/35] 10.222.0.32 () {60 vars in 1163 bytes} [Wed Sep 15 02:17:11 2021] POST /identity/v3/projects => generated 301 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:17:12.067524 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70121f40-2009-4e7e-b838-a1deebf10dcf None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:12.068255 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70121f40-2009-4e7e-b838-a1deebf10dcf None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:12.068255 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70121f40-2009-4e7e-b838-a1deebf10dcf None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:12.070218 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 17/36] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:12.078516 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b3a9e-64d6-42fa-9719-600777d2745c None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:12.078827 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b3a9e-64d6-42fa-9719-600777d2745c None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:12.079071 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b3a9e-64d6-42fa-9719-600777d2745c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:12.102820 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-3c3b3a9e-64d6-42fa-9719-600777d2745c None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:12.104395 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-3c3b3a9e-64d6-42fa-9719-600777d2745c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:12.186176 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 20/37] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:12.212673 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70121f40-2009-4e7e-b838-a1deebf10dcf None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:12.227069 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70121f40-2009-4e7e-b838-a1deebf10dcf None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:12.234143 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffff457-d6e4-49bd-8e45-1066baea78f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:12.234871 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffff457-d6e4-49bd-8e45-1066baea78f6 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:12.235195 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffff457-d6e4-49bd-8e45-1066baea78f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:12.235478 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffff457-d6e4-49bd-8e45-1066baea78f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:12.236297 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffff457-d6e4-49bd-8e45-1066baea78f6 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:12.238794 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffff457-d6e4-49bd-8e45-1066baea78f6 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:12.259263 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 18/38] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:17:12 2021] POST /identity/v3/roles => generated 225 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:17:12.440472 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1d22e-8034-41e0-b190-2878a26e82c7 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:12.440798 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1d22e-8034-41e0-b190-2878a26e82c7 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:12.441069 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1d22e-8034-41e0-b190-2878a26e82c7 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:12.442930 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 21/39] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:12.450681 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1be5c-515b-4975-99a7-71fb078bdfb8 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:12.451038 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1be5c-515b-4975-99a7-71fb078bdfb8 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:12.451325 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1be5c-515b-4975-99a7-71fb078bdfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:12.477199 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-e5a1be5c-515b-4975-99a7-71fb078bdfb8 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:12.479107 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e5a1be5c-515b-4975-99a7-71fb078bdfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:12.486768 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 19/40] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:12.511795 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1d22e-8034-41e0-b190-2878a26e82c7 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:12.524247 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1d22e-8034-41e0-b190-2878a26e82c7 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:12.529185 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7740a-1788-4ea2-9296-d1a7a27b6a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:12.529975 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7740a-1788-4ea2-9296-d1a7a27b6a03 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:12.530264 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7740a-1788-4ea2-9296-d1a7a27b6a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:12.530541 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7740a-1788-4ea2-9296-d1a7a27b6a03 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:12.531740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7740a-1788-4ea2-9296-d1a7a27b6a03 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:12.533525 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7740a-1788-4ea2-9296-d1a7a27b6a03 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:12.535871 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 22/41] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:12.541778 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1be5c-515b-4975-99a7-71fb078bdfb8 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:12.551424 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1be5c-515b-4975-99a7-71fb078bdfb8 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:12.555950 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a6819-8bb1-4cad-9614-51c32d5e7566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:12.556607 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a6819-8bb1-4cad-9614-51c32d5e7566 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:12.556908 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a6819-8bb1-4cad-9614-51c32d5e7566 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:12.557189 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a6819-8bb1-4cad-9614-51c32d5e7566 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:12.558153 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a6819-8bb1-4cad-9614-51c32d5e7566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:12.559174 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING py.warnings [None req-7a9a6819-8bb1-4cad-9614-51c32d5e7566 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:17:12.559174 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: warnings.warn(msg) Sep 15 02:17:12.559174 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: Sep 15 02:17:12.560389 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a6819-8bb1-4cad-9614-51c32d5e7566 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:12.587457 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 20/42] 10.222.0.32 () {60 vars in 1163 bytes} [Wed Sep 15 02:17:12 2021] POST /identity/v3/projects => generated 312 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:17:12.746584 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3a8e1-2f7c-48de-9162-a2d86c5cfa4e None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:12.746870 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3a8e1-2f7c-48de-9162-a2d86c5cfa4e None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:12.747065 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3a8e1-2f7c-48de-9162-a2d86c5cfa4e None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:12.749020 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 23/43] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:12.756514 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d7d54-c349-42e5-b971-c2f1c8b4c988 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:12.756802 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d7d54-c349-42e5-b971-c2f1c8b4c988 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:12.757886 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d7d54-c349-42e5-b971-c2f1c8b4c988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:12.777138 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-866d7d54-c349-42e5-b971-c2f1c8b4c988 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:12.778329 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-866d7d54-c349-42e5-b971-c2f1c8b4c988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:12.835864 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 21/44] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:12.859571 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3a8e1-2f7c-48de-9162-a2d86c5cfa4e None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:12.871857 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3a8e1-2f7c-48de-9162-a2d86c5cfa4e None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:12.876124 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d007b-4bee-4d46-a9b9-81f0aee17cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:12.876783 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d007b-4bee-4d46-a9b9-81f0aee17cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:12.877120 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d007b-4bee-4d46-a9b9-81f0aee17cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:12.877412 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d007b-4bee-4d46-a9b9-81f0aee17cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:12.878154 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d007b-4bee-4d46-a9b9-81f0aee17cd1 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:12.879204 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING py.warnings [None req-9f2d007b-4bee-4d46-a9b9-81f0aee17cd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:17:12.879204 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: warnings.warn(msg) Sep 15 02:17:12.879204 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: Sep 15 02:17:12.880103 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d007b-4bee-4d46-a9b9-81f0aee17cd1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:12.895105 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 24/45] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:17:12 2021] POST /identity/v3/roles => generated 223 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:17:14.126254 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ebbf1-d7cd-4b77-921c-ba1430921b1f None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:14.126784 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ebbf1-d7cd-4b77-921c-ba1430921b1f None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:14.126867 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ebbf1-d7cd-4b77-921c-ba1430921b1f None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:14.128602 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 22/46] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:14.135778 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89c823-9119-4ff4-b2d1-6ea769ecc573 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:14.136189 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89c823-9119-4ff4-b2d1-6ea769ecc573 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:14.136321 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89c823-9119-4ff4-b2d1-6ea769ecc573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:14.154495 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-eb89c823-9119-4ff4-b2d1-6ea769ecc573 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:14.155662 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-eb89c823-9119-4ff4-b2d1-6ea769ecc573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:14.163744 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 25/47] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:14.187479 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ebbf1-d7cd-4b77-921c-ba1430921b1f None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:14.199277 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ebbf1-d7cd-4b77-921c-ba1430921b1f None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:14.203469 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ec2e6-6681-4f74-8e69-a640a9b5d388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:14.204251 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ec2e6-6681-4f74-8e69-a640a9b5d388 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:14.204533 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ec2e6-6681-4f74-8e69-a640a9b5d388 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:14.204805 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ec2e6-6681-4f74-8e69-a640a9b5d388 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:14.215179 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0ec2e6-6681-4f74-8e69-a640a9b5d388 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:14.221915 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-db0ec2e6-6681-4f74-8e69-a640a9b5d388 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:17:14.223876 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 23/48] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:17:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:14.229900 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89c823-9119-4ff4-b2d1-6ea769ecc573 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:14.239076 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89c823-9119-4ff4-b2d1-6ea769ecc573 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:14.243475 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bd5c4-d6ee-4374-b508-db16c3dd649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:14.244140 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bd5c4-d6ee-4374-b508-db16c3dd649b admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:14.244427 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bd5c4-d6ee-4374-b508-db16c3dd649b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:14.244710 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bd5c4-d6ee-4374-b508-db16c3dd649b admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:14.245498 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582bd5c4-d6ee-4374-b508-db16c3dd649b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:14.245814 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582bd5c4-d6ee-4374-b508-db16c3dd649b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:14.247413 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582bd5c4-d6ee-4374-b508-db16c3dd649b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:14.255481 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 26/49] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:14.261232 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ec2e6-6681-4f74-8e69-a640a9b5d388 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:14.271658 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ec2e6-6681-4f74-8e69-a640a9b5d388 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:14.276063 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2ef82-d753-4018-b862-6e907a96cebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:14.276930 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2ef82-d753-4018-b862-6e907a96cebf admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:14.277218 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2ef82-d753-4018-b862-6e907a96cebf admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:14.277496 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2ef82-d753-4018-b862-6e907a96cebf admin admin] PATH_INFO: `/v3/users/a88ff9155434478bafd7ce991d7c4650` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:14.278901 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2ef82-d753-4018-b862-6e907a96cebf admin admin] RBAC: Authorizing `identity:get_user(user_id=a88ff9155434478bafd7ce991d7c4650)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:14.280718 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2ef82-d753-4018-b862-6e907a96cebf admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:14.282457 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 24/50] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:14 2021] GET /identity/v3/users/a88ff9155434478bafd7ce991d7c4650 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:14.288506 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bd5c4-d6ee-4374-b508-db16c3dd649b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:14.298283 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bd5c4-d6ee-4374-b508-db16c3dd649b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:14.302637 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2bd94-71f3-49b6-b8e3-e108c111d0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:14.303423 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2bd94-71f3-49b6-b8e3-e108c111d0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:14.303709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2bd94-71f3-49b6-b8e3-e108c111d0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:14.303988 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2bd94-71f3-49b6-b8e3-e108c111d0e0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:14.305189 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2bd94-71f3-49b6-b8e3-e108c111d0e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:14.306896 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2bd94-71f3-49b6-b8e3-e108c111d0e0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:14.308456 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 27/51] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:14.314405 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2ef82-d753-4018-b862-6e907a96cebf admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:14.323819 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2ef82-d753-4018-b862-6e907a96cebf admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:14.328152 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6ec69-269e-4de3-add9-6c25b1cf5ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:14.328786 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6ec69-269e-4de3-add9-6c25b1cf5ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:14.329097 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6ec69-269e-4de3-add9-6c25b1cf5ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:14.329376 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6ec69-269e-4de3-add9-6c25b1cf5ba1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:14.330200 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6ec69-269e-4de3-add9-6c25b1cf5ba1 admin admin] RBAC: Adding query filter params (role.id=19308d3515f546e9a04e44ae278cd111, scope.domain.id=default, user.id=a88ff9155434478bafd7ce991d7c4650) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:14.330509 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6ec69-269e-4de3-add9-6c25b1cf5ba1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:14.332850 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6ec69-269e-4de3-add9-6c25b1cf5ba1 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:14.338479 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 25/52] 10.222.0.32 () {56 vars in 1344 bytes} [Wed Sep 15 02:17:14 2021] GET /identity/v3/role_assignments?user.id=a88ff9155434478bafd7ce991d7c4650&scope.domain.id=default&role.id=19308d3515f546e9a04e44ae278cd111 => generated 530 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:14.769978 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48810b-7009-4d5b-905a-fc0c9c8bafc8 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:14.770239 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48810b-7009-4d5b-905a-fc0c9c8bafc8 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:14.770467 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d48810b-7009-4d5b-905a-fc0c9c8bafc8 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:14.772738 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 28/53] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:14.779697 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4408a-f555-4993-b5c3-3c286b36b400 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:14.779989 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4408a-f555-4993-b5c3-3c286b36b400 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:14.780277 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4408a-f555-4993-b5c3-3c286b36b400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:14.797661 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-15e4408a-f555-4993-b5c3-3c286b36b400 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:14.798858 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-15e4408a-f555-4993-b5c3-3c286b36b400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:14.806405 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 26/54] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:14.829903 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48810b-7009-4d5b-905a-fc0c9c8bafc8 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:14.842260 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d48810b-7009-4d5b-905a-fc0c9c8bafc8 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:14.846462 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71249c91-595c-43a6-a5fd-c86bdadf2de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:14.847223 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71249c91-595c-43a6-a5fd-c86bdadf2de7 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:14.847506 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71249c91-595c-43a6-a5fd-c86bdadf2de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:14.847778 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71249c91-595c-43a6-a5fd-c86bdadf2de7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:14.848950 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71249c91-595c-43a6-a5fd-c86bdadf2de7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:14.850671 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71249c91-595c-43a6-a5fd-c86bdadf2de7 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:14.852199 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 29/55] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:14.857824 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4408a-f555-4993-b5c3-3c286b36b400 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:14.867518 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4408a-f555-4993-b5c3-3c286b36b400 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:14.872002 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edf2bf-265c-4f21-a063-f07b6864c78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:14.872664 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edf2bf-265c-4f21-a063-f07b6864c78f admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:14.873018 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edf2bf-265c-4f21-a063-f07b6864c78f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:14.873307 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edf2bf-265c-4f21-a063-f07b6864c78f admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:14.874039 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edf2bf-265c-4f21-a063-f07b6864c78f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:14.875955 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edf2bf-265c-4f21-a063-f07b6864c78f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:14.900933 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 27/56] 10.222.0.32 () {60 vars in 1162 bytes} [Wed Sep 15 02:17:14 2021] POST /identity/v3/projects => generated 298 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:17:17.039835 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554aafe-bd69-4d4e-9850-8525e2dfb632 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:17.040384 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554aafe-bd69-4d4e-9850-8525e2dfb632 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:17.040384 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554aafe-bd69-4d4e-9850-8525e2dfb632 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:17.042208 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 30/57] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:17.049123 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c14fa3-546c-48fe-bf39-5b1050bff86f None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:17.049599 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c14fa3-546c-48fe-bf39-5b1050bff86f None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:17.049706 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c14fa3-546c-48fe-bf39-5b1050bff86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:17.067418 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-78c14fa3-546c-48fe-bf39-5b1050bff86f None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:17.068611 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-78c14fa3-546c-48fe-bf39-5b1050bff86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:17.124597 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 28/58] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:17.150271 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554aafe-bd69-4d4e-9850-8525e2dfb632 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:17.165025 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554aafe-bd69-4d4e-9850-8525e2dfb632 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:17.170427 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33137ffb-c2e8-4dfb-b795-a791c7936cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:17.171368 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33137ffb-c2e8-4dfb-b795-a791c7936cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:17.171653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33137ffb-c2e8-4dfb-b795-a791c7936cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:17.172023 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33137ffb-c2e8-4dfb-b795-a791c7936cc2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:17.173499 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33137ffb-c2e8-4dfb-b795-a791c7936cc2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:17.175584 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33137ffb-c2e8-4dfb-b795-a791c7936cc2 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:17.177850 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 31/59] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:17 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:17.183681 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c14fa3-546c-48fe-bf39-5b1050bff86f None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:17.193165 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c14fa3-546c-48fe-bf39-5b1050bff86f None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:17.197568 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0bdfb-2087-4711-a8ae-a9c3e4ffe038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:17.198224 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0bdfb-2087-4711-a8ae-a9c3e4ffe038 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:17.198511 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0bdfb-2087-4711-a8ae-a9c3e4ffe038 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:17.198787 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0bdfb-2087-4711-a8ae-a9c3e4ffe038 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:17.199483 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0bdfb-2087-4711-a8ae-a9c3e4ffe038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:17.200486 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING py.warnings [None req-c8e0bdfb-2087-4711-a8ae-a9c3e4ffe038 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:17:17.200486 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: warnings.warn(msg) Sep 15 02:17:17.200486 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: Sep 15 02:17:17.201750 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0bdfb-2087-4711-a8ae-a9c3e4ffe038 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:17.227081 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 29/60] 10.222.0.32 () {60 vars in 1154 bytes} [Wed Sep 15 02:17:17 2021] POST /identity/v3/users => generated 275 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:17:20.577189 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267412d-a9da-4f28-8be3-453d753b7d55 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:20.578171 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267412d-a9da-4f28-8be3-453d753b7d55 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:20.578678 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267412d-a9da-4f28-8be3-453d753b7d55 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:20.581014 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 32/61] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:20.589598 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411079d7-a84d-408c-8c5e-95162649a45c None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:20.590587 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411079d7-a84d-408c-8c5e-95162649a45c None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:20.591071 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411079d7-a84d-408c-8c5e-95162649a45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:20.618561 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-411079d7-a84d-408c-8c5e-95162649a45c None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:20.620100 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-411079d7-a84d-408c-8c5e-95162649a45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:20.632664 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 30/62] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:20.677828 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267412d-a9da-4f28-8be3-453d753b7d55 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:20.694734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267412d-a9da-4f28-8be3-453d753b7d55 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:20.695220 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90599d1-f50a-4908-9b56-c994861171a9 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:20.695770 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90599d1-f50a-4908-9b56-c994861171a9 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:20.696264 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90599d1-f50a-4908-9b56-c994861171a9 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:20.698334 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 31/63] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:17:20.705513 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc50010-c9cc-4dc9-9f40-449df6ae03f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:20.705970 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ca289-8aba-45a6-b18c-038ccea00238 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:20.706265 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ca289-8aba-45a6-b18c-038ccea00238 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:20.706548 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ca289-8aba-45a6-b18c-038ccea00238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:20.707081 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc50010-c9cc-4dc9-9f40-449df6ae03f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:20.707373 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc50010-c9cc-4dc9-9f40-449df6ae03f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:20.707651 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc50010-c9cc-4dc9-9f40-449df6ae03f1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:20.723908 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc50010-c9cc-4dc9-9f40-449df6ae03f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:20.727927 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-426ca289-8aba-45a6-b18c-038ccea00238 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:20.729316 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-426ca289-8aba-45a6-b18c-038ccea00238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:20.730785 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-3fc50010-c9cc-4dc9-9f40-449df6ae03f1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 02:17:20.732265 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 33/64] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:20.739254 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc50010-c9cc-4dc9-9f40-449df6ae03f1 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:20.749610 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 32/65] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:20.759455 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc50010-c9cc-4dc9-9f40-449df6ae03f1 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:20.761658 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04de95-97b0-450c-b705-15efb85688c3 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:20.762173 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04de95-97b0-450c-b705-15efb85688c3 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:20.762665 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04de95-97b0-450c-b705-15efb85688c3 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:20.764995 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 33/66] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:17:20.770564 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317075a4-74cd-4a01-82f3-5c3df3bbed59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:20.771250 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317075a4-74cd-4a01-82f3-5c3df3bbed59 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:20.771689 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317075a4-74cd-4a01-82f3-5c3df3bbed59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:20.771973 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a637d-3d2d-4abb-aae1-679aaa8b4083 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:20.772276 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a637d-3d2d-4abb-aae1-679aaa8b4083 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:20.772400 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317075a4-74cd-4a01-82f3-5c3df3bbed59 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:20.772557 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a637d-3d2d-4abb-aae1-679aaa8b4083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:20.773449 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317075a4-74cd-4a01-82f3-5c3df3bbed59 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:20.773998 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317075a4-74cd-4a01-82f3-5c3df3bbed59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:20.775776 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317075a4-74cd-4a01-82f3-5c3df3bbed59 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:20.786711 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 34/67] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Sep 15 02:17:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:20.787836 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317075a4-74cd-4a01-82f3-5c3df3bbed59 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:20.790881 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-053a637d-3d2d-4abb-aae1-679aaa8b4083 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:20.792292 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-053a637d-3d2d-4abb-aae1-679aaa8b4083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:20.800438 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 34/68] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:20.802042 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a637d-3d2d-4abb-aae1-679aaa8b4083 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:20.802339 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317075a4-74cd-4a01-82f3-5c3df3bbed59 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:20.811796 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a637d-3d2d-4abb-aae1-679aaa8b4083 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:20.816649 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df8a1c-5269-43c9-86b9-86baeceaa7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:20.817870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df8a1c-5269-43c9-86b9-86baeceaa7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:20.818382 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df8a1c-5269-43c9-86b9-86baeceaa7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:20.818484 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc55f4e-f563-43c7-a0c1-571b5820dfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:20.818994 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df8a1c-5269-43c9-86b9-86baeceaa7b7 admin admin] PATH_INFO: `/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:20.819204 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc55f4e-f563-43c7-a0c1-571b5820dfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:20.819495 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc55f4e-f563-43c7-a0c1-571b5820dfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:20.819776 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc55f4e-f563-43c7-a0c1-571b5820dfd7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:20.834111 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc55f4e-f563-43c7-a0c1-571b5820dfd7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:20.835432 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df8a1c-5269-43c9-86b9-86baeceaa7b7 admin admin] RBAC: Authorizing `identity:get_user(user_id=b44925dbf31f42bcbc4d0b9cb9d7a80e)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:20.837900 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df8a1c-5269-43c9-86b9-86baeceaa7b7 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:20.840161 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 35/69] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:20 2021] GET /identity/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:20.841002 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-ecc55f4e-f563-43c7-a0c1-571b5820dfd7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:17:20.841420 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df8a1c-5269-43c9-86b9-86baeceaa7b7 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:20.842469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 35/70] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:17:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:20.852164 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df8a1c-5269-43c9-86b9-86baeceaa7b7 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:20.853946 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc55f4e-f563-43c7-a0c1-571b5820dfd7 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:20.856813 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492695a-da2a-4149-829b-888ecb868856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:20.857793 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492695a-da2a-4149-829b-888ecb868856 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:20.858228 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492695a-da2a-4149-829b-888ecb868856 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:20.858651 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492695a-da2a-4149-829b-888ecb868856 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:20.865524 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc55f4e-f563-43c7-a0c1-571b5820dfd7 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:20.870324 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a11b6-4fe3-4a05-aaef-c359481617fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:20.871178 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a11b6-4fe3-4a05-aaef-c359481617fe admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:20.871393 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492695a-da2a-4149-829b-888ecb868856 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:20.871814 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a11b6-4fe3-4a05-aaef-c359481617fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:20.872284 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a11b6-4fe3-4a05-aaef-c359481617fe admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:20.873235 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a11b6-4fe3-4a05-aaef-c359481617fe admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:20.873716 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a11b6-4fe3-4a05-aaef-c359481617fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:20.875503 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a11b6-4fe3-4a05-aaef-c359481617fe admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:20.880065 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-0492695a-da2a-4149-829b-888ecb868856 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 02:17:20.882403 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 36/71] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:20.883712 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492695a-da2a-4149-829b-888ecb868856 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:20.890020 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 36/72] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:20.891134 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a11b6-4fe3-4a05-aaef-c359481617fe admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:20.895040 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492695a-da2a-4149-829b-888ecb868856 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:20.899657 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98d3fa-3f70-40c6-9637-9f989ee0e2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:20.900294 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98d3fa-3f70-40c6-9637-9f989ee0e2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:20.900588 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98d3fa-3f70-40c6-9637-9f989ee0e2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:20.900872 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98d3fa-3f70-40c6-9637-9f989ee0e2c1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:20.903141 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a11b6-4fe3-4a05-aaef-c359481617fe admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:20.907981 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d7a1f-e426-4e62-8010-74386bb4e30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:20.908859 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d7a1f-e426-4e62-8010-74386bb4e30d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:20.909230 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98d3fa-3f70-40c6-9637-9f989ee0e2c1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:20.909589 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d7a1f-e426-4e62-8010-74386bb4e30d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:20.910627 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d7a1f-e426-4e62-8010-74386bb4e30d admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:20.911593 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98d3fa-3f70-40c6-9637-9f989ee0e2c1 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:20.911839 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d7a1f-e426-4e62-8010-74386bb4e30d admin admin] RBAC: Adding query filter params (name=member) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:20.912339 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d7a1f-e426-4e62-8010-74386bb4e30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:20.914232 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d7a1f-e426-4e62-8010-74386bb4e30d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:20.926911 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 37/73] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:20 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:20.926911 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98d3fa-3f70-40c6-9637-9f989ee0e2c1 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:20.929911 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 37/74] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Sep 15 02:17:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:20.931200 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d7a1f-e426-4e62-8010-74386bb4e30d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:20.932781 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98d3fa-3f70-40c6-9637-9f989ee0e2c1 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:20.937568 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7981e-fa8b-436e-a604-77f117723cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:20.938474 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7981e-fa8b-436e-a604-77f117723cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:20.938763 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7981e-fa8b-436e-a604-77f117723cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:20.939116 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7981e-fa8b-436e-a604-77f117723cd2 admin admin] PATH_INFO: `/v3/users/a88ff9155434478bafd7ce991d7c4650` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:20.940434 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7981e-fa8b-436e-a604-77f117723cd2 admin admin] RBAC: Authorizing `identity:get_user(user_id=a88ff9155434478bafd7ce991d7c4650)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:20.948986 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7981e-fa8b-436e-a604-77f117723cd2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:20.948986 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 38/75] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:20 2021] GET /identity/v3/users/a88ff9155434478bafd7ce991d7c4650 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:20.948986 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7981e-fa8b-436e-a604-77f117723cd2 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:20.952168 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d7a1f-e426-4e62-8010-74386bb4e30d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:20.955125 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7981e-fa8b-436e-a604-77f117723cd2 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:20.957471 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9d422-cd21-4631-99de-71ee56884b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:20.958362 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9d422-cd21-4631-99de-71ee56884b2b admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:20.958659 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9d422-cd21-4631-99de-71ee56884b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:20.958913 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9d422-cd21-4631-99de-71ee56884b2b admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:20.960157 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9d422-cd21-4631-99de-71ee56884b2b admin admin] RBAC: Authorizing `identity:get_project(project_id=911c2d8152d7481fad6c6c9125f3d5a0)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:20.962349 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9d422-cd21-4631-99de-71ee56884b2b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:20.962939 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c111416-9f8a-4d39-a5fe-c51a0600eeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:20.964086 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c111416-9f8a-4d39-a5fe-c51a0600eeb2 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:20.964494 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 38/76] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:20 2021] GET /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:20.964797 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c111416-9f8a-4d39-a5fe-c51a0600eeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:20.965297 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c111416-9f8a-4d39-a5fe-c51a0600eeb2 admin admin] PATH_INFO: `/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:20.965412 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9d422-cd21-4631-99de-71ee56884b2b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:20.966992 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c111416-9f8a-4d39-a5fe-c51a0600eeb2 admin admin] RBAC: Authorizing `identity:get_user(user_id=b44925dbf31f42bcbc4d0b9cb9d7a80e)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:20.969397 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c111416-9f8a-4d39-a5fe-c51a0600eeb2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:20.971558 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 39/77] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:20 2021] GET /identity/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:20.973219 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c111416-9f8a-4d39-a5fe-c51a0600eeb2 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:20.981356 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9d422-cd21-4631-99de-71ee56884b2b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:20.985301 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c111416-9f8a-4d39-a5fe-c51a0600eeb2 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:20.986211 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecf67a-2ae9-4c6d-99b6-88a22c1829aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:20.987197 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecf67a-2ae9-4c6d-99b6-88a22c1829aa admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:20.987557 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecf67a-2ae9-4c6d-99b6-88a22c1829aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:20.987914 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecf67a-2ae9-4c6d-99b6-88a22c1829aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:20.991484 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e33b5-6f66-4a5c-b978-b5451ae6213c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:20.992412 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e33b5-6f66-4a5c-b978-b5451ae6213c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:20.992905 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e33b5-6f66-4a5c-b978-b5451ae6213c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:20.993398 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e33b5-6f66-4a5c-b978-b5451ae6213c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:20.994422 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e33b5-6f66-4a5c-b978-b5451ae6213c admin admin] RBAC: Adding query filter params (role.id=6f4a40def5d74f0a95ae44fd686a92e5, scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0, user.id=b44925dbf31f42bcbc4d0b9cb9d7a80e) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:20.994945 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e33b5-6f66-4a5c-b978-b5451ae6213c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:20.997062 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e33b5-6f66-4a5c-b978-b5451ae6213c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:20.997172 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecf67a-2ae9-4c6d-99b6-88a22c1829aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:20.998871 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecf67a-2ae9-4c6d-99b6-88a22c1829aa admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:21.003851 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 40/78] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:20 2021] GET /identity/v3/role_assignments?user.id=b44925dbf31f42bcbc4d0b9cb9d7a80e&scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0&role.id=6f4a40def5d74f0a95ae44fd686a92e5 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:21.004863 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e33b5-6f66-4a5c-b978-b5451ae6213c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:21.013036 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 39/79] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:20 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:21.015030 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecf67a-2ae9-4c6d-99b6-88a22c1829aa admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:21.016177 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e33b5-6f66-4a5c-b978-b5451ae6213c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:21.025039 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecf67a-2ae9-4c6d-99b6-88a22c1829aa admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:21.028870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93968f0b-f685-402d-a116-b23b3b882508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:21.029638 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93968f0b-f685-402d-a116-b23b3b882508 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:21.029742 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef34c60-f01c-449a-837f-afa15f8cae0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:21.029945 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93968f0b-f685-402d-a116-b23b3b882508 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:21.030214 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93968f0b-f685-402d-a116-b23b3b882508 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:21.030608 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef34c60-f01c-449a-837f-afa15f8cae0d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:21.030893 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef34c60-f01c-449a-837f-afa15f8cae0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:21.031178 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef34c60-f01c-449a-837f-afa15f8cae0d admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:21.032392 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef34c60-f01c-449a-837f-afa15f8cae0d admin admin] RBAC: Authorizing `identity:get_project(project_id=911c2d8152d7481fad6c6c9125f3d5a0)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:21.034584 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef34c60-f01c-449a-837f-afa15f8cae0d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:21.037063 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 40/80] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:21 2021] GET /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:21.038354 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8b311-d7e7-4aaa-b050-27165892b30d None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:21.038641 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8b311-d7e7-4aaa-b050-27165892b30d None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:21.038920 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8b311-d7e7-4aaa-b050-27165892b30d None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:21.040917 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 41/81] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:21.045290 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93968f0b-f685-402d-a116-b23b3b882508 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:21.047528 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93968f0b-f685-402d-a116-b23b3b882508 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:21.048389 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9571d-c72a-4568-befc-f0b53692dc30 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:21.048687 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9571d-c72a-4568-befc-f0b53692dc30 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:21.049008 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9571d-c72a-4568-befc-f0b53692dc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:21.059154 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 41/82] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:21 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:21.060294 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93968f0b-f685-402d-a116-b23b3b882508 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:21.073174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-22d9571d-c72a-4568-befc-f0b53692dc30 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:21.074240 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93968f0b-f685-402d-a116-b23b3b882508 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:21.074434 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-22d9571d-c72a-4568-befc-f0b53692dc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:21.078943 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d9c5b-733e-4e9e-bb82-dff39abed7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:21.079626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d9c5b-733e-4e9e-bb82-dff39abed7be admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:21.080008 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d9c5b-733e-4e9e-bb82-dff39abed7be admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:21.080296 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d9c5b-733e-4e9e-bb82-dff39abed7be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:21.081196 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d9c5b-733e-4e9e-bb82-dff39abed7be admin admin] RBAC: Adding query filter params (role.id=19308d3515f546e9a04e44ae278cd111, scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0, user.id=a88ff9155434478bafd7ce991d7c4650) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:21.081519 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d9c5b-733e-4e9e-bb82-dff39abed7be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:21.084467 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 42/83] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:21.084631 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d9c5b-733e-4e9e-bb82-dff39abed7be admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:21.084715 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9571d-c72a-4568-befc-f0b53692dc30 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:21.090321 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 42/84] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:21 2021] GET /identity/v3/role_assignments?user.id=a88ff9155434478bafd7ce991d7c4650&scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0&role.id=19308d3515f546e9a04e44ae278cd111 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:21.091687 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367eb0a-f55f-4c7a-a2a3-9737918835e2 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:21.092047 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367eb0a-f55f-4c7a-a2a3-9737918835e2 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:21.092333 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367eb0a-f55f-4c7a-a2a3-9737918835e2 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:21.094630 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 43/85] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:21.103296 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdec510-8d11-4dbd-ae8d-d7e9b3649f9d None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:21.103596 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdec510-8d11-4dbd-ae8d-d7e9b3649f9d None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:21.103797 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9571d-c72a-4568-befc-f0b53692dc30 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:21.103897 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdec510-8d11-4dbd-ae8d-d7e9b3649f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:21.119818 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf0c8a-dd9b-4f9a-9113-4090a01a094d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:21.120738 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf0c8a-dd9b-4f9a-9113-4090a01a094d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:21.121092 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf0c8a-dd9b-4f9a-9113-4090a01a094d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:21.121375 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf0c8a-dd9b-4f9a-9113-4090a01a094d admin admin] PATH_INFO: `/v3/projects/1e876cadd760463fbcc85b667340e817` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:21.122784 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf0c8a-dd9b-4f9a-9113-4090a01a094d admin admin] RBAC: Authorizing `identity:get_project(project_id=1e876cadd760463fbcc85b667340e817)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:21.123649 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-bcdec510-8d11-4dbd-ae8d-d7e9b3649f9d None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:21.125039 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-bcdec510-8d11-4dbd-ae8d-d7e9b3649f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:21.125159 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf0c8a-dd9b-4f9a-9113-4090a01a094d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:21.127378 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 43/86] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:21 2021] GET /identity/v3/projects/1e876cadd760463fbcc85b667340e817 => generated 312 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:21.128225 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf0c8a-dd9b-4f9a-9113-4090a01a094d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:21.143144 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 44/87] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:21.143811 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdec510-8d11-4dbd-ae8d-d7e9b3649f9d None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:21.150441 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf0c8a-dd9b-4f9a-9113-4090a01a094d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:21.156161 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdec510-8d11-4dbd-ae8d-d7e9b3649f9d None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:21.161718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdacd5a-20cc-4d15-bf06-9c5f4bc716cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:21.161953 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc99b50-6acd-4732-a1e4-f2cd7324c2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:21.162573 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdacd5a-20cc-4d15-bf06-9c5f4bc716cf admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:21.162843 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc99b50-6acd-4732-a1e4-f2cd7324c2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:21.163009 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdacd5a-20cc-4d15-bf06-9c5f4bc716cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:21.163196 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdacd5a-20cc-4d15-bf06-9c5f4bc716cf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:21.163344 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc99b50-6acd-4732-a1e4-f2cd7324c2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:21.163864 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc99b50-6acd-4732-a1e4-f2cd7324c2d2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:21.164824 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc99b50-6acd-4732-a1e4-f2cd7324c2d2 admin admin] RBAC: Adding query filter params (role.id=6f4a40def5d74f0a95ae44fd686a92e5, scope.project.id=1e876cadd760463fbcc85b667340e817, user.id=b44925dbf31f42bcbc4d0b9cb9d7a80e) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:21.165314 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc99b50-6acd-4732-a1e4-f2cd7324c2d2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:21.167448 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc99b50-6acd-4732-a1e4-f2cd7324c2d2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:21.175157 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 45/88] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:21 2021] GET /identity/v3/role_assignments?user.id=b44925dbf31f42bcbc4d0b9cb9d7a80e&scope.project.id=1e876cadd760463fbcc85b667340e817&role.id=6f4a40def5d74f0a95ae44fd686a92e5 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:21.188658 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc99b50-6acd-4732-a1e4-f2cd7324c2d2 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:21.191550 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdacd5a-20cc-4d15-bf06-9c5f4bc716cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:21.199285 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-9fdacd5a-20cc-4d15-bf06-9c5f4bc716cf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 02:17:21.200988 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 44/89] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:17:21 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:21.209726 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdacd5a-20cc-4d15-bf06-9c5f4bc716cf admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:21.212240 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc99b50-6acd-4732-a1e4-f2cd7324c2d2 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:21.225724 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afc8de-fae8-4452-9d53-c35c9c80b0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:21.226814 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afc8de-fae8-4452-9d53-c35c9c80b0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:21.227270 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afc8de-fae8-4452-9d53-c35c9c80b0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:21.227690 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afc8de-fae8-4452-9d53-c35c9c80b0d6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:21.230791 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdacd5a-20cc-4d15-bf06-9c5f4bc716cf admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:21.231888 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afc8de-fae8-4452-9d53-c35c9c80b0d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:21.233838 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afc8de-fae8-4452-9d53-c35c9c80b0d6 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:21.236590 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 46/90] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:21.243839 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afc8de-fae8-4452-9d53-c35c9c80b0d6 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:21.252635 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca2b23-d610-40e4-998f-1a681ab7d1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:21.253620 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca2b23-d610-40e4-998f-1a681ab7d1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:21.254597 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca2b23-d610-40e4-998f-1a681ab7d1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:21.255046 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca2b23-d610-40e4-998f-1a681ab7d1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:21.255998 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca2b23-d610-40e4-998f-1a681ab7d1c1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:21.256462 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca2b23-d610-40e4-998f-1a681ab7d1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:21.259561 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca2b23-d610-40e4-998f-1a681ab7d1c1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:21.265599 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afc8de-fae8-4452-9d53-c35c9c80b0d6 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:21.273018 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 45/91] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:21 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:21.279414 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca2b23-d610-40e4-998f-1a681ab7d1c1 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:21.286712 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef52392-134d-4434-a43d-f7b5c14ae4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:21.287641 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef52392-134d-4434-a43d-f7b5c14ae4ac admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:21.288071 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef52392-134d-4434-a43d-f7b5c14ae4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:21.288515 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef52392-134d-4434-a43d-f7b5c14ae4ac admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:21.289414 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef52392-134d-4434-a43d-f7b5c14ae4ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:21.290050 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca2b23-d610-40e4-998f-1a681ab7d1c1 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:21.291670 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef52392-134d-4434-a43d-f7b5c14ae4ac admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:21.300902 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8b50b-5d94-44bd-8cc0-8aea4ed63f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:21.300902 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8b50b-5d94-44bd-8cc0-8aea4ed63f47 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:21.300902 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8b50b-5d94-44bd-8cc0-8aea4ed63f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:21.300902 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8b50b-5d94-44bd-8cc0-8aea4ed63f47 admin admin] PATH_INFO: `/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:21.301314 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8b50b-5d94-44bd-8cc0-8aea4ed63f47 admin admin] RBAC: Authorizing `identity:get_user(user_id=b44925dbf31f42bcbc4d0b9cb9d7a80e)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:21.301314 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8b50b-5d94-44bd-8cc0-8aea4ed63f47 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:21.302681 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 46/92] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:21 2021] GET /identity/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:21.309232 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8b50b-5d94-44bd-8cc0-8aea4ed63f47 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:21.321395 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8b50b-5d94-44bd-8cc0-8aea4ed63f47 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:21.328655 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d53ecf-c71c-49b2-b403-e700ca2d8386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:21.329461 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d53ecf-c71c-49b2-b403-e700ca2d8386 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:21.329746 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d53ecf-c71c-49b2-b403-e700ca2d8386 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:21.330033 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d53ecf-c71c-49b2-b403-e700ca2d8386 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:21.339635 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d53ecf-c71c-49b2-b403-e700ca2d8386 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:21.341264 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 47/93] 10.222.0.32 () {60 vars in 1163 bytes} [Wed Sep 15 02:17:21 2021] POST /identity/v3/projects => generated 302 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:17:21.344975 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d53ecf-c71c-49b2-b403-e700ca2d8386 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:21.352844 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 47/94] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:21 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:21.359554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef52392-134d-4434-a43d-f7b5c14ae4ac admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:21.431456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef52392-134d-4434-a43d-f7b5c14ae4ac admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:21.436200 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68a3fa-05ba-4788-8f64-bf66e1278864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:21.437114 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68a3fa-05ba-4788-8f64-bf66e1278864 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:21.437403 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68a3fa-05ba-4788-8f64-bf66e1278864 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:21.437746 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68a3fa-05ba-4788-8f64-bf66e1278864 admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:21.439075 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68a3fa-05ba-4788-8f64-bf66e1278864 admin admin] RBAC: Authorizing `identity:get_project(project_id=911c2d8152d7481fad6c6c9125f3d5a0)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:21.441887 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68a3fa-05ba-4788-8f64-bf66e1278864 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:21.443733 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 48/95] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:21 2021] GET /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0 => generated 298 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:21.450386 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d53ecf-c71c-49b2-b403-e700ca2d8386 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:21.460509 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d53ecf-c71c-49b2-b403-e700ca2d8386 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:21.465519 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1184a-665a-4c86-b9b3-1c59dc256f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:21.466207 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1184a-665a-4c86-b9b3-1c59dc256f66 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:21.466778 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1184a-665a-4c86-b9b3-1c59dc256f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:21.467065 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1184a-665a-4c86-b9b3-1c59dc256f66 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:21.467933 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1184a-665a-4c86-b9b3-1c59dc256f66 admin admin] RBAC: Adding query filter params (role.id=4449685a6c854c46a265236ba82cd668, scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0, user.id=b44925dbf31f42bcbc4d0b9cb9d7a80e) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:21.468293 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1184a-665a-4c86-b9b3-1c59dc256f66 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:21.469422 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING py.warnings [None req-27b1184a-665a-4c86-b9b3-1c59dc256f66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:17:21.469422 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: warnings.warn(msg) Sep 15 02:17:21.469422 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: Sep 15 02:17:21.470588 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1184a-665a-4c86-b9b3-1c59dc256f66 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:21.484865 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 48/96] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:21 2021] GET /identity/v3/role_assignments?user.id=b44925dbf31f42bcbc4d0b9cb9d7a80e&scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0&role.id=4449685a6c854c46a265236ba82cd668 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:23.661737 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f4184-16d3-49fc-95b3-faecf700c48d None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:23.662257 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f4184-16d3-49fc-95b3-faecf700c48d None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:23.662327 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f4184-16d3-49fc-95b3-faecf700c48d None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:23.664107 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 49/97] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:23.671858 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0fc2f-85e0-4d87-9457-14d05ee83726 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:23.672356 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0fc2f-85e0-4d87-9457-14d05ee83726 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:23.672429 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0fc2f-85e0-4d87-9457-14d05ee83726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:23.696779 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-d3f0fc2f-85e0-4d87-9457-14d05ee83726 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:23.698001 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d3f0fc2f-85e0-4d87-9457-14d05ee83726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:23.712485 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 49/98] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:23.728743 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5540ce-640e-4c83-ae2a-8d39e73601ec None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:23.729025 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5540ce-640e-4c83-ae2a-8d39e73601ec None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:23.729283 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5540ce-640e-4c83-ae2a-8d39e73601ec None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:23.731303 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 50/99] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:23.739447 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76601085-f7c5-4fae-b51e-d0a067f68a1e None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:23.739758 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76601085-f7c5-4fae-b51e-d0a067f68a1e None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:23.740016 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76601085-f7c5-4fae-b51e-d0a067f68a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:23.761208 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-76601085-f7c5-4fae-b51e-d0a067f68a1e None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:23.762423 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-76601085-f7c5-4fae-b51e-d0a067f68a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:23.770082 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5540ce-640e-4c83-ae2a-8d39e73601ec None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:23.785836 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 50/100] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:23.787184 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5540ce-640e-4c83-ae2a-8d39e73601ec None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:23.800435 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31165aae-de91-44c7-a31d-76a7fa9170d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:23.801991 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31165aae-de91-44c7-a31d-76a7fa9170d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:23.802424 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31165aae-de91-44c7-a31d-76a7fa9170d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:23.802705 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31165aae-de91-44c7-a31d-76a7fa9170d8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:23.809593 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76601085-f7c5-4fae-b51e-d0a067f68a1e None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:23.820063 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76601085-f7c5-4fae-b51e-d0a067f68a1e None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:23.827633 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc323f-7106-42ca-a170-a0d61657edd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:23.828432 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc323f-7106-42ca-a170-a0d61657edd6 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:23.828716 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc323f-7106-42ca-a170-a0d61657edd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:23.829020 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc323f-7106-42ca-a170-a0d61657edd6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:23.830358 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31165aae-de91-44c7-a31d-76a7fa9170d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:23.837242 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-31165aae-de91-44c7-a31d-76a7fa9170d8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 02:17:23.838473 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 51/101] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:17:23.849188 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31165aae-de91-44c7-a31d-76a7fa9170d8 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:23.859532 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc323f-7106-42ca-a170-a0d61657edd6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:23.867784 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-66bc323f-7106-42ca-a170-a0d61657edd6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:17:23.868485 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31165aae-de91-44c7-a31d-76a7fa9170d8 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:23.869102 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 51/102] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:17:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:17:23.872974 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39ba6f-b608-4642-ab75-76c0735e45cd None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:23.872974 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39ba6f-b608-4642-ab75-76c0735e45cd None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:23.872974 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39ba6f-b608-4642-ab75-76c0735e45cd None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:23.872974 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 52/103] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:23.875337 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39ba6f-b608-4642-ab75-76c0735e45cd None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:23.880631 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38191038-a2d6-4e9f-a60f-3af19533858a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:23.881332 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38191038-a2d6-4e9f-a60f-3af19533858a admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:23.881617 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38191038-a2d6-4e9f-a60f-3af19533858a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:23.881978 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38191038-a2d6-4e9f-a60f-3af19533858a admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:23.882839 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38191038-a2d6-4e9f-a60f-3af19533858a admin admin] RBAC: Adding query filter params (name=member) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:23.883149 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38191038-a2d6-4e9f-a60f-3af19533858a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:23.884762 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38191038-a2d6-4e9f-a60f-3af19533858a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:23.892164 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39ba6f-b608-4642-ab75-76c0735e45cd None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:23.894992 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 52/104] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Sep 15 02:17:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:23.896444 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18678a3-6994-47e3-909a-09d8ffd339f8 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:23.896735 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18678a3-6994-47e3-909a-09d8ffd339f8 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:23.901107 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18678a3-6994-47e3-909a-09d8ffd339f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:23.903058 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76580cc-a6c6-41ad-bb85-9b56cc3528bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:23.903736 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76580cc-a6c6-41ad-bb85-9b56cc3528bc admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:23.904025 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76580cc-a6c6-41ad-bb85-9b56cc3528bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:23.904298 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76580cc-a6c6-41ad-bb85-9b56cc3528bc admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:23.905082 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76580cc-a6c6-41ad-bb85-9b56cc3528bc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:23.905392 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76580cc-a6c6-41ad-bb85-9b56cc3528bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:23.907061 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76580cc-a6c6-41ad-bb85-9b56cc3528bc admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:23.919243 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 53/105] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:23.920225 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76580cc-a6c6-41ad-bb85-9b56cc3528bc admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:23.922060 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-e18678a3-6994-47e3-909a-09d8ffd339f8 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:23.923462 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e18678a3-6994-47e3-909a-09d8ffd339f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:23.929967 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76580cc-a6c6-41ad-bb85-9b56cc3528bc admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:23.936907 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738506b6-f873-4fc6-bcdf-37026597638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:23.936907 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738506b6-f873-4fc6-bcdf-37026597638a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:23.936907 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738506b6-f873-4fc6-bcdf-37026597638a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:23.936907 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738506b6-f873-4fc6-bcdf-37026597638a admin admin] PATH_INFO: `/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:23.937237 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738506b6-f873-4fc6-bcdf-37026597638a admin admin] RBAC: Authorizing `identity:get_user(user_id=b44925dbf31f42bcbc4d0b9cb9d7a80e)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:23.937726 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 53/106] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:23.938771 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18678a3-6994-47e3-909a-09d8ffd339f8 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:23.944895 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738506b6-f873-4fc6-bcdf-37026597638a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:23.944895 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 54/107] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:23 2021] GET /identity/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:23.947289 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738506b6-f873-4fc6-bcdf-37026597638a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:23.955106 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18678a3-6994-47e3-909a-09d8ffd339f8 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:23.958746 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738506b6-f873-4fc6-bcdf-37026597638a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:23.963813 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c2c32-4519-4c0c-8208-6f6782ef7f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:23.964775 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c2c32-4519-4c0c-8208-6f6782ef7f86 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:23.965090 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c2c32-4519-4c0c-8208-6f6782ef7f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:23.965370 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c2c32-4519-4c0c-8208-6f6782ef7f86 admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:23.965768 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47994544-0694-44a4-824c-6efd7e6e6d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:23.966623 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c2c32-4519-4c0c-8208-6f6782ef7f86 admin admin] RBAC: Authorizing `identity:get_project(project_id=911c2d8152d7481fad6c6c9125f3d5a0)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:23.967062 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47994544-0694-44a4-824c-6efd7e6e6d14 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:23.967537 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47994544-0694-44a4-824c-6efd7e6e6d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:23.968020 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47994544-0694-44a4-824c-6efd7e6e6d14 admin admin] PATH_INFO: `/v3/users/a88ff9155434478bafd7ce991d7c4650` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:23.968695 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c2c32-4519-4c0c-8208-6f6782ef7f86 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:23.969604 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47994544-0694-44a4-824c-6efd7e6e6d14 admin admin] RBAC: Authorizing `identity:get_user(user_id=a88ff9155434478bafd7ce991d7c4650)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:23.970393 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 55/108] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:23 2021] GET /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:23.971824 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47994544-0694-44a4-824c-6efd7e6e6d14 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:23.974488 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 54/109] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:23 2021] GET /identity/v3/users/a88ff9155434478bafd7ce991d7c4650 => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:23.979021 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c2c32-4519-4c0c-8208-6f6782ef7f86 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:23.980410 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47994544-0694-44a4-824c-6efd7e6e6d14 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:23.991949 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c2c32-4519-4c0c-8208-6f6782ef7f86 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:23.997036 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f392b-3dae-4ebb-aeb7-5f47f7008895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:23.998170 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f392b-3dae-4ebb-aeb7-5f47f7008895 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:23.998661 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f392b-3dae-4ebb-aeb7-5f47f7008895 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:23.999026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47994544-0694-44a4-824c-6efd7e6e6d14 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:23.999342 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f392b-3dae-4ebb-aeb7-5f47f7008895 admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0/users/b44925dbf31f42bcbc4d0b9cb9d7a80e/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:24.001610 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f392b-3dae-4ebb-aeb7-5f47f7008895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=911c2d8152d7481fad6c6c9125f3d5a0, user_id=b44925dbf31f42bcbc4d0b9cb9d7a80e, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:24.004164 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a762299-032f-4c77-8dc3-5412670bcb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:24.004836 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f392b-3dae-4ebb-aeb7-5f47f7008895 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:24.005171 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a762299-032f-4c77-8dc3-5412670bcb17 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:24.005456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a762299-032f-4c77-8dc3-5412670bcb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:24.005738 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a762299-032f-4c77-8dc3-5412670bcb17 admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:24.007003 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a762299-032f-4c77-8dc3-5412670bcb17 admin admin] RBAC: Authorizing `identity:get_project(project_id=911c2d8152d7481fad6c6c9125f3d5a0)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:24.009386 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a762299-032f-4c77-8dc3-5412670bcb17 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:24.011327 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 55/110] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:23 2021] GET /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:24.012127 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a762299-032f-4c77-8dc3-5412670bcb17 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:24.023442 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a762299-032f-4c77-8dc3-5412670bcb17 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:24.032340 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 56/111] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:17:23 2021] PUT /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0/users/b44925dbf31f42bcbc4d0b9cb9d7a80e/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:17:24.036966 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f392b-3dae-4ebb-aeb7-5f47f7008895 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:24.039269 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f520b9-281b-420e-ae57-5801d76b5501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:24.040631 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f520b9-281b-420e-ae57-5801d76b5501 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:24.040935 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f520b9-281b-420e-ae57-5801d76b5501 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:24.041217 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f520b9-281b-420e-ae57-5801d76b5501 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:24.063934 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f520b9-281b-420e-ae57-5801d76b5501 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:24.078150 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-31f520b9-281b-420e-ae57-5801d76b5501 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 02:17:24.079585 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 56/112] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:24 2021] GET /identity/v3/roles/member => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:24.090038 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f520b9-281b-420e-ae57-5801d76b5501 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:24.108336 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f520b9-281b-420e-ae57-5801d76b5501 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:24.145780 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f392b-3dae-4ebb-aeb7-5f47f7008895 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:24.151066 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71738789-c4db-4a8e-aa0d-0a1fbe8947f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:24.151983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71738789-c4db-4a8e-aa0d-0a1fbe8947f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:24.152271 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71738789-c4db-4a8e-aa0d-0a1fbe8947f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:24.152588 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71738789-c4db-4a8e-aa0d-0a1fbe8947f1 admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0/users/a88ff9155434478bafd7ce991d7c4650/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:24.154979 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71738789-c4db-4a8e-aa0d-0a1fbe8947f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=911c2d8152d7481fad6c6c9125f3d5a0, user_id=a88ff9155434478bafd7ce991d7c4650, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:24.159015 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71738789-c4db-4a8e-aa0d-0a1fbe8947f1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:24.176455 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 57/113] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:17:24 2021] PUT /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0/users/a88ff9155434478bafd7ce991d7c4650/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:17:24.177956 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d22f1d-c9c0-46c2-998d-35c14dfd45a6 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:24.178251 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d22f1d-c9c0-46c2-998d-35c14dfd45a6 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:24.178588 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d22f1d-c9c0-46c2-998d-35c14dfd45a6 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:24.186832 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 58/114] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:24.188554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a5df7-54fb-432b-8ce7-0463d691b134 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:24.188901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a5df7-54fb-432b-8ce7-0463d691b134 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:24.189191 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a5df7-54fb-432b-8ce7-0463d691b134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:24.216011 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c58947-29f5-44a9-9f48-804803da6abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:24.216716 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c58947-29f5-44a9-9f48-804803da6abe admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:24.217032 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c58947-29f5-44a9-9f48-804803da6abe admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:24.217554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c58947-29f5-44a9-9f48-804803da6abe admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:24.218367 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c58947-29f5-44a9-9f48-804803da6abe admin admin] RBAC: Adding query filter params (name=member) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:24.218680 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c58947-29f5-44a9-9f48-804803da6abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:24.224608 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c58947-29f5-44a9-9f48-804803da6abe admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:24.228269 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-059a5df7-54fb-432b-8ce7-0463d691b134 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:24.229665 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-059a5df7-54fb-432b-8ce7-0463d691b134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:24.239316 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 57/115] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Sep 15 02:17:24 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:24.240728 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25f80c-3500-4a3c-990e-56f97cee412e None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:24.241043 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25f80c-3500-4a3c-990e-56f97cee412e None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:24.241910 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25f80c-3500-4a3c-990e-56f97cee412e None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:24.244312 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 58/116] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:24.253083 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25f80c-3500-4a3c-990e-56f97cee412e None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:24.303310 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 59/117] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:24.304672 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19724f-3926-4950-ab4e-8378d835fec6 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:24.305082 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19724f-3926-4950-ab4e-8378d835fec6 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:24.305369 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19724f-3926-4950-ab4e-8378d835fec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:24.339552 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-2f19724f-3926-4950-ab4e-8378d835fec6 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:24.340760 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-2f19724f-3926-4950-ab4e-8378d835fec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:24.344269 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25f80c-3500-4a3c-990e-56f97cee412e None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:24.352819 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba9dc7-7146-4109-a034-3ab69933c9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:24.353747 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba9dc7-7146-4109-a034-3ab69933c9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:24.354030 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba9dc7-7146-4109-a034-3ab69933c9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:24.354304 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba9dc7-7146-4109-a034-3ab69933c9d8 admin admin] PATH_INFO: `/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:24.354733 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 60/118] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:24.355556 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba9dc7-7146-4109-a034-3ab69933c9d8 admin admin] RBAC: Authorizing `identity:get_user(user_id=b44925dbf31f42bcbc4d0b9cb9d7a80e)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:24.355762 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19724f-3926-4950-ab4e-8378d835fec6 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:24.357772 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba9dc7-7146-4109-a034-3ab69933c9d8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:24.359467 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 59/119] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:24 2021] GET /identity/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e => generated 275 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:24.370352 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba9dc7-7146-4109-a034-3ab69933c9d8 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:24.371609 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19724f-3926-4950-ab4e-8378d835fec6 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:24.376427 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ecef2-f9de-400f-bf37-68c093f6beb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:24.377418 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ecef2-f9de-400f-bf37-68c093f6beb5 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:24.377709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ecef2-f9de-400f-bf37-68c093f6beb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:24.378049 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ecef2-f9de-400f-bf37-68c093f6beb5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:24.389886 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ecef2-f9de-400f-bf37-68c093f6beb5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:24.396216 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba9dc7-7146-4109-a034-3ab69933c9d8 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:24.397839 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-106ecef2-f9de-400f-bf37-68c093f6beb5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 02:17:24.404928 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 61/120] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:17:24 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:24.405776 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ecef2-f9de-400f-bf37-68c093f6beb5 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:24.406657 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e822715-a3db-41d3-8e31-885daf243b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:24.407520 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e822715-a3db-41d3-8e31-885daf243b01 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:24.407805 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e822715-a3db-41d3-8e31-885daf243b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:24.408082 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e822715-a3db-41d3-8e31-885daf243b01 admin admin] PATH_INFO: `/v3/projects/1e876cadd760463fbcc85b667340e817` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:24.409293 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e822715-a3db-41d3-8e31-885daf243b01 admin admin] RBAC: Authorizing `identity:get_project(project_id=1e876cadd760463fbcc85b667340e817)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:24.412739 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e822715-a3db-41d3-8e31-885daf243b01 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:24.414930 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 60/121] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:24 2021] GET /identity/v3/projects/1e876cadd760463fbcc85b667340e817 => generated 312 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:24.415895 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e822715-a3db-41d3-8e31-885daf243b01 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:24.416860 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ecef2-f9de-400f-bf37-68c093f6beb5 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:24.420758 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d687e3-de52-4c6d-b460-caf046e6493d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:24.421584 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d687e3-de52-4c6d-b460-caf046e6493d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:24.421967 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d687e3-de52-4c6d-b460-caf046e6493d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:24.422250 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d687e3-de52-4c6d-b460-caf046e6493d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:24.423428 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d687e3-de52-4c6d-b460-caf046e6493d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:24.425176 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d687e3-de52-4c6d-b460-caf046e6493d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:24.426573 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e822715-a3db-41d3-8e31-885daf243b01 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:24.426845 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 62/122] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:24.427639 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d687e3-de52-4c6d-b460-caf046e6493d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:24.431775 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07192aca-1e33-40ed-8162-44ab8e56974d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:24.432845 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07192aca-1e33-40ed-8162-44ab8e56974d admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:24.433341 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07192aca-1e33-40ed-8162-44ab8e56974d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:24.434339 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07192aca-1e33-40ed-8162-44ab8e56974d admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:24.435271 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07192aca-1e33-40ed-8162-44ab8e56974d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:24.436008 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07192aca-1e33-40ed-8162-44ab8e56974d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:24.438398 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d687e3-de52-4c6d-b460-caf046e6493d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:24.438699 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07192aca-1e33-40ed-8162-44ab8e56974d admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:24.442742 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8db308-755d-4877-b514-b7c11eb928b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:24.443599 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8db308-755d-4877-b514-b7c11eb928b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:24.443885 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8db308-755d-4877-b514-b7c11eb928b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:24.444162 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8db308-755d-4877-b514-b7c11eb928b0 admin admin] PATH_INFO: `/v3/projects/1e876cadd760463fbcc85b667340e817/users/b44925dbf31f42bcbc4d0b9cb9d7a80e/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:24.447514 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8db308-755d-4877-b514-b7c11eb928b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e876cadd760463fbcc85b667340e817, user_id=b44925dbf31f42bcbc4d0b9cb9d7a80e, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:24.448745 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 61/123] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:24 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:24.449445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07192aca-1e33-40ed-8162-44ab8e56974d admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:24.453212 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8db308-755d-4877-b514-b7c11eb928b0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:24.462136 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07192aca-1e33-40ed-8162-44ab8e56974d admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:24.468860 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 63/124] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:17:24 2021] PUT /identity/v3/projects/1e876cadd760463fbcc85b667340e817/users/b44925dbf31f42bcbc4d0b9cb9d7a80e/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:17:24.469727 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8db308-755d-4877-b514-b7c11eb928b0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:24.539233 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281107b-90af-4eca-86ee-9ab967e0e852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:24.540278 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281107b-90af-4eca-86ee-9ab967e0e852 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:24.540823 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281107b-90af-4eca-86ee-9ab967e0e852 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:24.541339 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281107b-90af-4eca-86ee-9ab967e0e852 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:24.542251 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281107b-90af-4eca-86ee-9ab967e0e852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:24.544515 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281107b-90af-4eca-86ee-9ab967e0e852 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:24.557556 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8db308-755d-4877-b514-b7c11eb928b0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:24.565994 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1475eae-b724-4dc1-a5d6-51fe1ad4c55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:24.567895 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1475eae-b724-4dc1-a5d6-51fe1ad4c55e admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:24.568395 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1475eae-b724-4dc1-a5d6-51fe1ad4c55e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:24.569058 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1475eae-b724-4dc1-a5d6-51fe1ad4c55e admin admin] PATH_INFO: `/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:24.570769 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1475eae-b724-4dc1-a5d6-51fe1ad4c55e admin admin] RBAC: Authorizing `identity:get_user(user_id=b44925dbf31f42bcbc4d0b9cb9d7a80e)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:24.573521 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1475eae-b724-4dc1-a5d6-51fe1ad4c55e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:24.575688 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 64/125] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:24 2021] GET /identity/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e => generated 275 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:24.583736 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 62/126] 10.222.0.32 () {60 vars in 1154 bytes} [Wed Sep 15 02:17:24 2021] POST /identity/v3/users => generated 283 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:17:24.585141 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1475eae-b724-4dc1-a5d6-51fe1ad4c55e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:24.606452 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1475eae-b724-4dc1-a5d6-51fe1ad4c55e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:24.614221 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bc37f-8a0f-43a0-b02f-0dbb063c1a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:24.615619 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bc37f-8a0f-43a0-b02f-0dbb063c1a88 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:24.616162 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bc37f-8a0f-43a0-b02f-0dbb063c1a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:24.616640 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bc37f-8a0f-43a0-b02f-0dbb063c1a88 admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:24.619890 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bc37f-8a0f-43a0-b02f-0dbb063c1a88 admin admin] RBAC: Authorizing `identity:get_project(project_id=911c2d8152d7481fad6c6c9125f3d5a0)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:24.622699 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bc37f-8a0f-43a0-b02f-0dbb063c1a88 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:24.625016 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 65/127] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:24 2021] GET /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:24.631848 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281107b-90af-4eca-86ee-9ab967e0e852 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:24.643561 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281107b-90af-4eca-86ee-9ab967e0e852 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:24.649710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb35f7-f830-4f7d-be19-dfa0205c49e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:24.651125 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb35f7-f830-4f7d-be19-dfa0205c49e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:24.651675 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb35f7-f830-4f7d-be19-dfa0205c49e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:24.652187 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb35f7-f830-4f7d-be19-dfa0205c49e3 admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0/users/b44925dbf31f42bcbc4d0b9cb9d7a80e/roles/4449685a6c854c46a265236ba82cd668` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:24.655404 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb35f7-f830-4f7d-be19-dfa0205c49e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=911c2d8152d7481fad6c6c9125f3d5a0, user_id=b44925dbf31f42bcbc4d0b9cb9d7a80e, role_id=4449685a6c854c46a265236ba82cd668)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:24.656934 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING py.warnings [None req-0cfb35f7-f830-4f7d-be19-dfa0205c49e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:17:24.656934 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: warnings.warn(msg) Sep 15 02:17:24.656934 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: Sep 15 02:17:24.659681 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb35f7-f830-4f7d-be19-dfa0205c49e3 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:24.679138 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 63/128] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:17:24 2021] PUT /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0/users/b44925dbf31f42bcbc4d0b9cb9d7a80e/roles/4449685a6c854c46a265236ba82cd668 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:17:26.577972 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64d67c-8925-44c5-a2b9-e963872a2249 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:26.579025 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64d67c-8925-44c5-a2b9-e963872a2249 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:26.579505 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64d67c-8925-44c5-a2b9-e963872a2249 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:26.581585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 66/129] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:26.589352 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be68be-bfb1-4bce-b990-9a6864fae3f2 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:26.590313 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be68be-bfb1-4bce-b990-9a6864fae3f2 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:26.590787 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be68be-bfb1-4bce-b990-9a6864fae3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:26.620701 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-67be68be-bfb1-4bce-b990-9a6864fae3f2 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:26.626604 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-67be68be-bfb1-4bce-b990-9a6864fae3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:26.698161 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 64/130] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:26.743257 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64d67c-8925-44c5-a2b9-e963872a2249 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:26.757275 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64d67c-8925-44c5-a2b9-e963872a2249 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:26.765473 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80825ae1-6599-45fa-abc8-c7526eaf98cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:26.766545 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80825ae1-6599-45fa-abc8-c7526eaf98cf admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:26.767045 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80825ae1-6599-45fa-abc8-c7526eaf98cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:26.767531 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80825ae1-6599-45fa-abc8-c7526eaf98cf admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:26.778719 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80825ae1-6599-45fa-abc8-c7526eaf98cf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:26.786421 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-80825ae1-6599-45fa-abc8-c7526eaf98cf admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 02:17:26.787860 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 67/131] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:26.794256 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be68be-bfb1-4bce-b990-9a6864fae3f2 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:26.804436 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be68be-bfb1-4bce-b990-9a6864fae3f2 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:26.814429 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa68e3-e557-4b93-8a58-4ea7ca4c51de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:26.815416 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa68e3-e557-4b93-8a58-4ea7ca4c51de admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:26.815911 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa68e3-e557-4b93-8a58-4ea7ca4c51de admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:26.816430 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa68e3-e557-4b93-8a58-4ea7ca4c51de admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:26.817431 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa68e3-e557-4b93-8a58-4ea7ca4c51de admin admin] RBAC: Adding query filter params (name=member) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:26.817947 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa68e3-e557-4b93-8a58-4ea7ca4c51de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:26.819767 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa68e3-e557-4b93-8a58-4ea7ca4c51de admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:26.829126 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 65/132] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Sep 15 02:17:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:26.835476 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80825ae1-6599-45fa-abc8-c7526eaf98cf admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:26.845498 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80825ae1-6599-45fa-abc8-c7526eaf98cf admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:26.851663 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6837e8-ebed-4f07-a263-dc1f2d9bb27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:26.852795 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6837e8-ebed-4f07-a263-dc1f2d9bb27a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:26.853295 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6837e8-ebed-4f07-a263-dc1f2d9bb27a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:26.853780 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6837e8-ebed-4f07-a263-dc1f2d9bb27a admin admin] PATH_INFO: `/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:26.857613 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6837e8-ebed-4f07-a263-dc1f2d9bb27a admin admin] RBAC: Authorizing `identity:get_user(user_id=b44925dbf31f42bcbc4d0b9cb9d7a80e)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:26.860008 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6837e8-ebed-4f07-a263-dc1f2d9bb27a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:26.862257 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 68/133] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:26 2021] GET /identity/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:26.868412 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa68e3-e557-4b93-8a58-4ea7ca4c51de admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:26.878465 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa68e3-e557-4b93-8a58-4ea7ca4c51de admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:26.888950 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961e581-5899-43f2-89d3-a39e356919fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:26.889853 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961e581-5899-43f2-89d3-a39e356919fa admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:26.890330 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961e581-5899-43f2-89d3-a39e356919fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:26.890802 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961e581-5899-43f2-89d3-a39e356919fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:26.899784 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961e581-5899-43f2-89d3-a39e356919fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:26.901785 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961e581-5899-43f2-89d3-a39e356919fa admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:26.915553 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 66/134] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:26.922021 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6837e8-ebed-4f07-a263-dc1f2d9bb27a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:26.933396 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6837e8-ebed-4f07-a263-dc1f2d9bb27a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:26.944801 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7164fa3a-c3fb-409a-9d50-f4fabd45e36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:26.945699 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164fa3a-c3fb-409a-9d50-f4fabd45e36d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:26.945984 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164fa3a-c3fb-409a-9d50-f4fabd45e36d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:26.946260 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7164fa3a-c3fb-409a-9d50-f4fabd45e36d admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:26.949642 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164fa3a-c3fb-409a-9d50-f4fabd45e36d admin admin] RBAC: Authorizing `identity:get_project(project_id=911c2d8152d7481fad6c6c9125f3d5a0)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:26.951735 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7164fa3a-c3fb-409a-9d50-f4fabd45e36d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:26.953471 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 69/135] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:26 2021] GET /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:26.960428 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961e581-5899-43f2-89d3-a39e356919fa admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:26.969831 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961e581-5899-43f2-89d3-a39e356919fa admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:26.981003 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01f41b-deb3-4c06-8c0a-c984f44a469c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:26.981957 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01f41b-deb3-4c06-8c0a-c984f44a469c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:26.982435 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01f41b-deb3-4c06-8c0a-c984f44a469c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:26.982900 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01f41b-deb3-4c06-8c0a-c984f44a469c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:26.983927 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01f41b-deb3-4c06-8c0a-c984f44a469c admin admin] RBAC: Adding query filter params (role.id=6f4a40def5d74f0a95ae44fd686a92e5, scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0, user.id=b44925dbf31f42bcbc4d0b9cb9d7a80e) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:26.984438 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01f41b-deb3-4c06-8c0a-c984f44a469c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:26.986507 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01f41b-deb3-4c06-8c0a-c984f44a469c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:27.000975 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 67/136] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:26 2021] GET /identity/v3/role_assignments?user.id=b44925dbf31f42bcbc4d0b9cb9d7a80e&scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0&role.id=6f4a40def5d74f0a95ae44fd686a92e5 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:27.395579 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e997934-a2f4-4d8c-984d-c239dc20fe53 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:27.395917 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e997934-a2f4-4d8c-984d-c239dc20fe53 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:27.396143 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e997934-a2f4-4d8c-984d-c239dc20fe53 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:27.398071 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 70/137] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:27.406209 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840dc34-45fe-4e39-9f85-fb0ff4ca1c32 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:27.406816 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840dc34-45fe-4e39-9f85-fb0ff4ca1c32 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:27.407297 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840dc34-45fe-4e39-9f85-fb0ff4ca1c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:27.430334 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-2840dc34-45fe-4e39-9f85-fb0ff4ca1c32 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:27.431873 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-2840dc34-45fe-4e39-9f85-fb0ff4ca1c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:27.443721 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 68/138] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:27.486031 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e997934-a2f4-4d8c-984d-c239dc20fe53 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:27.507317 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e997934-a2f4-4d8c-984d-c239dc20fe53 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:27.513088 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b091b-a2b0-4fe6-9803-a53758eb2823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:27.513889 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b091b-a2b0-4fe6-9803-a53758eb2823 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:27.514174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b091b-a2b0-4fe6-9803-a53758eb2823 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:27.514449 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b091b-a2b0-4fe6-9803-a53758eb2823 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:27.533788 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b091b-a2b0-4fe6-9803-a53758eb2823 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:27.540742 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-898b091b-a2b0-4fe6-9803-a53758eb2823 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:17:27.542002 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 71/139] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:17:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:27.548693 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840dc34-45fe-4e39-9f85-fb0ff4ca1c32 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:27.558219 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840dc34-45fe-4e39-9f85-fb0ff4ca1c32 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:27.574431 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88f49f-9d08-4e2c-b442-1dae710f28a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:27.575434 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88f49f-9d08-4e2c-b442-1dae710f28a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:27.575912 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88f49f-9d08-4e2c-b442-1dae710f28a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:27.576392 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88f49f-9d08-4e2c-b442-1dae710f28a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:27.577394 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88f49f-9d08-4e2c-b442-1dae710f28a4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:27.577917 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88f49f-9d08-4e2c-b442-1dae710f28a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:27.579696 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88f49f-9d08-4e2c-b442-1dae710f28a4 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:27.593076 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 69/140] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:27.600166 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b091b-a2b0-4fe6-9803-a53758eb2823 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:27.614848 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b091b-a2b0-4fe6-9803-a53758eb2823 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:27.617263 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becc50c-5010-490f-86bc-bafcf3ca1bdb None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:27.617772 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becc50c-5010-490f-86bc-bafcf3ca1bdb None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:27.618253 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becc50c-5010-490f-86bc-bafcf3ca1bdb None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:27.620209 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 70/141] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:17:27.625161 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ddec1-6f10-4040-a369-c321d20dfce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:27.626041 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ddec1-6f10-4040-a369-c321d20dfce1 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:27.626326 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ddec1-6f10-4040-a369-c321d20dfce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:27.626605 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ddec1-6f10-4040-a369-c321d20dfce1 admin admin] PATH_INFO: `/v3/users/a88ff9155434478bafd7ce991d7c4650` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:27.629626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92ae1c-b406-4d49-9847-98aa149e7ff4 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:27.630140 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92ae1c-b406-4d49-9847-98aa149e7ff4 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:27.630630 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92ae1c-b406-4d49-9847-98aa149e7ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:27.634011 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ddec1-6f10-4040-a369-c321d20dfce1 admin admin] RBAC: Authorizing `identity:get_user(user_id=a88ff9155434478bafd7ce991d7c4650)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:27.635873 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ddec1-6f10-4040-a369-c321d20dfce1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:27.637748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 72/142] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:27 2021] GET /identity/v3/users/a88ff9155434478bafd7ce991d7c4650 => generated 247 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:27.645553 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ddec1-6f10-4040-a369-c321d20dfce1 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:27.657281 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-eb92ae1c-b406-4d49-9847-98aa149e7ff4 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:27.657995 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ddec1-6f10-4040-a369-c321d20dfce1 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:27.659070 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-eb92ae1c-b406-4d49-9847-98aa149e7ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:27.668698 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21186e36-1d35-491f-a780-422523e6c894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:27.669452 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21186e36-1d35-491f-a780-422523e6c894 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:27.669742 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21186e36-1d35-491f-a780-422523e6c894 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:27.670020 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21186e36-1d35-491f-a780-422523e6c894 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:27.673209 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 71/143] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:27.684538 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21186e36-1d35-491f-a780-422523e6c894 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:27.686396 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21186e36-1d35-491f-a780-422523e6c894 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:27.698224 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 73/144] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:17:27.704767 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92ae1c-b406-4d49-9847-98aa149e7ff4 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:27.715486 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92ae1c-b406-4d49-9847-98aa149e7ff4 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:27.723277 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21186e36-1d35-491f-a780-422523e6c894 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:27.724415 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2e0d8-0b42-4c3b-b796-c9ec107f62fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:27.725321 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2e0d8-0b42-4c3b-b796-c9ec107f62fd admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:27.725606 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2e0d8-0b42-4c3b-b796-c9ec107f62fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:27.725880 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2e0d8-0b42-4c3b-b796-c9ec107f62fd admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:27.727079 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2e0d8-0b42-4c3b-b796-c9ec107f62fd admin admin] RBAC: Authorizing `identity:get_project(project_id=911c2d8152d7481fad6c6c9125f3d5a0)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:27.730019 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2e0d8-0b42-4c3b-b796-c9ec107f62fd admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:27.732018 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 72/145] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:27 2021] GET /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:27.740153 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2e0d8-0b42-4c3b-b796-c9ec107f62fd admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:27.740521 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21186e36-1d35-491f-a780-422523e6c894 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:27.749355 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17623d72-24e2-4443-8965-ef014c9db8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:27.750157 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17623d72-24e2-4443-8965-ef014c9db8db admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:27.750441 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17623d72-24e2-4443-8965-ef014c9db8db admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:27.750717 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17623d72-24e2-4443-8965-ef014c9db8db admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:27.753470 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2e0d8-0b42-4c3b-b796-c9ec107f62fd admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:27.762217 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ae07d-ff09-4e61-b7e9-fbd6a4f61839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:27.762888 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ae07d-ff09-4e61-b7e9-fbd6a4f61839 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:27.763170 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ae07d-ff09-4e61-b7e9-fbd6a4f61839 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:27.763446 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ae07d-ff09-4e61-b7e9-fbd6a4f61839 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:27.764277 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ae07d-ff09-4e61-b7e9-fbd6a4f61839 admin admin] RBAC: Adding query filter params (role.id=19308d3515f546e9a04e44ae278cd111, scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0, user.id=a88ff9155434478bafd7ce991d7c4650) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:27.764590 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ae07d-ff09-4e61-b7e9-fbd6a4f61839 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:27.766827 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ae07d-ff09-4e61-b7e9-fbd6a4f61839 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:27.776705 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17623d72-24e2-4443-8965-ef014c9db8db admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:27.776972 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 73/146] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:27 2021] GET /identity/v3/role_assignments?user.id=a88ff9155434478bafd7ce991d7c4650&scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0&role.id=19308d3515f546e9a04e44ae278cd111 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:27.784267 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-17623d72-24e2-4443-8965-ef014c9db8db admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 02:17:27.785678 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 74/147] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:17:27.792405 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ae07d-ff09-4e61-b7e9-fbd6a4f61839 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:27.806551 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ae07d-ff09-4e61-b7e9-fbd6a4f61839 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:27.816184 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fe2f6-4640-4beb-ae51-9e3afeb99c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:27.816887 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fe2f6-4640-4beb-ae51-9e3afeb99c71 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:27.817193 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fe2f6-4640-4beb-ae51-9e3afeb99c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:27.817477 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fe2f6-4640-4beb-ae51-9e3afeb99c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:27.818259 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782fe2f6-4640-4beb-ae51-9e3afeb99c71 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:27.818573 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782fe2f6-4640-4beb-ae51-9e3afeb99c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:27.820205 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782fe2f6-4640-4beb-ae51-9e3afeb99c71 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:27.835188 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 74/148] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Sep 15 02:17:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:27.841924 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17623d72-24e2-4443-8965-ef014c9db8db admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:27.858344 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17623d72-24e2-4443-8965-ef014c9db8db admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:27.869292 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce34e31-b3c4-4371-a0eb-e43579e95fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:27.870199 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce34e31-b3c4-4371-a0eb-e43579e95fea admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:27.870483 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce34e31-b3c4-4371-a0eb-e43579e95fea admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:27.870766 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce34e31-b3c4-4371-a0eb-e43579e95fea admin admin] PATH_INFO: `/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:27.877805 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce34e31-b3c4-4371-a0eb-e43579e95fea admin admin] RBAC: Authorizing `identity:get_user(user_id=b44925dbf31f42bcbc4d0b9cb9d7a80e)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:27.880102 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce34e31-b3c4-4371-a0eb-e43579e95fea admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:27.881881 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 75/149] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:27 2021] GET /identity/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e => generated 275 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:27.889403 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fe2f6-4640-4beb-ae51-9e3afeb99c71 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:27.907131 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782fe2f6-4640-4beb-ae51-9e3afeb99c71 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:27.911810 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d7d8b-7ad8-48fd-b8db-2978f1ffa8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:27.912411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d7d8b-7ad8-48fd-b8db-2978f1ffa8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:27.912696 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d7d8b-7ad8-48fd-b8db-2978f1ffa8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:27.913015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d7d8b-7ad8-48fd-b8db-2978f1ffa8c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:27.924864 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d7d8b-7ad8-48fd-b8db-2978f1ffa8c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:27.927181 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d7d8b-7ad8-48fd-b8db-2978f1ffa8c9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:27.943466 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 75/150] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:27 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:27.949421 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce34e31-b3c4-4371-a0eb-e43579e95fea admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:27.962968 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce34e31-b3c4-4371-a0eb-e43579e95fea admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:27.973543 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258ee81-c909-47b7-a102-b8ba8aff3317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:27.974435 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258ee81-c909-47b7-a102-b8ba8aff3317 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:27.974719 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258ee81-c909-47b7-a102-b8ba8aff3317 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:27.974996 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258ee81-c909-47b7-a102-b8ba8aff3317 admin admin] PATH_INFO: `/v3/projects/1e876cadd760463fbcc85b667340e817` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:27.981945 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258ee81-c909-47b7-a102-b8ba8aff3317 admin admin] RBAC: Authorizing `identity:get_project(project_id=1e876cadd760463fbcc85b667340e817)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:27.984090 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258ee81-c909-47b7-a102-b8ba8aff3317 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:27.985945 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 76/151] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:27 2021] GET /identity/v3/projects/1e876cadd760463fbcc85b667340e817 => generated 312 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:27.993189 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d7d8b-7ad8-48fd-b8db-2978f1ffa8c9 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:28.006110 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d7d8b-7ad8-48fd-b8db-2978f1ffa8c9 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:28.016159 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aef32c-d473-4952-9037-6efe31fad6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:28.017205 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aef32c-d473-4952-9037-6efe31fad6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:28.017695 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aef32c-d473-4952-9037-6efe31fad6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:28.018164 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aef32c-d473-4952-9037-6efe31fad6c8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:28.019268 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aef32c-d473-4952-9037-6efe31fad6c8 admin admin] RBAC: Adding query filter params (role.id=6f4a40def5d74f0a95ae44fd686a92e5, scope.project.id=1e876cadd760463fbcc85b667340e817, user.id=b44925dbf31f42bcbc4d0b9cb9d7a80e) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:28.019793 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aef32c-d473-4952-9037-6efe31fad6c8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:28.021883 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aef32c-d473-4952-9037-6efe31fad6c8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:28.032476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 76/152] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:27 2021] GET /identity/v3/role_assignments?user.id=b44925dbf31f42bcbc4d0b9cb9d7a80e&scope.project.id=1e876cadd760463fbcc85b667340e817&role.id=6f4a40def5d74f0a95ae44fd686a92e5 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:28.442947 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d1777-430d-4900-94b5-2d1c464e7e5f None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:28.443331 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d1777-430d-4900-94b5-2d1c464e7e5f None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:28.443505 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d1777-430d-4900-94b5-2d1c464e7e5f None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:28.445339 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 77/153] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:28.452792 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605356e-89e7-4bc3-8fe8-9613b2e92a52 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:28.453381 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605356e-89e7-4bc3-8fe8-9613b2e92a52 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:28.453941 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605356e-89e7-4bc3-8fe8-9613b2e92a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:28.490174 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-7605356e-89e7-4bc3-8fe8-9613b2e92a52 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:28.491589 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7605356e-89e7-4bc3-8fe8-9613b2e92a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:28.502833 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 77/154] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:28.539191 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d1777-430d-4900-94b5-2d1c464e7e5f None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:28.560127 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d1777-430d-4900-94b5-2d1c464e7e5f None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:28.567918 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e0326-ab3c-4c79-b2b0-222ffde7b5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:28.568727 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e0326-ab3c-4c79-b2b0-222ffde7b5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:28.569035 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e0326-ab3c-4c79-b2b0-222ffde7b5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:28.569313 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e0326-ab3c-4c79-b2b0-222ffde7b5f2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:28.585378 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e0326-ab3c-4c79-b2b0-222ffde7b5f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:28.592555 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-ac6e0326-ab3c-4c79-b2b0-222ffde7b5f2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 02:17:28.593948 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 78/155] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:17:28 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:28.600227 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605356e-89e7-4bc3-8fe8-9613b2e92a52 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:28.610292 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605356e-89e7-4bc3-8fe8-9613b2e92a52 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:28.621019 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743394e-588c-4c8f-b77b-877c3e445d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:28.622032 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743394e-588c-4c8f-b77b-877c3e445d65 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:28.622513 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743394e-588c-4c8f-b77b-877c3e445d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:28.623006 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743394e-588c-4c8f-b77b-877c3e445d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:28.624002 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743394e-588c-4c8f-b77b-877c3e445d65 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:28.624528 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743394e-588c-4c8f-b77b-877c3e445d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:28.626441 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743394e-588c-4c8f-b77b-877c3e445d65 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:28.642656 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 78/156] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:28 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:28.648825 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e0326-ab3c-4c79-b2b0-222ffde7b5f2 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:28.662052 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e0326-ab3c-4c79-b2b0-222ffde7b5f2 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:28.668627 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a10f7-5dfb-49be-92d4-2da6db3a5f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:28.669518 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a10f7-5dfb-49be-92d4-2da6db3a5f31 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:28.669800 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a10f7-5dfb-49be-92d4-2da6db3a5f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:28.670075 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a10f7-5dfb-49be-92d4-2da6db3a5f31 admin admin] PATH_INFO: `/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:28.671726 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a10f7-5dfb-49be-92d4-2da6db3a5f31 admin admin] RBAC: Authorizing `identity:get_user(user_id=b44925dbf31f42bcbc4d0b9cb9d7a80e)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:28.674055 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a10f7-5dfb-49be-92d4-2da6db3a5f31 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:28.676392 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 79/157] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:28 2021] GET /identity/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:28.682319 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743394e-588c-4c8f-b77b-877c3e445d65 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:28.693160 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743394e-588c-4c8f-b77b-877c3e445d65 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:28.704803 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2c46f-69aa-4735-8195-5fa33e87872c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:28.705806 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2c46f-69aa-4735-8195-5fa33e87872c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:28.706285 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2c46f-69aa-4735-8195-5fa33e87872c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:28.706793 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2c46f-69aa-4735-8195-5fa33e87872c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:28.717539 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2c46f-69aa-4735-8195-5fa33e87872c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:28.719579 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2c46f-69aa-4735-8195-5fa33e87872c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:28.733228 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 79/158] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:28 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:28.741000 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a10f7-5dfb-49be-92d4-2da6db3a5f31 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:28.754061 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a10f7-5dfb-49be-92d4-2da6db3a5f31 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:28.766146 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b909fe-2667-4647-8709-2725d9c6c3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:28.767030 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b909fe-2667-4647-8709-2725d9c6c3ad admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:28.767314 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b909fe-2667-4647-8709-2725d9c6c3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:28.767592 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b909fe-2667-4647-8709-2725d9c6c3ad admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:28.773651 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b909fe-2667-4647-8709-2725d9c6c3ad admin admin] RBAC: Authorizing `identity:get_project(project_id=911c2d8152d7481fad6c6c9125f3d5a0)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:28.775740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b909fe-2667-4647-8709-2725d9c6c3ad admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:28.777487 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 80/159] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:28 2021] GET /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:28.784073 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2c46f-69aa-4735-8195-5fa33e87872c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:28.794155 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2c46f-69aa-4735-8195-5fa33e87872c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:28.805716 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ab532-e380-4001-93c3-72456bacb83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:28.806661 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ab532-e380-4001-93c3-72456bacb83c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:28.807218 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ab532-e380-4001-93c3-72456bacb83c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:28.807685 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ab532-e380-4001-93c3-72456bacb83c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:28.808755 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ab532-e380-4001-93c3-72456bacb83c admin admin] RBAC: Adding query filter params (role.id=4449685a6c854c46a265236ba82cd668, scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0, user.id=b44925dbf31f42bcbc4d0b9cb9d7a80e) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:28.809287 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ab532-e380-4001-93c3-72456bacb83c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:28.811487 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ab532-e380-4001-93c3-72456bacb83c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:28.824751 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 80/160] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:28 2021] GET /identity/v3/role_assignments?user.id=b44925dbf31f42bcbc4d0b9cb9d7a80e&scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0&role.id=4449685a6c854c46a265236ba82cd668 => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:29.157741 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d31081-0054-4478-b8b3-1103853683de None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.158120 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d31081-0054-4478-b8b3-1103853683de None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.158305 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d31081-0054-4478-b8b3-1103853683de None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.160281 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 81/161] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:29.167826 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351918e5-6a37-43e2-8bf4-3fbfe101a5c5 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.168358 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351918e5-6a37-43e2-8bf4-3fbfe101a5c5 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.168828 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351918e5-6a37-43e2-8bf4-3fbfe101a5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.188154 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-351918e5-6a37-43e2-8bf4-3fbfe101a5c5 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:29.189671 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-351918e5-6a37-43e2-8bf4-3fbfe101a5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:29.204278 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 81/162] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:29.230500 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d31081-0054-4478-b8b3-1103853683de None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:29.246793 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d31081-0054-4478-b8b3-1103853683de None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:29.253591 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188d4f6-92db-44ec-bf22-e9369dd86ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:29.254425 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188d4f6-92db-44ec-bf22-e9369dd86ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.254685 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188d4f6-92db-44ec-bf22-e9369dd86ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.254961 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188d4f6-92db-44ec-bf22-e9369dd86ee3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.271507 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188d4f6-92db-44ec-bf22-e9369dd86ee3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:29.278602 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-5188d4f6-92db-44ec-bf22-e9369dd86ee3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 02:17:29.280058 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 82/163] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:29.287476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351918e5-6a37-43e2-8bf4-3fbfe101a5c5 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:29.297533 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351918e5-6a37-43e2-8bf4-3fbfe101a5c5 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:29.310147 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5a1ea-cc3f-4ecb-ba9a-a724ba6967a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:29.311226 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5a1ea-cc3f-4ecb-ba9a-a724ba6967a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.311770 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5a1ea-cc3f-4ecb-ba9a-a724ba6967a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.312245 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5a1ea-cc3f-4ecb-ba9a-a724ba6967a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.313274 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5a1ea-cc3f-4ecb-ba9a-a724ba6967a6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:29.313795 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5a1ea-cc3f-4ecb-ba9a-a724ba6967a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:29.315694 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5a1ea-cc3f-4ecb-ba9a-a724ba6967a6 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:29.325230 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 82/164] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Sep 15 02:17:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:29.332106 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188d4f6-92db-44ec-bf22-e9369dd86ee3 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:29.342376 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188d4f6-92db-44ec-bf22-e9369dd86ee3 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:29.347354 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252d8c2-5811-4524-b4d5-cb78ae7c570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:29.348990 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252d8c2-5811-4524-b4d5-cb78ae7c570a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.349529 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252d8c2-5811-4524-b4d5-cb78ae7c570a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.349997 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252d8c2-5811-4524-b4d5-cb78ae7c570a admin admin] PATH_INFO: `/v3/users/17730e59d96c42b68e33fbbd4ba213f7` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.365686 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252d8c2-5811-4524-b4d5-cb78ae7c570a admin admin] RBAC: Authorizing `identity:get_user(user_id=17730e59d96c42b68e33fbbd4ba213f7)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:29.368191 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252d8c2-5811-4524-b4d5-cb78ae7c570a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:29.370192 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 83/165] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:29 2021] GET /identity/v3/users/17730e59d96c42b68e33fbbd4ba213f7 => generated 283 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:29.378077 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5a1ea-cc3f-4ecb-ba9a-a724ba6967a6 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:29.389416 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5a1ea-cc3f-4ecb-ba9a-a724ba6967a6 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:29.393700 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be4804-5095-4178-946b-832371184311 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.394304 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15762cbc-533b-4727-b8ec-bd86f80e5ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:29.394581 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be4804-5095-4178-946b-832371184311 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.395028 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15762cbc-533b-4727-b8ec-bd86f80e5ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.395267 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be4804-5095-4178-946b-832371184311 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.395362 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15762cbc-533b-4727-b8ec-bd86f80e5ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.395568 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15762cbc-533b-4727-b8ec-bd86f80e5ab8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.397627 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 84/166] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:17:29.404949 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15762cbc-533b-4727-b8ec-bd86f80e5ab8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:29.406924 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15762cbc-533b-4727-b8ec-bd86f80e5ab8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:29.407683 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe4c3b-1356-450e-821f-445ec163a0e4 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.408247 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe4c3b-1356-450e-821f-445ec163a0e4 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.408716 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe4c3b-1356-450e-821f-445ec163a0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.419502 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 83/167] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:29.426762 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15762cbc-533b-4727-b8ec-bd86f80e5ab8 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:29.431918 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-7cfe4c3b-1356-450e-821f-445ec163a0e4 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:29.433906 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-7cfe4c3b-1356-450e-821f-445ec163a0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:29.436346 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15762cbc-533b-4727-b8ec-bd86f80e5ab8 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:29.441892 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941d9ae-7ec1-4742-9e2d-318e5b563800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:29.442893 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941d9ae-7ec1-4742-9e2d-318e5b563800 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.443173 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941d9ae-7ec1-4742-9e2d-318e5b563800 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.443448 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7941d9ae-7ec1-4742-9e2d-318e5b563800 admin admin] PATH_INFO: `/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.444289 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 85/168] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:29.448938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941d9ae-7ec1-4742-9e2d-318e5b563800 admin admin] RBAC: Authorizing `identity:get_project(project_id=e95b7aee5cbe45d1ac7e1805bf0d46dd)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:29.448938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7941d9ae-7ec1-4742-9e2d-318e5b563800 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:29.448938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 84/169] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:29 2021] GET /identity/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:29.455109 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe4c3b-1356-450e-821f-445ec163a0e4 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:29.466206 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe4c3b-1356-450e-821f-445ec163a0e4 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:29.472912 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae127c7-f65e-4ede-b6b7-4d1b6a57b140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:29.472912 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae127c7-f65e-4ede-b6b7-4d1b6a57b140 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.473127 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae127c7-f65e-4ede-b6b7-4d1b6a57b140 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.473446 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae127c7-f65e-4ede-b6b7-4d1b6a57b140 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.476199 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae127c7-f65e-4ede-b6b7-4d1b6a57b140 admin admin] RBAC: Adding query filter params (role.id=6f4a40def5d74f0a95ae44fd686a92e5, scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd, user.id=17730e59d96c42b68e33fbbd4ba213f7) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:29.476199 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae127c7-f65e-4ede-b6b7-4d1b6a57b140 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:29.476649 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae127c7-f65e-4ede-b6b7-4d1b6a57b140 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:29.480573 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941d9ae-7ec1-4742-9e2d-318e5b563800 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:29.485580 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 86/170] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:29 2021] GET /identity/v3/role_assignments?user.id=17730e59d96c42b68e33fbbd4ba213f7&scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd&role.id=6f4a40def5d74f0a95ae44fd686a92e5 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:29.486728 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd9b08-30b0-4342-a5f0-890c31868f81 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.487268 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd9b08-30b0-4342-a5f0-890c31868f81 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.487541 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd9b08-30b0-4342-a5f0-890c31868f81 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.489866 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 87/171] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:29.497321 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da81a9-8948-471f-b12d-9efcda96687f None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.497625 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da81a9-8948-471f-b12d-9efcda96687f None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.497881 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da81a9-8948-471f-b12d-9efcda96687f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.503684 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7941d9ae-7ec1-4742-9e2d-318e5b563800 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:29.516264 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-54da81a9-8948-471f-b12d-9efcda96687f None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:29.517601 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-54da81a9-8948-471f-b12d-9efcda96687f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:29.522102 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79117c-ffbb-41f1-b31f-1930bfdcec16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:29.522931 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79117c-ffbb-41f1-b31f-1930bfdcec16 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.523207 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79117c-ffbb-41f1-b31f-1930bfdcec16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.523482 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79117c-ffbb-41f1-b31f-1930bfdcec16 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.525258 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 88/172] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:29.546969 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79117c-ffbb-41f1-b31f-1930bfdcec16 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:29.550149 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da81a9-8948-471f-b12d-9efcda96687f None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:29.555315 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-6f79117c-ffbb-41f1-b31f-1930bfdcec16 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 02:17:29.556623 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 85/173] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:17:29 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:29.561053 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da81a9-8948-471f-b12d-9efcda96687f None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:29.563326 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79117c-ffbb-41f1-b31f-1930bfdcec16 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:29.566486 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef93ee6-2607-40f8-85e1-f96d0dfe2ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:29.567681 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef93ee6-2607-40f8-85e1-f96d0dfe2ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.568204 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef93ee6-2607-40f8-85e1-f96d0dfe2ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.568670 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef93ee6-2607-40f8-85e1-f96d0dfe2ed9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.574828 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79117c-ffbb-41f1-b31f-1930bfdcec16 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:29.581015 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef93ee6-2607-40f8-85e1-f96d0dfe2ed9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:29.581519 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a451120-b00f-4c7f-b9af-57b89e9ef464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:29.582372 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a451120-b00f-4c7f-b9af-57b89e9ef464 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.582694 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a451120-b00f-4c7f-b9af-57b89e9ef464 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.582965 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a451120-b00f-4c7f-b9af-57b89e9ef464 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.583782 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a451120-b00f-4c7f-b9af-57b89e9ef464 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:29.584141 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a451120-b00f-4c7f-b9af-57b89e9ef464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:29.585885 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a451120-b00f-4c7f-b9af-57b89e9ef464 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:29.590053 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-7ef93ee6-2607-40f8-85e1-f96d0dfe2ed9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:17:29.591630 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 89/174] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:17:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:17:29.596975 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 86/175] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:29 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:29.598869 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef93ee6-2607-40f8-85e1-f96d0dfe2ed9 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:29.603098 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a451120-b00f-4c7f-b9af-57b89e9ef464 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:29.615887 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a451120-b00f-4c7f-b9af-57b89e9ef464 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:29.616117 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef93ee6-2607-40f8-85e1-f96d0dfe2ed9 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:29.619246 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54f610-db19-4c8c-8378-c155973c3937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:29.620112 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54f610-db19-4c8c-8378-c155973c3937 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.620295 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234a1ab-86fa-4490-bbed-e6fbe1ed4a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:29.620411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54f610-db19-4c8c-8378-c155973c3937 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.620638 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d54f610-db19-4c8c-8378-c155973c3937 admin admin] PATH_INFO: `/v3/users/17730e59d96c42b68e33fbbd4ba213f7` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.621549 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234a1ab-86fa-4490-bbed-e6fbe1ed4a1c admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.622029 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234a1ab-86fa-4490-bbed-e6fbe1ed4a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.622138 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54f610-db19-4c8c-8378-c155973c3937 admin admin] RBAC: Authorizing `identity:get_user(user_id=17730e59d96c42b68e33fbbd4ba213f7)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:29.622556 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234a1ab-86fa-4490-bbed-e6fbe1ed4a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.623518 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234a1ab-86fa-4490-bbed-e6fbe1ed4a1c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:29.624030 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234a1ab-86fa-4490-bbed-e6fbe1ed4a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:29.624209 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d54f610-db19-4c8c-8378-c155973c3937 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:29.626138 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234a1ab-86fa-4490-bbed-e6fbe1ed4a1c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:29.626372 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 87/176] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:29 2021] GET /identity/v3/users/17730e59d96c42b68e33fbbd4ba213f7 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:29.633534 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54f610-db19-4c8c-8378-c155973c3937 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:29.644238 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 90/177] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:29.647996 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d54f610-db19-4c8c-8378-c155973c3937 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:29.652196 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234a1ab-86fa-4490-bbed-e6fbe1ed4a1c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:29.652744 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a4ffb-c1a4-4cb0-b30f-43c40a0175f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:29.653347 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a4ffb-c1a4-4cb0-b30f-43c40a0175f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.653633 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a4ffb-c1a4-4cb0-b30f-43c40a0175f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.653909 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a4ffb-c1a4-4cb0-b30f-43c40a0175f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.663620 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a4ffb-c1a4-4cb0-b30f-43c40a0175f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:29.665359 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a4ffb-c1a4-4cb0-b30f-43c40a0175f4 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:29.665972 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234a1ab-86fa-4490-bbed-e6fbe1ed4a1c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:29.671256 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086d513-d530-4b4f-86f7-6d45db4bec84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:29.672493 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086d513-d530-4b4f-86f7-6d45db4bec84 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.673058 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086d513-d530-4b4f-86f7-6d45db4bec84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.673556 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086d513-d530-4b4f-86f7-6d45db4bec84 admin admin] PATH_INFO: `/v3/users/a88ff9155434478bafd7ce991d7c4650` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.675203 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086d513-d530-4b4f-86f7-6d45db4bec84 admin admin] RBAC: Authorizing `identity:get_user(user_id=a88ff9155434478bafd7ce991d7c4650)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:29.675748 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 88/178] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:29.678073 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7086d513-d530-4b4f-86f7-6d45db4bec84 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:29.679964 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 91/179] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:29 2021] GET /identity/v3/users/a88ff9155434478bafd7ce991d7c4650 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:29.684786 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a4ffb-c1a4-4cb0-b30f-43c40a0175f4 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:29.685956 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086d513-d530-4b4f-86f7-6d45db4bec84 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:29.692898 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a4ffb-c1a4-4cb0-b30f-43c40a0175f4 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:29.696167 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7086d513-d530-4b4f-86f7-6d45db4bec84 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:29.700668 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357e960-5f07-4a6e-90dd-e782827fc24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:29.700822 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1eb36-b93d-4937-b256-250a2d5e3fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:29.701551 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1eb36-b93d-4937-b256-250a2d5e3fca admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.701725 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357e960-5f07-4a6e-90dd-e782827fc24c admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.701816 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1eb36-b93d-4937-b256-250a2d5e3fca admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.702103 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1eb36-b93d-4937-b256-250a2d5e3fca admin admin] PATH_INFO: `/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.702232 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357e960-5f07-4a6e-90dd-e782827fc24c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.702595 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357e960-5f07-4a6e-90dd-e782827fc24c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.703417 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1eb36-b93d-4937-b256-250a2d5e3fca admin admin] RBAC: Authorizing `identity:get_project(project_id=e95b7aee5cbe45d1ac7e1805bf0d46dd)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:29.705596 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1eb36-b93d-4937-b256-250a2d5e3fca admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:29.707583 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 89/180] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:29 2021] GET /identity/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:29.711480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357e960-5f07-4a6e-90dd-e782827fc24c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:29.713474 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357e960-5f07-4a6e-90dd-e782827fc24c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:29.713659 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1eb36-b93d-4937-b256-250a2d5e3fca admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:29.723764 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 92/181] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:29.723911 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1eb36-b93d-4937-b256-250a2d5e3fca admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:29.725268 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c62c0-2dc8-4b04-92b8-3be8e6130582 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.725655 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c62c0-2dc8-4b04-92b8-3be8e6130582 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.726010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c62c0-2dc8-4b04-92b8-3be8e6130582 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.727739 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 93/182] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:29.728930 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164f50b-2614-4f0e-b30f-87672142e687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:29.729758 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164f50b-2614-4f0e-b30f-87672142e687 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.730055 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c62c0-2dc8-4b04-92b8-3be8e6130582 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:29.730159 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164f50b-2614-4f0e-b30f-87672142e687 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.730576 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164f50b-2614-4f0e-b30f-87672142e687 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.731452 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164f50b-2614-4f0e-b30f-87672142e687 admin admin] RBAC: Adding query filter params (role.id=4449685a6c854c46a265236ba82cd668, scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd, user.id=17730e59d96c42b68e33fbbd4ba213f7) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:29.731928 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164f50b-2614-4f0e-b30f-87672142e687 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:29.734014 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164f50b-2614-4f0e-b30f-87672142e687 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:29.740713 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 90/183] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:29 2021] GET /identity/v3/role_assignments?user.id=17730e59d96c42b68e33fbbd4ba213f7&scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd&role.id=4449685a6c854c46a265236ba82cd668 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:29.742820 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c62c0-2dc8-4b04-92b8-3be8e6130582 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:29.747208 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2693d5-9f80-48b0-b3eb-7acac6fd3eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:29.748164 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2693d5-9f80-48b0-b3eb-7acac6fd3eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.748513 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2693d5-9f80-48b0-b3eb-7acac6fd3eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.748857 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2693d5-9f80-48b0-b3eb-7acac6fd3eb0 admin admin] PATH_INFO: `/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.750397 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71573271-4a1f-41ea-825a-c17887ab9351 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.751358 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71573271-4a1f-41ea-825a-c17887ab9351 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.751639 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71573271-4a1f-41ea-825a-c17887ab9351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.752020 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2693d5-9f80-48b0-b3eb-7acac6fd3eb0 admin admin] RBAC: Authorizing `identity:get_project(project_id=e95b7aee5cbe45d1ac7e1805bf0d46dd)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:29.754721 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2693d5-9f80-48b0-b3eb-7acac6fd3eb0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:29.761079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 94/184] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:29 2021] GET /identity/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:29.763323 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2693d5-9f80-48b0-b3eb-7acac6fd3eb0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:29.779952 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2693d5-9f80-48b0-b3eb-7acac6fd3eb0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:29.785263 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-71573271-4a1f-41ea-825a-c17887ab9351 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:29.786303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b6e8a-b7b8-411f-b30c-7f9bd2fe6b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:29.786731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-71573271-4a1f-41ea-825a-c17887ab9351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:29.787398 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b6e8a-b7b8-411f-b30c-7f9bd2fe6b87 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.787974 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b6e8a-b7b8-411f-b30c-7f9bd2fe6b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.788392 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b6e8a-b7b8-411f-b30c-7f9bd2fe6b87 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.789639 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b6e8a-b7b8-411f-b30c-7f9bd2fe6b87 admin admin] RBAC: Adding query filter params (role.id=19308d3515f546e9a04e44ae278cd111, scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd, user.id=a88ff9155434478bafd7ce991d7c4650) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:29.790232 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b6e8a-b7b8-411f-b30c-7f9bd2fe6b87 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:29.792685 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b6e8a-b7b8-411f-b30c-7f9bd2fe6b87 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:29.795887 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 91/185] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:29.805805 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 95/186] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:29 2021] GET /identity/v3/role_assignments?user.id=a88ff9155434478bafd7ce991d7c4650&scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd&role.id=19308d3515f546e9a04e44ae278cd111 => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:29.822843 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71573271-4a1f-41ea-825a-c17887ab9351 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:29.832705 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71573271-4a1f-41ea-825a-c17887ab9351 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:29.837674 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbaab40-78e0-4962-87ef-c06b8a2a684a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:29.838679 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbaab40-78e0-4962-87ef-c06b8a2a684a admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.839069 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbaab40-78e0-4962-87ef-c06b8a2a684a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.839440 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbaab40-78e0-4962-87ef-c06b8a2a684a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.840994 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbaab40-78e0-4962-87ef-c06b8a2a684a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:29.842901 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbaab40-78e0-4962-87ef-c06b8a2a684a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:29.845048 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 92/187] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:29 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:29.852223 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b6e8a-b7b8-411f-b30c-7f9bd2fe6b87 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:29.863296 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b6e8a-b7b8-411f-b30c-7f9bd2fe6b87 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:29.868432 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1f399-054a-4ee8-89ca-85b2a759fa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:29.869386 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f399-054a-4ee8-89ca-85b2a759fa2b admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:29.869819 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f399-054a-4ee8-89ca-85b2a759fa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:29.870193 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f399-054a-4ee8-89ca-85b2a759fa2b admin admin] PATH_INFO: `/v3/groups` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:29.871032 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1f399-054a-4ee8-89ca-85b2a759fa2b admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:29.872276 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING py.warnings [None req-4ea1f399-054a-4ee8-89ca-85b2a759fa2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:17:29.872276 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: warnings.warn(msg) Sep 15 02:17:29.872276 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: Sep 15 02:17:29.873848 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1f399-054a-4ee8-89ca-85b2a759fa2b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:29.894631 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 96/188] 10.222.0.32 () {60 vars in 1156 bytes} [Wed Sep 15 02:17:29 2021] POST /identity/v3/groups => generated 229 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:17:31.690414 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91ee26-f779-4dcb-afbc-50cb9c8e349c None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:31.691731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91ee26-f779-4dcb-afbc-50cb9c8e349c None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:31.691731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91ee26-f779-4dcb-afbc-50cb9c8e349c None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:31.693654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 93/189] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:31.701154 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87c4dd-38ef-48fb-a91d-7335efe00e63 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:31.701695 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87c4dd-38ef-48fb-a91d-7335efe00e63 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:31.701695 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87c4dd-38ef-48fb-a91d-7335efe00e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:31.719606 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-8d87c4dd-38ef-48fb-a91d-7335efe00e63 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:31.720792 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-8d87c4dd-38ef-48fb-a91d-7335efe00e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:31.733044 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 97/190] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:31.752743 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91ee26-f779-4dcb-afbc-50cb9c8e349c None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:31.767399 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91ee26-f779-4dcb-afbc-50cb9c8e349c None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:31.771778 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9315c8-0b0c-4612-95e2-7fd17ddcedf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:31.772562 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9315c8-0b0c-4612-95e2-7fd17ddcedf4 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:31.772844 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9315c8-0b0c-4612-95e2-7fd17ddcedf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:31.773154 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9315c8-0b0c-4612-95e2-7fd17ddcedf4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:31.783647 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9315c8-0b0c-4612-95e2-7fd17ddcedf4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:31.791117 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-ca9315c8-0b0c-4612-95e2-7fd17ddcedf4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 02:17:31.792313 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 94/191] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:31 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:31.798801 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87c4dd-38ef-48fb-a91d-7335efe00e63 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:31.808403 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87c4dd-38ef-48fb-a91d-7335efe00e63 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:31.812900 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde8dbe-4152-43ae-a49f-8ed2f26126fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:31.813566 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde8dbe-4152-43ae-a49f-8ed2f26126fa admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:31.813843 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde8dbe-4152-43ae-a49f-8ed2f26126fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:31.814115 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde8dbe-4152-43ae-a49f-8ed2f26126fa admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:31.814867 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde8dbe-4152-43ae-a49f-8ed2f26126fa admin admin] RBAC: Adding query filter params (name=member) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:31.815172 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde8dbe-4152-43ae-a49f-8ed2f26126fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:31.817413 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde8dbe-4152-43ae-a49f-8ed2f26126fa admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:31.827030 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 98/192] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Sep 15 02:17:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:31.833833 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9315c8-0b0c-4612-95e2-7fd17ddcedf4 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:31.845315 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9315c8-0b0c-4612-95e2-7fd17ddcedf4 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:31.850629 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc4e3d-f37a-4a83-be7d-8f60fdbebb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:31.851525 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc4e3d-f37a-4a83-be7d-8f60fdbebb92 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:31.851806 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc4e3d-f37a-4a83-be7d-8f60fdbebb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:31.852082 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc4e3d-f37a-4a83-be7d-8f60fdbebb92 admin admin] PATH_INFO: `/v3/users/17730e59d96c42b68e33fbbd4ba213f7` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:31.853394 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc4e3d-f37a-4a83-be7d-8f60fdbebb92 admin admin] RBAC: Authorizing `identity:get_user(user_id=17730e59d96c42b68e33fbbd4ba213f7)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:31.855607 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc4e3d-f37a-4a83-be7d-8f60fdbebb92 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:31.857316 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 95/193] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:31 2021] GET /identity/v3/users/17730e59d96c42b68e33fbbd4ba213f7 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:31.863947 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde8dbe-4152-43ae-a49f-8ed2f26126fa admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:31.873816 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde8dbe-4152-43ae-a49f-8ed2f26126fa admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:31.878340 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc3b70-2f66-4618-a677-50b2f311fc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:31.879730 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3b70-2f66-4618-a677-50b2f311fc23 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:31.880007 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3b70-2f66-4618-a677-50b2f311fc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:31.880280 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3b70-2f66-4618-a677-50b2f311fc23 admin admin] PATH_INFO: `/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:31.881492 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc3b70-2f66-4618-a677-50b2f311fc23 admin admin] RBAC: Authorizing `identity:get_project(project_id=e95b7aee5cbe45d1ac7e1805bf0d46dd)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:31.883591 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc3b70-2f66-4618-a677-50b2f311fc23 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:31.889005 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 99/194] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:31 2021] GET /identity/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:31.891936 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc4e3d-f37a-4a83-be7d-8f60fdbebb92 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:31.901631 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc4e3d-f37a-4a83-be7d-8f60fdbebb92 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:31.906039 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc6487-626b-4d03-9844-37cb33d0d660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:31.906910 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc6487-626b-4d03-9844-37cb33d0d660 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:31.907188 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc6487-626b-4d03-9844-37cb33d0d660 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:31.907460 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc6487-626b-4d03-9844-37cb33d0d660 admin admin] PATH_INFO: `/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd/users/17730e59d96c42b68e33fbbd4ba213f7/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:31.909464 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc6487-626b-4d03-9844-37cb33d0d660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95b7aee5cbe45d1ac7e1805bf0d46dd, user_id=17730e59d96c42b68e33fbbd4ba213f7, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:31.912723 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc6487-626b-4d03-9844-37cb33d0d660 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:31.919035 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df3880-e270-4082-b813-193caa1bee96 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:31.919319 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df3880-e270-4082-b813-193caa1bee96 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:31.919596 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df3880-e270-4082-b813-193caa1bee96 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:31.921444 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 100/195] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:31.929063 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b6da-18e1-46aa-bef8-24f9bac9bda4 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:31.929369 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b6da-18e1-46aa-bef8-24f9bac9bda4 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:31.929608 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b6da-18e1-46aa-bef8-24f9bac9bda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:31.930097 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 96/196] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:17:31 2021] PUT /identity/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd/users/17730e59d96c42b68e33fbbd4ba213f7/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:17:31.949743 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-02d3b6da-18e1-46aa-bef8-24f9bac9bda4 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:31.951014 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-02d3b6da-18e1-46aa-bef8-24f9bac9bda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:32.024329 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 101/197] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:32.042323 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64252f-d144-4d00-b56e-778fce8089dc None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:32.042323 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64252f-d144-4d00-b56e-778fce8089dc None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:32.042323 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64252f-d144-4d00-b56e-778fce8089dc None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:32.042323 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 97/198] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:32.052911 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3b6da-18e1-46aa-bef8-24f9bac9bda4 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:32.053248 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b80e7e-6939-4ce5-bfd9-a638122eaa80 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:32.053248 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b80e7e-6939-4ce5-bfd9-a638122eaa80 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:32.053248 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b80e7e-6939-4ce5-bfd9-a638122eaa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:32.062150 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3b6da-18e1-46aa-bef8-24f9bac9bda4 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:32.067578 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7c58c-1cd9-4004-9197-9a64df811365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:32.068422 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7c58c-1cd9-4004-9197-9a64df811365 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:32.068701 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7c58c-1cd9-4004-9197-9a64df811365 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:32.069001 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7c58c-1cd9-4004-9197-9a64df811365 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:32.074065 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-54b80e7e-6939-4ce5-bfd9-a638122eaa80 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:32.075607 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-54b80e7e-6939-4ce5-bfd9-a638122eaa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:32.081437 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7c58c-1cd9-4004-9197-9a64df811365 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:32.084530 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 98/199] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:32.089388 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-c8d7c58c-1cd9-4004-9197-9a64df811365 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 02:17:32.096190 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 102/200] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:17:32 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:32.098171 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b80e7e-6939-4ce5-bfd9-a638122eaa80 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:32.108207 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b80e7e-6939-4ce5-bfd9-a638122eaa80 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:32.111297 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7c58c-1cd9-4004-9197-9a64df811365 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:32.114200 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f551b-638b-40b1-af80-e89cae9abe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:32.115124 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f551b-638b-40b1-af80-e89cae9abe15 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:32.115621 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f551b-638b-40b1-af80-e89cae9abe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:32.116084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f551b-638b-40b1-af80-e89cae9abe15 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:32.117098 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f551b-638b-40b1-af80-e89cae9abe15 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:32.117607 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f551b-638b-40b1-af80-e89cae9abe15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:32.119396 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f551b-638b-40b1-af80-e89cae9abe15 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:32.122501 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7c58c-1cd9-4004-9197-9a64df811365 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:32.127794 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f45a37-cbd2-4bb3-9264-71e1b7b09f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:32.128927 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f45a37-cbd2-4bb3-9264-71e1b7b09f9c admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:32.129048 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 99/201] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:32 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:32.131552 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f45a37-cbd2-4bb3-9264-71e1b7b09f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:32.131866 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f45a37-cbd2-4bb3-9264-71e1b7b09f9c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:32.132805 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035925c7-fcc2-4984-a6dc-7d5620ffb14c None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:32.133138 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035925c7-fcc2-4984-a6dc-7d5620ffb14c None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:32.133418 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035925c7-fcc2-4984-a6dc-7d5620ffb14c None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:32.135381 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 100/202] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:17:32.141263 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035925c7-fcc2-4984-a6dc-7d5620ffb14c None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:32.145087 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f45a37-cbd2-4bb3-9264-71e1b7b09f9c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:32.152196 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-f3f45a37-cbd2-4bb3-9264-71e1b7b09f9c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:17:32.153584 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 103/203] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:17:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:17:32.157585 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035925c7-fcc2-4984-a6dc-7d5620ffb14c None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:32.158170 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb3129-77e5-452a-98b5-9e6f4b465d13 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:32.158458 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb3129-77e5-452a-98b5-9e6f4b465d13 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:32.158741 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb3129-77e5-452a-98b5-9e6f4b465d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:32.162470 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ecef3-5d61-4bf4-b19a-635246247b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:32.163357 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ecef3-5d61-4bf4-b19a-635246247b90 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:32.163642 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ecef3-5d61-4bf4-b19a-635246247b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:32.163919 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ecef3-5d61-4bf4-b19a-635246247b90 admin admin] PATH_INFO: `/v3/users/17730e59d96c42b68e33fbbd4ba213f7` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:32.165171 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ecef3-5d61-4bf4-b19a-635246247b90 admin admin] RBAC: Authorizing `identity:get_user(user_id=17730e59d96c42b68e33fbbd4ba213f7)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:32.167286 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ecef3-5d61-4bf4-b19a-635246247b90 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:32.169093 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 101/204] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:32 2021] GET /identity/v3/users/17730e59d96c42b68e33fbbd4ba213f7 => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:32.169663 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ecef3-5d61-4bf4-b19a-635246247b90 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:32.178796 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-e0fb3129-77e5-452a-98b5-9e6f4b465d13 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:32.180091 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-e0fb3129-77e5-452a-98b5-9e6f4b465d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:32.181463 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ecef3-5d61-4bf4-b19a-635246247b90 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:32.185908 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c4138-d441-4130-948a-9d370b130673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:32.186488 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c4138-d441-4130-948a-9d370b130673 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:32.186774 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c4138-d441-4130-948a-9d370b130673 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:32.187050 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c4138-d441-4130-948a-9d370b130673 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:32.187786 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c4138-d441-4130-948a-9d370b130673 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:32.188093 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c4138-d441-4130-948a-9d370b130673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:32.188603 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 104/205] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:32.192901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb3129-77e5-452a-98b5-9e6f4b465d13 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:32.193010 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c4138-d441-4130-948a-9d370b130673 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:32.198915 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 102/206] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:32.205371 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb3129-77e5-452a-98b5-9e6f4b465d13 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:32.205988 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c4138-d441-4130-948a-9d370b130673 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:32.213069 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ec503-fd8e-4823-bd17-2cb9852431d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:32.213938 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ec503-fd8e-4823-bd17-2cb9852431d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:32.214223 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ec503-fd8e-4823-bd17-2cb9852431d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:32.214500 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ec503-fd8e-4823-bd17-2cb9852431d1 admin admin] PATH_INFO: `/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:32.215688 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ec503-fd8e-4823-bd17-2cb9852431d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=e95b7aee5cbe45d1ac7e1805bf0d46dd)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:32.216324 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c4138-d441-4130-948a-9d370b130673 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:32.217804 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ec503-fd8e-4823-bd17-2cb9852431d1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:32.219749 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 105/207] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:32 2021] GET /identity/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:32.220515 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ec503-fd8e-4823-bd17-2cb9852431d1 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:32.221400 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f1a40-0f82-4c87-86ef-a53d071f42f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:32.222560 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f1a40-0f82-4c87-86ef-a53d071f42f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:32.223133 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f1a40-0f82-4c87-86ef-a53d071f42f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:32.223600 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f1a40-0f82-4c87-86ef-a53d071f42f9 admin admin] PATH_INFO: `/v3/users/a88ff9155434478bafd7ce991d7c4650` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:32.225165 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f1a40-0f82-4c87-86ef-a53d071f42f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=a88ff9155434478bafd7ce991d7c4650)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:32.227158 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f1a40-0f82-4c87-86ef-a53d071f42f9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:32.228920 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 103/208] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:32 2021] GET /identity/v3/users/a88ff9155434478bafd7ce991d7c4650 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:32.233724 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ec503-fd8e-4823-bd17-2cb9852431d1 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:32.234259 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f1a40-0f82-4c87-86ef-a53d071f42f9 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:32.234525 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093dd311-5870-4d6f-9fa0-3b82db178e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:32.235384 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dd311-5870-4d6f-9fa0-3b82db178e46 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:32.235670 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dd311-5870-4d6f-9fa0-3b82db178e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:32.235947 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093dd311-5870-4d6f-9fa0-3b82db178e46 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:32.237401 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093dd311-5870-4d6f-9fa0-3b82db178e46 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:32.239615 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093dd311-5870-4d6f-9fa0-3b82db178e46 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:32.241387 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 106/209] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:32.241972 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093dd311-5870-4d6f-9fa0-3b82db178e46 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:32.248004 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f1a40-0f82-4c87-86ef-a53d071f42f9 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:32.252506 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581da6fe-3482-48f2-8c41-21a975b4bbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:32.253479 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581da6fe-3482-48f2-8c41-21a975b4bbfb admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:32.254249 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581da6fe-3482-48f2-8c41-21a975b4bbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:32.255036 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581da6fe-3482-48f2-8c41-21a975b4bbfb admin admin] PATH_INFO: `/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd/users/17730e59d96c42b68e33fbbd4ba213f7/roles/4449685a6c854c46a265236ba82cd668` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:32.256729 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581da6fe-3482-48f2-8c41-21a975b4bbfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95b7aee5cbe45d1ac7e1805bf0d46dd, user_id=17730e59d96c42b68e33fbbd4ba213f7, role_id=4449685a6c854c46a265236ba82cd668)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:32.258118 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093dd311-5870-4d6f-9fa0-3b82db178e46 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:32.259466 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581da6fe-3482-48f2-8c41-21a975b4bbfb admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:32.262436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b53dd2-9d7c-4d05-9190-c49c05797e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:32.263263 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b53dd2-9d7c-4d05-9190-c49c05797e78 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:32.263621 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b53dd2-9d7c-4d05-9190-c49c05797e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:32.263869 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b53dd2-9d7c-4d05-9190-c49c05797e78 admin admin] PATH_INFO: `/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:32.265307 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b53dd2-9d7c-4d05-9190-c49c05797e78 admin admin] RBAC: Authorizing `identity:get_project(project_id=e95b7aee5cbe45d1ac7e1805bf0d46dd)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:32.267655 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b53dd2-9d7c-4d05-9190-c49c05797e78 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:32.274831 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 107/210] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:32 2021] GET /identity/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:32.274831 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b53dd2-9d7c-4d05-9190-c49c05797e78 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:32.279185 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 104/211] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:17:32 2021] PUT /identity/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd/users/17730e59d96c42b68e33fbbd4ba213f7/roles/4449685a6c854c46a265236ba82cd668 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:17:32.279559 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b53dd2-9d7c-4d05-9190-c49c05797e78 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:32.286251 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581da6fe-3482-48f2-8c41-21a975b4bbfb admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:32.348842 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185739a4-c127-4e47-af31-a776d85a81fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:32.349644 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185739a4-c127-4e47-af31-a776d85a81fe admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:32.349937 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185739a4-c127-4e47-af31-a776d85a81fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:32.350219 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185739a4-c127-4e47-af31-a776d85a81fe admin admin] PATH_INFO: `/v3/groups` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:32.350948 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185739a4-c127-4e47-af31-a776d85a81fe admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:32.353835 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185739a4-c127-4e47-af31-a776d85a81fe admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:32.370519 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581da6fe-3482-48f2-8c41-21a975b4bbfb admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:32.373683 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 108/212] 10.222.0.32 () {60 vars in 1156 bytes} [Wed Sep 15 02:17:32 2021] POST /identity/v3/groups => generated 226 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:17:32.377481 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59660a9-37d2-4e36-8961-738ff8445f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:32.378942 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59660a9-37d2-4e36-8961-738ff8445f15 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:32.379514 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59660a9-37d2-4e36-8961-738ff8445f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:32.379990 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59660a9-37d2-4e36-8961-738ff8445f15 admin admin] PATH_INFO: `/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd/users/a88ff9155434478bafd7ce991d7c4650/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:32.382762 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59660a9-37d2-4e36-8961-738ff8445f15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95b7aee5cbe45d1ac7e1805bf0d46dd, user_id=a88ff9155434478bafd7ce991d7c4650, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:32.386453 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59660a9-37d2-4e36-8961-738ff8445f15 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:32.409140 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 105/213] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:17:32 2021] PUT /identity/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd/users/a88ff9155434478bafd7ce991d7c4650/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:17:34.435885 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b41e1e-9739-4e8f-a045-7d3ee7afbc13 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:34.436434 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b41e1e-9739-4e8f-a045-7d3ee7afbc13 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:34.436434 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b41e1e-9739-4e8f-a045-7d3ee7afbc13 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:34.438266 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 109/214] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:34.446790 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd13c7-43d6-4db9-b48e-32090733adac None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:34.447647 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd13c7-43d6-4db9-b48e-32090733adac None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:34.448319 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd13c7-43d6-4db9-b48e-32090733adac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:34.471139 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-06cd13c7-43d6-4db9-b48e-32090733adac None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:34.472703 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-06cd13c7-43d6-4db9-b48e-32090733adac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:34.553569 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 106/215] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:34.592301 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b41e1e-9739-4e8f-a045-7d3ee7afbc13 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:34.614853 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b41e1e-9739-4e8f-a045-7d3ee7afbc13 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:34.619495 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a177c34-683d-4e02-af41-add163c2d77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:34.620287 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a177c34-683d-4e02-af41-add163c2d77d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:34.620572 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a177c34-683d-4e02-af41-add163c2d77d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:34.620843 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a177c34-683d-4e02-af41-add163c2d77d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:34.637293 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a177c34-683d-4e02-af41-add163c2d77d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:34.644701 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-7a177c34-683d-4e02-af41-add163c2d77d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 02:17:34.645948 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 110/216] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:34 2021] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:34.652359 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd13c7-43d6-4db9-b48e-32090733adac None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:34.666100 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd13c7-43d6-4db9-b48e-32090733adac None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:34.677130 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a53ad-05a0-4b0e-a48a-234fe46bc364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:34.678087 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a53ad-05a0-4b0e-a48a-234fe46bc364 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:34.678564 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a53ad-05a0-4b0e-a48a-234fe46bc364 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:34.679032 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a53ad-05a0-4b0e-a48a-234fe46bc364 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:34.684909 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a53ad-05a0-4b0e-a48a-234fe46bc364 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:34.685484 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a53ad-05a0-4b0e-a48a-234fe46bc364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:34.687367 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8a53ad-05a0-4b0e-a48a-234fe46bc364 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:34.696949 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 107/217] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Sep 15 02:17:34 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:34.702855 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a177c34-683d-4e02-af41-add163c2d77d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:34.723210 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a177c34-683d-4e02-af41-add163c2d77d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:34.733132 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246c1bd-9f9d-40df-baa9-51a2b3d7eeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:34.734026 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c1bd-9f9d-40df-baa9-51a2b3d7eeec admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:34.734306 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c1bd-9f9d-40df-baa9-51a2b3d7eeec admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:34.734580 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c1bd-9f9d-40df-baa9-51a2b3d7eeec admin admin] PATH_INFO: `/v3/users/17730e59d96c42b68e33fbbd4ba213f7` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:34.737891 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246c1bd-9f9d-40df-baa9-51a2b3d7eeec admin admin] RBAC: Authorizing `identity:get_user(user_id=17730e59d96c42b68e33fbbd4ba213f7)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:34.740072 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246c1bd-9f9d-40df-baa9-51a2b3d7eeec admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:34.742015 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 111/218] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:34 2021] GET /identity/v3/users/17730e59d96c42b68e33fbbd4ba213f7 => generated 283 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:34.747729 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a53ad-05a0-4b0e-a48a-234fe46bc364 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:34.764926 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a53ad-05a0-4b0e-a48a-234fe46bc364 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:34.770594 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d65f2-d798-4dbb-829e-ad0ba28f39ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:34.771504 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d65f2-d798-4dbb-829e-ad0ba28f39ca admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:34.771983 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d65f2-d798-4dbb-829e-ad0ba28f39ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:34.772453 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d65f2-d798-4dbb-829e-ad0ba28f39ca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:34.785520 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d65f2-d798-4dbb-829e-ad0ba28f39ca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:34.787541 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d65f2-d798-4dbb-829e-ad0ba28f39ca admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:34.796962 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 108/219] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:34 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:34.803086 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246c1bd-9f9d-40df-baa9-51a2b3d7eeec admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:34.818377 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246c1bd-9f9d-40df-baa9-51a2b3d7eeec admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:34.833548 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4a281-01fc-47f5-9cfa-d376424043a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:34.834429 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4a281-01fc-47f5-9cfa-d376424043a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:34.834710 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4a281-01fc-47f5-9cfa-d376424043a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:34.834988 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4a281-01fc-47f5-9cfa-d376424043a8 admin admin] PATH_INFO: `/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:34.836218 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4a281-01fc-47f5-9cfa-d376424043a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=e95b7aee5cbe45d1ac7e1805bf0d46dd)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:34.838330 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4a281-01fc-47f5-9cfa-d376424043a8 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:34.840226 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 112/220] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:34 2021] GET /identity/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:34.846448 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d65f2-d798-4dbb-829e-ad0ba28f39ca admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:34.857695 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d65f2-d798-4dbb-829e-ad0ba28f39ca admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:34.864735 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9817bb5-f946-4856-b769-951e6c0536a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:34.865753 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9817bb5-f946-4856-b769-951e6c0536a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:34.866232 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9817bb5-f946-4856-b769-951e6c0536a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:34.866702 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9817bb5-f946-4856-b769-951e6c0536a4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:34.867727 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9817bb5-f946-4856-b769-951e6c0536a4 admin admin] RBAC: Adding query filter params (role.id=6f4a40def5d74f0a95ae44fd686a92e5, scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd, user.id=17730e59d96c42b68e33fbbd4ba213f7) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:34.868232 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9817bb5-f946-4856-b769-951e6c0536a4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:34.870320 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9817bb5-f946-4856-b769-951e6c0536a4 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:34.880231 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 109/221] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:34 2021] GET /identity/v3/role_assignments?user.id=17730e59d96c42b68e33fbbd4ba213f7&scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd&role.id=6f4a40def5d74f0a95ae44fd686a92e5 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:35.276141 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208ba79-92ed-40a9-8eda-3efa269b4677 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.276839 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208ba79-92ed-40a9-8eda-3efa269b4677 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.277350 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208ba79-92ed-40a9-8eda-3efa269b4677 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.279765 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 113/222] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:35 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:35.287267 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf1b39-3939-492b-9ae2-9dbfa7d2dbdf None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.287848 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf1b39-3939-492b-9ae2-9dbfa7d2dbdf None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.288323 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf1b39-3939-492b-9ae2-9dbfa7d2dbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.311494 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-37cf1b39-3939-492b-9ae2-9dbfa7d2dbdf None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:35.313048 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-37cf1b39-3939-492b-9ae2-9dbfa7d2dbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:35.322923 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 110/223] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:35.360369 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208ba79-92ed-40a9-8eda-3efa269b4677 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:35.374222 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208ba79-92ed-40a9-8eda-3efa269b4677 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:35.379529 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc79c5-71bb-4e94-bd20-7597050b6abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:35.380625 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc79c5-71bb-4e94-bd20-7597050b6abf admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.384327 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24073129-6123-4e46-b4c2-2066957f5838 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.384864 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24073129-6123-4e46-b4c2-2066957f5838 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.385364 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24073129-6123-4e46-b4c2-2066957f5838 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.387328 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 111/224] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:35.387901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc79c5-71bb-4e94-bd20-7597050b6abf admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.388413 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc79c5-71bb-4e94-bd20-7597050b6abf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.395072 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b290d32-3705-4e4b-98d2-6d20ba3b72ad None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.395615 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b290d32-3705-4e4b-98d2-6d20ba3b72ad None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.396084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b290d32-3705-4e4b-98d2-6d20ba3b72ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.424655 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc79c5-71bb-4e94-bd20-7597050b6abf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:35.431811 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-2b290d32-3705-4e4b-98d2-6d20ba3b72ad None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:35.436554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-dcdc79c5-71bb-4e94-bd20-7597050b6abf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:17:35.438319 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-2b290d32-3705-4e4b-98d2-6d20ba3b72ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:35.441863 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 114/225] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:17:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:35.448566 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc79c5-71bb-4e94-bd20-7597050b6abf admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:35.456106 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 112/226] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:35.465027 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc79c5-71bb-4e94-bd20-7597050b6abf admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:35.469830 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617c4a1-cb61-4ad0-b75a-950d9484ede0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:35.470808 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617c4a1-cb61-4ad0-b75a-950d9484ede0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.471298 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617c4a1-cb61-4ad0-b75a-950d9484ede0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.471763 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617c4a1-cb61-4ad0-b75a-950d9484ede0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.472793 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617c4a1-cb61-4ad0-b75a-950d9484ede0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:35.473322 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617c4a1-cb61-4ad0-b75a-950d9484ede0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:35.475154 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617c4a1-cb61-4ad0-b75a-950d9484ede0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:35.486042 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 115/227] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:35.493637 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b290d32-3705-4e4b-98d2-6d20ba3b72ad None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:35.503598 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b290d32-3705-4e4b-98d2-6d20ba3b72ad None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:35.505350 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617c4a1-cb61-4ad0-b75a-950d9484ede0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:35.515303 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a79538-866d-49f0-b493-5b7c899251f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:35.516138 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a79538-866d-49f0-b493-5b7c899251f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.516415 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a79538-866d-49f0-b493-5b7c899251f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.516685 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a79538-866d-49f0-b493-5b7c899251f6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.524484 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617c4a1-cb61-4ad0-b75a-950d9484ede0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:35.539373 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896db1b-bfa7-4d9d-be01-8dbc709eaf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:35.540187 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896db1b-bfa7-4d9d-be01-8dbc709eaf90 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.540465 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896db1b-bfa7-4d9d-be01-8dbc709eaf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.540739 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896db1b-bfa7-4d9d-be01-8dbc709eaf90 admin admin] PATH_INFO: `/v3/users/a88ff9155434478bafd7ce991d7c4650` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.542277 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a79538-866d-49f0-b493-5b7c899251f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:35.549291 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-e7a79538-866d-49f0-b493-5b7c899251f6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 02:17:35.550552 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896db1b-bfa7-4d9d-be01-8dbc709eaf90 admin admin] RBAC: Authorizing `identity:get_user(user_id=a88ff9155434478bafd7ce991d7c4650)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:35.552429 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896db1b-bfa7-4d9d-be01-8dbc709eaf90 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:35.554213 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 116/228] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:35 2021] GET /identity/v3/users/a88ff9155434478bafd7ce991d7c4650 => generated 247 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:35.555654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 113/229] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:35 2021] GET /identity/v3/roles/member => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:35.560337 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896db1b-bfa7-4d9d-be01-8dbc709eaf90 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:35.570980 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896db1b-bfa7-4d9d-be01-8dbc709eaf90 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:35.575421 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b3f75-3e05-44c2-9ce3-0d3929453a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:35.576079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b3f75-3e05-44c2-9ce3-0d3929453a27 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.576361 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b3f75-3e05-44c2-9ce3-0d3929453a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.576631 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b3f75-3e05-44c2-9ce3-0d3929453a27 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.587157 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b3f75-3e05-44c2-9ce3-0d3929453a27 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:35.588943 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b3f75-3e05-44c2-9ce3-0d3929453a27 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:35.598825 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a79538-866d-49f0-b493-5b7c899251f6 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:35.608785 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a79538-866d-49f0-b493-5b7c899251f6 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:35.611012 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 117/230] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:35.615444 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457572e-cd0a-4867-9a58-e6b860119f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:35.616110 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457572e-cd0a-4867-9a58-e6b860119f86 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.616390 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457572e-cd0a-4867-9a58-e6b860119f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.616668 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457572e-cd0a-4867-9a58-e6b860119f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.617445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457572e-cd0a-4867-9a58-e6b860119f86 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:35.618710 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b3f75-3e05-44c2-9ce3-0d3929453a27 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:35.621013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457572e-cd0a-4867-9a58-e6b860119f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:35.622677 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457572e-cd0a-4867-9a58-e6b860119f86 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:35.628116 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b3f75-3e05-44c2-9ce3-0d3929453a27 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:35.633774 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99007ada-ae6c-44c3-a099-1b38c88add37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:35.634632 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99007ada-ae6c-44c3-a099-1b38c88add37 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.634914 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99007ada-ae6c-44c3-a099-1b38c88add37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.635190 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99007ada-ae6c-44c3-a099-1b38c88add37 admin admin] PATH_INFO: `/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.636377 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99007ada-ae6c-44c3-a099-1b38c88add37 admin admin] RBAC: Authorizing `identity:get_project(project_id=e95b7aee5cbe45d1ac7e1805bf0d46dd)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:35.640858 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99007ada-ae6c-44c3-a099-1b38c88add37 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:35.641499 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 114/231] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Sep 15 02:17:35 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:35.643687 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 118/232] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:35 2021] GET /identity/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:35.650374 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457572e-cd0a-4867-9a58-e6b860119f86 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:35.651329 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99007ada-ae6c-44c3-a099-1b38c88add37 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:35.662587 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99007ada-ae6c-44c3-a099-1b38c88add37 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:35.664178 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457572e-cd0a-4867-9a58-e6b860119f86 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:35.668159 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f9df4-6384-4cab-ba84-6ec45fceb45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:35.668809 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f9df4-6384-4cab-ba84-6ec45fceb45a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.669213 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f9df4-6384-4cab-ba84-6ec45fceb45a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.669490 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f9df4-6384-4cab-ba84-6ec45fceb45a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.677517 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9de830-ad1d-4e74-a825-3bdddf93e041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:35.678182 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9de830-ad1d-4e74-a825-3bdddf93e041 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.678463 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9de830-ad1d-4e74-a825-3bdddf93e041 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.678731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9de830-ad1d-4e74-a825-3bdddf93e041 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.679568 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9de830-ad1d-4e74-a825-3bdddf93e041 admin admin] RBAC: Adding query filter params (role.id=19308d3515f546e9a04e44ae278cd111, scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd, user.id=a88ff9155434478bafd7ce991d7c4650) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:35.679875 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9de830-ad1d-4e74-a825-3bdddf93e041 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:35.681175 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f9df4-6384-4cab-ba84-6ec45fceb45a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:35.681759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9de830-ad1d-4e74-a825-3bdddf93e041 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:35.682917 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f9df4-6384-4cab-ba84-6ec45fceb45a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:35.695058 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 115/233] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:35 2021] GET /identity/v3/role_assignments?user.id=a88ff9155434478bafd7ce991d7c4650&scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd&role.id=19308d3515f546e9a04e44ae278cd111 => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:35.703323 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 119/234] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:17:35.710045 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9de830-ad1d-4e74-a825-3bdddf93e041 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:35.726638 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9de830-ad1d-4e74-a825-3bdddf93e041 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:35.731455 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bb9c8-3420-453e-a5d2-0407da28237f None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.731747 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bb9c8-3420-453e-a5d2-0407da28237f None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.732024 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540bb9c8-3420-453e-a5d2-0407da28237f None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.734321 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 120/235] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:35.737893 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7750fb-6f27-4974-893b-902202bb4d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:35.738769 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7750fb-6f27-4974-893b-902202bb4d5c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.739050 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7750fb-6f27-4974-893b-902202bb4d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.739326 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7750fb-6f27-4974-893b-902202bb4d5c admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.743890 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f55b5-63be-4ec9-8fe7-d547fb6d2e8a None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.744176 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f55b5-63be-4ec9-8fe7-d547fb6d2e8a None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.744463 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f55b5-63be-4ec9-8fe7-d547fb6d2e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.745812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7750fb-6f27-4974-893b-902202bb4d5c admin admin] RBAC: Authorizing `identity:get_project(project_id=911c2d8152d7481fad6c6c9125f3d5a0)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:35.747883 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7750fb-6f27-4974-893b-902202bb4d5c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:35.749708 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 116/236] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:35 2021] GET /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:35.769867 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7750fb-6f27-4974-893b-902202bb4d5c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:35.770776 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-ef3f55b5-63be-4ec9-8fe7-d547fb6d2e8a None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:35.772002 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ef3f55b5-63be-4ec9-8fe7-d547fb6d2e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:35.780996 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 121/237] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:35.795000 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7750fb-6f27-4974-893b-902202bb4d5c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:35.801091 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2dc5e-8fd8-4634-a871-659c9d5d3e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:35.801950 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2dc5e-8fd8-4634-a871-659c9d5d3e5c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.802227 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2dc5e-8fd8-4634-a871-659c9d5d3e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.802497 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2dc5e-8fd8-4634-a871-659c9d5d3e5c admin admin] PATH_INFO: `/v3/groups/e8b118db9c9f4778986061b5d747c527` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.812557 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f55b5-63be-4ec9-8fe7-d547fb6d2e8a None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:35.813908 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2dc5e-8fd8-4634-a871-659c9d5d3e5c admin admin] RBAC: Authorizing `identity:get_group(group_id=e8b118db9c9f4778986061b5d747c527)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:35.814939 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING py.warnings [None req-f1c2dc5e-8fd8-4634-a871-659c9d5d3e5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:17:35.814939 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: warnings.warn(msg) Sep 15 02:17:35.814939 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: Sep 15 02:17:35.816656 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2dc5e-8fd8-4634-a871-659c9d5d3e5c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:35.818414 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 117/238] 10.222.0.32 () {56 vars in 1202 bytes} [Wed Sep 15 02:17:35 2021] GET /identity/v3/groups/e8b118db9c9f4778986061b5d747c527 => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:35.824494 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f55b5-63be-4ec9-8fe7-d547fb6d2e8a None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:35.825089 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2dc5e-8fd8-4634-a871-659c9d5d3e5c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:35.829283 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6ef69-c556-4420-8e5e-922d38d3fce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:35.830124 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6ef69-c556-4420-8e5e-922d38d3fce5 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.830400 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6ef69-c556-4420-8e5e-922d38d3fce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.830674 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6ef69-c556-4420-8e5e-922d38d3fce5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.838122 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2dc5e-8fd8-4634-a871-659c9d5d3e5c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:35.844012 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6ef69-c556-4420-8e5e-922d38d3fce5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:35.846206 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59552b2b-e288-4673-94ae-56e6b945f11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:35.846871 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59552b2b-e288-4673-94ae-56e6b945f11d admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.847695 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59552b2b-e288-4673-94ae-56e6b945f11d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.847971 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59552b2b-e288-4673-94ae-56e6b945f11d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.848813 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59552b2b-e288-4673-94ae-56e6b945f11d admin admin] RBAC: Adding query filter params (group.id=e8b118db9c9f4778986061b5d747c527, role.id=6f4a40def5d74f0a95ae44fd686a92e5, scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:35.849150 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59552b2b-e288-4673-94ae-56e6b945f11d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:35.851021 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59552b2b-e288-4673-94ae-56e6b945f11d admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:35.852261 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-d2f6ef69-c556-4420-8e5e-922d38d3fce5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 02:17:35.857034 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 122/239] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:17:35 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:35.861779 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6ef69-c556-4420-8e5e-922d38d3fce5 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:35.864461 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 118/240] 10.222.0.32 () {56 vars in 1398 bytes} [Wed Sep 15 02:17:35 2021] GET /identity/v3/role_assignments?group.id=e8b118db9c9f4778986061b5d747c527&scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0&role.id=6f4a40def5d74f0a95ae44fd686a92e5 => generated 260 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:35.874110 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6ef69-c556-4420-8e5e-922d38d3fce5 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:35.879055 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e006a54-0d34-4801-910c-1d443fa5e11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:35.879732 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e006a54-0d34-4801-910c-1d443fa5e11d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.880064 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e006a54-0d34-4801-910c-1d443fa5e11d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.880341 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e006a54-0d34-4801-910c-1d443fa5e11d admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.881212 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e006a54-0d34-4801-910c-1d443fa5e11d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:35.881522 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e006a54-0d34-4801-910c-1d443fa5e11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:35.883209 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e006a54-0d34-4801-910c-1d443fa5e11d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:35.893896 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 123/241] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:35 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:35.900922 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59552b2b-e288-4673-94ae-56e6b945f11d admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:35.918581 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59552b2b-e288-4673-94ae-56e6b945f11d admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:35.929943 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46a619-f8be-4fbe-bb2f-f22025c6d613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:35.930848 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46a619-f8be-4fbe-bb2f-f22025c6d613 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.931129 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46a619-f8be-4fbe-bb2f-f22025c6d613 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.931409 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46a619-f8be-4fbe-bb2f-f22025c6d613 admin admin] PATH_INFO: `/v3/users/17730e59d96c42b68e33fbbd4ba213f7` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.933702 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46a619-f8be-4fbe-bb2f-f22025c6d613 admin admin] RBAC: Authorizing `identity:get_user(user_id=17730e59d96c42b68e33fbbd4ba213f7)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:35.935869 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46a619-f8be-4fbe-bb2f-f22025c6d613 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:35.937962 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 119/242] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:17:35 2021] GET /identity/v3/users/17730e59d96c42b68e33fbbd4ba213f7 => generated 283 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:35.944028 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e006a54-0d34-4801-910c-1d443fa5e11d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:35.959072 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e006a54-0d34-4801-910c-1d443fa5e11d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:35.963774 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107943e0-7c61-43b6-83e6-a61f3b93d030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:35.964488 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107943e0-7c61-43b6-83e6-a61f3b93d030 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:35.964772 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107943e0-7c61-43b6-83e6-a61f3b93d030 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:35.965070 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107943e0-7c61-43b6-83e6-a61f3b93d030 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:35.981390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107943e0-7c61-43b6-83e6-a61f3b93d030 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:35.983229 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107943e0-7c61-43b6-83e6-a61f3b93d030 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:35.998936 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 124/243] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:36.005573 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46a619-f8be-4fbe-bb2f-f22025c6d613 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:36.018852 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46a619-f8be-4fbe-bb2f-f22025c6d613 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:36.027249 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184939cb-2575-4892-a08d-8295e50e9ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:36.028213 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184939cb-2575-4892-a08d-8295e50e9ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:36.028500 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184939cb-2575-4892-a08d-8295e50e9ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:36.028777 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184939cb-2575-4892-a08d-8295e50e9ff5 admin admin] PATH_INFO: `/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:36.030646 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184939cb-2575-4892-a08d-8295e50e9ff5 admin admin] RBAC: Authorizing `identity:get_project(project_id=e95b7aee5cbe45d1ac7e1805bf0d46dd)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:36.032836 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184939cb-2575-4892-a08d-8295e50e9ff5 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:36.034795 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 120/244] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:36 2021] GET /identity/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:36.041725 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107943e0-7c61-43b6-83e6-a61f3b93d030 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:36.055189 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107943e0-7c61-43b6-83e6-a61f3b93d030 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:36.059914 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617c691-7cc1-4aa7-8a4b-6ea50b589b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:36.060687 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617c691-7cc1-4aa7-8a4b-6ea50b589b31 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:36.061007 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617c691-7cc1-4aa7-8a4b-6ea50b589b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:36.061285 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617c691-7cc1-4aa7-8a4b-6ea50b589b31 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:36.062200 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617c691-7cc1-4aa7-8a4b-6ea50b589b31 admin admin] RBAC: Adding query filter params (role.id=4449685a6c854c46a265236ba82cd668, scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd, user.id=17730e59d96c42b68e33fbbd4ba213f7) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:36.062511 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617c691-7cc1-4aa7-8a4b-6ea50b589b31 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:36.064584 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617c691-7cc1-4aa7-8a4b-6ea50b589b31 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:36.071857 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 125/245] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:36 2021] GET /identity/v3/role_assignments?user.id=17730e59d96c42b68e33fbbd4ba213f7&scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd&role.id=4449685a6c854c46a265236ba82cd668 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:36.700367 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dddae-3f2e-451f-a4ca-bff9a76a099e None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:36.701050 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dddae-3f2e-451f-a4ca-bff9a76a099e None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:36.701050 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dddae-3f2e-451f-a4ca-bff9a76a099e None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:36.702690 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 121/246] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:36.710795 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048109d4-f7af-4417-b473-9abe3d4ad7b3 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:36.711394 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048109d4-f7af-4417-b473-9abe3d4ad7b3 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:36.711394 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048109d4-f7af-4417-b473-9abe3d4ad7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:36.735014 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-048109d4-f7af-4417-b473-9abe3d4ad7b3 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:36.736126 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-048109d4-f7af-4417-b473-9abe3d4ad7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:36.747237 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 126/247] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:36.786574 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dddae-3f2e-451f-a4ca-bff9a76a099e None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:36.799149 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dddae-3f2e-451f-a4ca-bff9a76a099e None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:36.805579 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894ce06-7564-4ab4-8951-9961812c5286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:36.806385 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894ce06-7564-4ab4-8951-9961812c5286 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:36.806669 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894ce06-7564-4ab4-8951-9961812c5286 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:36.806942 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894ce06-7564-4ab4-8951-9961812c5286 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:36.821518 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894ce06-7564-4ab4-8951-9961812c5286 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:36.829248 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-2894ce06-7564-4ab4-8951-9961812c5286 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 02:17:36.830843 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 122/248] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:17:36 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:36.837427 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048109d4-f7af-4417-b473-9abe3d4ad7b3 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:36.846535 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048109d4-f7af-4417-b473-9abe3d4ad7b3 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:36.851796 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3af260-02f4-4ce2-bccc-5d173581da76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:36.852469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3af260-02f4-4ce2-bccc-5d173581da76 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:36.852794 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3af260-02f4-4ce2-bccc-5d173581da76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:36.853100 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3af260-02f4-4ce2-bccc-5d173581da76 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:36.853864 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3af260-02f4-4ce2-bccc-5d173581da76 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:36.854165 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3af260-02f4-4ce2-bccc-5d173581da76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:36.855819 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3af260-02f4-4ce2-bccc-5d173581da76 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:36.865788 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 127/249] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:36 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:36.871815 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894ce06-7564-4ab4-8951-9961812c5286 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:36.881906 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894ce06-7564-4ab4-8951-9961812c5286 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:36.887440 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bd473-b7fd-4ba4-b961-408201f4bbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:36.888086 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bd473-b7fd-4ba4-b961-408201f4bbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:36.888368 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bd473-b7fd-4ba4-b961-408201f4bbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:36.888695 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bd473-b7fd-4ba4-b961-408201f4bbd1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:36.898876 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bd473-b7fd-4ba4-b961-408201f4bbd1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:36.900763 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bd473-b7fd-4ba4-b961-408201f4bbd1 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:36.912783 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 123/250] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:36 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:36.918943 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3af260-02f4-4ce2-bccc-5d173581da76 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:36.929102 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3af260-02f4-4ce2-bccc-5d173581da76 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:36.933651 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b74596-b6a9-4f10-b1e3-d9bd717e6341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:36.934541 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b74596-b6a9-4f10-b1e3-d9bd717e6341 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:36.934861 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b74596-b6a9-4f10-b1e3-d9bd717e6341 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:36.935138 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b74596-b6a9-4f10-b1e3-d9bd717e6341 admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:36.936320 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b74596-b6a9-4f10-b1e3-d9bd717e6341 admin admin] RBAC: Authorizing `identity:get_project(project_id=911c2d8152d7481fad6c6c9125f3d5a0)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:36.938565 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b74596-b6a9-4f10-b1e3-d9bd717e6341 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:36.940239 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 128/251] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:36 2021] GET /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:36.946168 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bd473-b7fd-4ba4-b961-408201f4bbd1 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:36.955199 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bd473-b7fd-4ba4-b961-408201f4bbd1 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:36.962520 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da567b0d-a146-41c5-a248-9b8ec48560f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:36.963429 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da567b0d-a146-41c5-a248-9b8ec48560f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:36.963714 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da567b0d-a146-41c5-a248-9b8ec48560f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:36.963989 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da567b0d-a146-41c5-a248-9b8ec48560f7 admin admin] PATH_INFO: `/v3/groups/e8b118db9c9f4778986061b5d747c527` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:36.965293 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da567b0d-a146-41c5-a248-9b8ec48560f7 admin admin] RBAC: Authorizing `identity:get_group(group_id=e8b118db9c9f4778986061b5d747c527)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:36.967309 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da567b0d-a146-41c5-a248-9b8ec48560f7 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:36.968980 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 124/252] 10.222.0.32 () {56 vars in 1202 bytes} [Wed Sep 15 02:17:36 2021] GET /identity/v3/groups/e8b118db9c9f4778986061b5d747c527 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:36.975464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b74596-b6a9-4f10-b1e3-d9bd717e6341 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:36.986732 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b74596-b6a9-4f10-b1e3-d9bd717e6341 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:36.992085 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b33c5a-e34d-4662-922f-ff98dc61abfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:36.992837 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b33c5a-e34d-4662-922f-ff98dc61abfe admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:36.993160 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b33c5a-e34d-4662-922f-ff98dc61abfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:36.993483 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b33c5a-e34d-4662-922f-ff98dc61abfe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:36.994319 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b33c5a-e34d-4662-922f-ff98dc61abfe admin admin] RBAC: Adding query filter params (group.id=e8b118db9c9f4778986061b5d747c527, role.id=4449685a6c854c46a265236ba82cd668, scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:36.994684 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b33c5a-e34d-4662-922f-ff98dc61abfe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:36.996647 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b33c5a-e34d-4662-922f-ff98dc61abfe admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:37.005036 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 129/253] 10.222.0.32 () {56 vars in 1398 bytes} [Wed Sep 15 02:17:36 2021] GET /identity/v3/role_assignments?group.id=e8b118db9c9f4778986061b5d747c527&scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0&role.id=4449685a6c854c46a265236ba82cd668 => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:37.167762 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c76488-55bf-4a8d-9919-ecef6107e2d7 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:37.168092 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c76488-55bf-4a8d-9919-ecef6107e2d7 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:37.168315 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c76488-55bf-4a8d-9919-ecef6107e2d7 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:37.170264 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 125/254] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:37.189718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfcd81-0e5b-4504-ac99-f9060571c46f None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:37.190038 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfcd81-0e5b-4504-ac99-f9060571c46f None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:37.190267 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfcd81-0e5b-4504-ac99-f9060571c46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:37.210945 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-c8bfcd81-0e5b-4504-ac99-f9060571c46f None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:37.212146 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-c8bfcd81-0e5b-4504-ac99-f9060571c46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:37.226250 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 130/255] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:37.252722 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c76488-55bf-4a8d-9919-ecef6107e2d7 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:37.268535 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c76488-55bf-4a8d-9919-ecef6107e2d7 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:37.274976 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9381e-dc0f-4fb0-866b-851e264b3c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:37.275777 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9381e-dc0f-4fb0-866b-851e264b3c15 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:37.276060 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9381e-dc0f-4fb0-866b-851e264b3c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:37.276336 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9381e-dc0f-4fb0-866b-851e264b3c15 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:37.292024 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9381e-dc0f-4fb0-866b-851e264b3c15 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:37.299101 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-d0a9381e-dc0f-4fb0-866b-851e264b3c15 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 02:17:37.300652 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 126/256] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:37 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:37.306936 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfcd81-0e5b-4504-ac99-f9060571c46f None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:37.320290 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfcd81-0e5b-4504-ac99-f9060571c46f None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:37.330369 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b773be5-1de2-459c-9e7e-34b187157387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:37.331073 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b773be5-1de2-459c-9e7e-34b187157387 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:37.331353 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b773be5-1de2-459c-9e7e-34b187157387 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:37.331713 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b773be5-1de2-459c-9e7e-34b187157387 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:37.332495 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b773be5-1de2-459c-9e7e-34b187157387 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:37.332798 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b773be5-1de2-459c-9e7e-34b187157387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:37.334492 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b773be5-1de2-459c-9e7e-34b187157387 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:37.344020 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 131/257] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Sep 15 02:17:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:37.350952 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9381e-dc0f-4fb0-866b-851e264b3c15 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:37.368401 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9381e-dc0f-4fb0-866b-851e264b3c15 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:37.375773 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19755db9-3da6-4145-be75-e03e1a3bdd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:37.376426 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19755db9-3da6-4145-be75-e03e1a3bdd0b admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:37.376710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19755db9-3da6-4145-be75-e03e1a3bdd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:37.377007 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19755db9-3da6-4145-be75-e03e1a3bdd0b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:37.390438 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19755db9-3da6-4145-be75-e03e1a3bdd0b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:37.392207 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19755db9-3da6-4145-be75-e03e1a3bdd0b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:37.407045 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 127/258] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:37 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:37.413273 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b773be5-1de2-459c-9e7e-34b187157387 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:37.427782 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b773be5-1de2-459c-9e7e-34b187157387 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:37.436829 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf238de-b7ce-4d63-a879-26f31696c3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:37.437711 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf238de-b7ce-4d63-a879-26f31696c3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:37.437984 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf238de-b7ce-4d63-a879-26f31696c3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:37.438251 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf238de-b7ce-4d63-a879-26f31696c3a2 admin admin] PATH_INFO: `/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:37.439434 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf238de-b7ce-4d63-a879-26f31696c3a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=e95b7aee5cbe45d1ac7e1805bf0d46dd)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:37.441591 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf238de-b7ce-4d63-a879-26f31696c3a2 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:37.443322 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 132/259] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:37 2021] GET /identity/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:37.449468 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19755db9-3da6-4145-be75-e03e1a3bdd0b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:37.461893 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19755db9-3da6-4145-be75-e03e1a3bdd0b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:37.470744 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540ba9b-5600-4b9b-b439-78e21737348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:37.470744 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540ba9b-5600-4b9b-b439-78e21737348f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:37.470744 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540ba9b-5600-4b9b-b439-78e21737348f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:37.470744 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540ba9b-5600-4b9b-b439-78e21737348f admin admin] PATH_INFO: `/v3/groups/e8b118db9c9f4778986061b5d747c527` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:37.478507 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540ba9b-5600-4b9b-b439-78e21737348f admin admin] RBAC: Authorizing `identity:get_group(group_id=e8b118db9c9f4778986061b5d747c527)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:37.479995 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540ba9b-5600-4b9b-b439-78e21737348f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:37.481590 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 128/260] 10.222.0.32 () {56 vars in 1202 bytes} [Wed Sep 15 02:17:37 2021] GET /identity/v3/groups/e8b118db9c9f4778986061b5d747c527 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:37.488683 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf238de-b7ce-4d63-a879-26f31696c3a2 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:37.499299 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf238de-b7ce-4d63-a879-26f31696c3a2 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:37.518178 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe830b-3fc9-4f46-a782-7084f0435226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:37.518775 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe830b-3fc9-4f46-a782-7084f0435226 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:37.519579 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe830b-3fc9-4f46-a782-7084f0435226 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:37.519849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe830b-3fc9-4f46-a782-7084f0435226 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:37.520681 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe830b-3fc9-4f46-a782-7084f0435226 admin admin] RBAC: Adding query filter params (group.id=e8b118db9c9f4778986061b5d747c527, role.id=6f4a40def5d74f0a95ae44fd686a92e5, scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:37.521015 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe830b-3fc9-4f46-a782-7084f0435226 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:37.522870 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe830b-3fc9-4f46-a782-7084f0435226 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:37.528795 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 133/261] 10.222.0.32 () {56 vars in 1398 bytes} [Wed Sep 15 02:17:37 2021] GET /identity/v3/role_assignments?group.id=e8b118db9c9f4778986061b5d747c527&scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd&role.id=6f4a40def5d74f0a95ae44fd686a92e5 => generated 260 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:37.903280 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b51a62-6011-44bb-94df-745d1dae32cd None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:37.903803 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b51a62-6011-44bb-94df-745d1dae32cd None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:37.903878 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b51a62-6011-44bb-94df-745d1dae32cd None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:37.907015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 129/262] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:37.915173 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edfd83-1769-4c61-aa29-9c95fab576c9 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:37.916050 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edfd83-1769-4c61-aa29-9c95fab576c9 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:37.916519 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edfd83-1769-4c61-aa29-9c95fab576c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:37.938206 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-66edfd83-1769-4c61-aa29-9c95fab576c9 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:37.939741 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-66edfd83-1769-4c61-aa29-9c95fab576c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:37.952059 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 134/263] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:37.984028 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b51a62-6011-44bb-94df-745d1dae32cd None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:37.998882 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b51a62-6011-44bb-94df-745d1dae32cd None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:38.005831 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649e265-7481-4d2b-900c-ddd86412b85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:38.006946 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649e265-7481-4d2b-900c-ddd86412b85b admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:38.007425 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649e265-7481-4d2b-900c-ddd86412b85b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:38.007927 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649e265-7481-4d2b-900c-ddd86412b85b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:38.025754 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649e265-7481-4d2b-900c-ddd86412b85b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:38.033392 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-f649e265-7481-4d2b-900c-ddd86412b85b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 02:17:38.035563 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 130/264] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:17:37 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:38.041946 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edfd83-1769-4c61-aa29-9c95fab576c9 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:38.052049 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edfd83-1769-4c61-aa29-9c95fab576c9 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:38.058887 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fbc6e-3907-47e4-812a-45fe96564b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:38.059777 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fbc6e-3907-47e4-812a-45fe96564b5a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:38.060275 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fbc6e-3907-47e4-812a-45fe96564b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:38.060757 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fbc6e-3907-47e4-812a-45fe96564b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:38.061760 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fbc6e-3907-47e4-812a-45fe96564b5a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:38.062284 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fbc6e-3907-47e4-812a-45fe96564b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:38.064099 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fbc6e-3907-47e4-812a-45fe96564b5a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:38.076843 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 135/265] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:38.083234 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649e265-7481-4d2b-900c-ddd86412b85b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:38.093550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649e265-7481-4d2b-900c-ddd86412b85b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:38.101456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad1997-7a6a-4cb9-b77c-a06efc52f850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:38.102614 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad1997-7a6a-4cb9-b77c-a06efc52f850 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:38.103095 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad1997-7a6a-4cb9-b77c-a06efc52f850 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:38.103578 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad1997-7a6a-4cb9-b77c-a06efc52f850 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:38.118783 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad1997-7a6a-4cb9-b77c-a06efc52f850 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:38.121041 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad1997-7a6a-4cb9-b77c-a06efc52f850 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:38.135017 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 131/266] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:38.140785 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fbc6e-3907-47e4-812a-45fe96564b5a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:38.152898 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fbc6e-3907-47e4-812a-45fe96564b5a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:38.158675 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf641b25-72e7-4945-bb69-aca9bef193a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:38.160402 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf641b25-72e7-4945-bb69-aca9bef193a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:38.160925 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf641b25-72e7-4945-bb69-aca9bef193a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:38.161419 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf641b25-72e7-4945-bb69-aca9bef193a0 admin admin] PATH_INFO: `/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:38.165638 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf641b25-72e7-4945-bb69-aca9bef193a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=e95b7aee5cbe45d1ac7e1805bf0d46dd)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:38.167984 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf641b25-72e7-4945-bb69-aca9bef193a0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:38.170118 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 136/267] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:38 2021] GET /identity/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:38.176265 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad1997-7a6a-4cb9-b77c-a06efc52f850 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:38.185644 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad1997-7a6a-4cb9-b77c-a06efc52f850 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:38.192190 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06ccca-53cb-4b4b-b925-f20644cd6900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:38.193401 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06ccca-53cb-4b4b-b925-f20644cd6900 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:38.193899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06ccca-53cb-4b4b-b925-f20644cd6900 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:38.194366 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06ccca-53cb-4b4b-b925-f20644cd6900 admin admin] PATH_INFO: `/v3/groups/e8b118db9c9f4778986061b5d747c527` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:38.195885 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06ccca-53cb-4b4b-b925-f20644cd6900 admin admin] RBAC: Authorizing `identity:get_group(group_id=e8b118db9c9f4778986061b5d747c527)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:38.198075 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06ccca-53cb-4b4b-b925-f20644cd6900 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:38.200113 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 132/268] 10.222.0.32 () {56 vars in 1202 bytes} [Wed Sep 15 02:17:38 2021] GET /identity/v3/groups/e8b118db9c9f4778986061b5d747c527 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:38.207090 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf641b25-72e7-4945-bb69-aca9bef193a0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:38.217708 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf641b25-72e7-4945-bb69-aca9bef193a0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:38.222801 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61293669-261a-41dc-98c0-40741204fbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:38.223746 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61293669-261a-41dc-98c0-40741204fbce admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:38.224296 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61293669-261a-41dc-98c0-40741204fbce admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:38.224796 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61293669-261a-41dc-98c0-40741204fbce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:38.225953 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61293669-261a-41dc-98c0-40741204fbce admin admin] RBAC: Adding query filter params (group.id=e8b118db9c9f4778986061b5d747c527, role.id=4449685a6c854c46a265236ba82cd668, scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:38.226517 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61293669-261a-41dc-98c0-40741204fbce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:38.228663 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61293669-261a-41dc-98c0-40741204fbce admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:38.237385 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 137/269] 10.222.0.32 () {56 vars in 1398 bytes} [Wed Sep 15 02:17:38 2021] GET /identity/v3/role_assignments?group.id=e8b118db9c9f4778986061b5d747c527&scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd&role.id=4449685a6c854c46a265236ba82cd668 => generated 260 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:38.482513 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee38d74-0bd1-4d5b-9490-7a7b8886fe6c None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:38.483119 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee38d74-0bd1-4d5b-9490-7a7b8886fe6c None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:38.483611 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee38d74-0bd1-4d5b-9490-7a7b8886fe6c None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:38.485934 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 133/270] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:38.493947 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f5cf5-d3a0-45de-a6bd-3c9da7df718f None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:38.494528 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f5cf5-d3a0-45de-a6bd-3c9da7df718f None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:38.495002 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f5cf5-d3a0-45de-a6bd-3c9da7df718f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:38.513700 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-e45f5cf5-d3a0-45de-a6bd-3c9da7df718f None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:38.514879 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-e45f5cf5-d3a0-45de-a6bd-3c9da7df718f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:38.527305 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 138/271] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:38.568761 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee38d74-0bd1-4d5b-9490-7a7b8886fe6c None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:38.583607 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee38d74-0bd1-4d5b-9490-7a7b8886fe6c None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:38.592351 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716aea34-4629-4b1d-83dd-5ebaa549d9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:38.593424 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716aea34-4629-4b1d-83dd-5ebaa549d9ab admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:38.593903 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716aea34-4629-4b1d-83dd-5ebaa549d9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:38.594370 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716aea34-4629-4b1d-83dd-5ebaa549d9ab admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:38.607836 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716aea34-4629-4b1d-83dd-5ebaa549d9ab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:38.615202 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-716aea34-4629-4b1d-83dd-5ebaa549d9ab admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:17:38.620971 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 134/272] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:17:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:38.622881 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f5cf5-d3a0-45de-a6bd-3c9da7df718f None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:38.632403 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f5cf5-d3a0-45de-a6bd-3c9da7df718f None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:38.641109 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060103f3-55c1-479e-9715-4a100dd90e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:38.641783 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060103f3-55c1-479e-9715-4a100dd90e79 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:38.642061 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060103f3-55c1-479e-9715-4a100dd90e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:38.642330 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060103f3-55c1-479e-9715-4a100dd90e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:38.643086 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060103f3-55c1-479e-9715-4a100dd90e79 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:38.643389 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060103f3-55c1-479e-9715-4a100dd90e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:38.645585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060103f3-55c1-479e-9715-4a100dd90e79 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:38.658758 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 139/273] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:38.664731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716aea34-4629-4b1d-83dd-5ebaa549d9ab admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:38.678337 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716aea34-4629-4b1d-83dd-5ebaa549d9ab admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:38.685155 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30087aa8-cf33-4717-bd70-f6ac08868888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:38.685815 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30087aa8-cf33-4717-bd70-f6ac08868888 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:38.686093 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30087aa8-cf33-4717-bd70-f6ac08868888 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:38.686363 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30087aa8-cf33-4717-bd70-f6ac08868888 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:38.697969 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30087aa8-cf33-4717-bd70-f6ac08868888 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:38.699737 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30087aa8-cf33-4717-bd70-f6ac08868888 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:38.717619 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 135/274] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:38.724376 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060103f3-55c1-479e-9715-4a100dd90e79 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:38.734513 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060103f3-55c1-479e-9715-4a100dd90e79 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:38.739319 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbad0e-af4f-4082-b046-848e343ddcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:38.740170 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbad0e-af4f-4082-b046-848e343ddcec admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:38.740452 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbad0e-af4f-4082-b046-848e343ddcec admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:38.740729 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbad0e-af4f-4082-b046-848e343ddcec admin admin] PATH_INFO: `/v3/projects/2c09835f6deb405b989b793378de873e` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:38.742006 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbad0e-af4f-4082-b046-848e343ddcec admin admin] RBAC: Authorizing `identity:get_project(project_id=2c09835f6deb405b989b793378de873e)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:38.743903 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbad0e-af4f-4082-b046-848e343ddcec admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:38.745676 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 140/275] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:38 2021] GET /identity/v3/projects/2c09835f6deb405b989b793378de873e => generated 344 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:38.751802 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30087aa8-cf33-4717-bd70-f6ac08868888 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:38.761619 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30087aa8-cf33-4717-bd70-f6ac08868888 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:38.768196 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f355d20-88e5-4a45-9e1d-bebfaec04085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:38.769759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f355d20-88e5-4a45-9e1d-bebfaec04085 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:38.770045 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f355d20-88e5-4a45-9e1d-bebfaec04085 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:38.770323 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f355d20-88e5-4a45-9e1d-bebfaec04085 admin admin] PATH_INFO: `/v3/groups/dc6e07bfa57e441c95d8a3c455161955` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:38.778063 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f355d20-88e5-4a45-9e1d-bebfaec04085 admin admin] RBAC: Authorizing `identity:get_group(group_id=dc6e07bfa57e441c95d8a3c455161955)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:38.780030 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f355d20-88e5-4a45-9e1d-bebfaec04085 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:38.782130 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 136/276] 10.222.0.32 () {56 vars in 1202 bytes} [Wed Sep 15 02:17:38 2021] GET /identity/v3/groups/dc6e07bfa57e441c95d8a3c455161955 => generated 229 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:38.788642 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbad0e-af4f-4082-b046-848e343ddcec admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:38.798866 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbad0e-af4f-4082-b046-848e343ddcec admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:38.805583 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c560f-67a0-4ba4-8481-3a39b47c6b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:38.806354 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c560f-67a0-4ba4-8481-3a39b47c6b1a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:38.806640 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c560f-67a0-4ba4-8481-3a39b47c6b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:38.806917 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c560f-67a0-4ba4-8481-3a39b47c6b1a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:38.807822 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c560f-67a0-4ba4-8481-3a39b47c6b1a admin admin] RBAC: Adding query filter params (group.id=dc6e07bfa57e441c95d8a3c455161955, role.id=19308d3515f546e9a04e44ae278cd111, scope.project.id=2c09835f6deb405b989b793378de873e) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:38.808136 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c560f-67a0-4ba4-8481-3a39b47c6b1a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:38.810137 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c560f-67a0-4ba4-8481-3a39b47c6b1a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:38.816754 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 141/277] 10.222.0.32 () {56 vars in 1398 bytes} [Wed Sep 15 02:17:38 2021] GET /identity/v3/role_assignments?group.id=dc6e07bfa57e441c95d8a3c455161955&scope.project.id=2c09835f6deb405b989b793378de873e&role.id=19308d3515f546e9a04e44ae278cd111 => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:39.126016 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e36c9-8287-463d-8621-a85f2432e730 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:39.126732 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e36c9-8287-463d-8621-a85f2432e730 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:39.126732 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e36c9-8287-463d-8621-a85f2432e730 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:39.128476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 137/278] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:39.149154 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69870b2-392a-4e28-90fb-503272d2f470 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:39.149774 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69870b2-392a-4e28-90fb-503272d2f470 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:39.149774 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69870b2-392a-4e28-90fb-503272d2f470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:39.171381 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-a69870b2-392a-4e28-90fb-503272d2f470 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:39.172572 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-a69870b2-392a-4e28-90fb-503272d2f470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:39.182929 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 142/279] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:39.209479 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e36c9-8287-463d-8621-a85f2432e730 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:39.223093 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e36c9-8287-463d-8621-a85f2432e730 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:39.227817 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b02c8-4a60-4f7e-a025-fc56dfde2964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:39.228618 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b02c8-4a60-4f7e-a025-fc56dfde2964 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:39.228921 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b02c8-4a60-4f7e-a025-fc56dfde2964 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:39.229203 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b02c8-4a60-4f7e-a025-fc56dfde2964 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:39.243877 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b02c8-4a60-4f7e-a025-fc56dfde2964 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:39.250956 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-c23b02c8-4a60-4f7e-a025-fc56dfde2964 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 02:17:39.252173 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 138/280] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:39.260123 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69870b2-392a-4e28-90fb-503272d2f470 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:39.269395 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69870b2-392a-4e28-90fb-503272d2f470 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:39.274664 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444ac08-0643-47c5-9c87-248b2b9c408a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:39.275345 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444ac08-0643-47c5-9c87-248b2b9c408a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:39.275625 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444ac08-0643-47c5-9c87-248b2b9c408a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:39.275893 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444ac08-0643-47c5-9c87-248b2b9c408a admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:39.276701 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444ac08-0643-47c5-9c87-248b2b9c408a admin admin] RBAC: Adding query filter params (name=member) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:39.277079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444ac08-0643-47c5-9c87-248b2b9c408a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:39.278702 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444ac08-0643-47c5-9c87-248b2b9c408a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:39.295126 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 143/281] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Sep 15 02:17:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:39.301915 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b02c8-4a60-4f7e-a025-fc56dfde2964 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:39.312281 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b02c8-4a60-4f7e-a025-fc56dfde2964 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:39.321165 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f9e0e-cf0c-4b1e-9572-338bef3853ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:39.322385 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f9e0e-cf0c-4b1e-9572-338bef3853ba admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:39.322870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f9e0e-cf0c-4b1e-9572-338bef3853ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:39.323372 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f9e0e-cf0c-4b1e-9572-338bef3853ba admin admin] PATH_INFO: `/v3/groups/e8b118db9c9f4778986061b5d747c527` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:39.325452 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f9e0e-cf0c-4b1e-9572-338bef3853ba admin admin] RBAC: Authorizing `identity:get_group(group_id=e8b118db9c9f4778986061b5d747c527)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:39.327704 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f9e0e-cf0c-4b1e-9572-338bef3853ba admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:39.329642 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 139/282] 10.222.0.32 () {56 vars in 1202 bytes} [Wed Sep 15 02:17:39 2021] GET /identity/v3/groups/e8b118db9c9f4778986061b5d747c527 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:39.336265 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444ac08-0643-47c5-9c87-248b2b9c408a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:39.350958 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444ac08-0643-47c5-9c87-248b2b9c408a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:39.361215 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749e0b0-0318-4aed-9616-d794d2f65c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:39.362344 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749e0b0-0318-4aed-9616-d794d2f65c63 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:39.362794 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749e0b0-0318-4aed-9616-d794d2f65c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:39.362967 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749e0b0-0318-4aed-9616-d794d2f65c63 admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:39.364166 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749e0b0-0318-4aed-9616-d794d2f65c63 admin admin] RBAC: Authorizing `identity:get_project(project_id=911c2d8152d7481fad6c6c9125f3d5a0)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:39.370365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749e0b0-0318-4aed-9616-d794d2f65c63 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:39.372434 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 144/283] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:39 2021] GET /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:39.379609 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f9e0e-cf0c-4b1e-9572-338bef3853ba admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:39.395751 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f9e0e-cf0c-4b1e-9572-338bef3853ba admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:39.402012 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b29ba-a9a4-47ab-b270-764957fe39d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:39.403166 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b29ba-a9a4-47ab-b270-764957fe39d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:39.403701 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b29ba-a9a4-47ab-b270-764957fe39d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:39.404176 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b29ba-a9a4-47ab-b270-764957fe39d9 admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0/groups/e8b118db9c9f4778986061b5d747c527/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:39.410842 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b29ba-a9a4-47ab-b270-764957fe39d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=911c2d8152d7481fad6c6c9125f3d5a0, group_id=e8b118db9c9f4778986061b5d747c527, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:39.413909 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b29ba-a9a4-47ab-b270-764957fe39d9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:39.435151 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 140/284] 10.222.0.32 () {58 vars in 1464 bytes} [Wed Sep 15 02:17:39 2021] PUT /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0/groups/e8b118db9c9f4778986061b5d747c527/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:17:39.814845 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26509943-a317-4788-a18c-1b9d7b4f6f24 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:39.815181 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26509943-a317-4788-a18c-1b9d7b4f6f24 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:39.815310 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26509943-a317-4788-a18c-1b9d7b4f6f24 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:39.817837 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 145/285] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:39.826211 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0f077-dfec-4d0c-b7a1-cd466395d77f None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:39.826791 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0f077-dfec-4d0c-b7a1-cd466395d77f None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:39.827271 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0f077-dfec-4d0c-b7a1-cd466395d77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:39.850335 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-8ac0f077-dfec-4d0c-b7a1-cd466395d77f None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:39.851838 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8ac0f077-dfec-4d0c-b7a1-cd466395d77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:39.917403 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 141/286] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:39.960493 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26509943-a317-4788-a18c-1b9d7b4f6f24 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:39.978781 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26509943-a317-4788-a18c-1b9d7b4f6f24 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:39.989486 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f08d3-a1c3-46b5-b99a-9fb303a16334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:39.990542 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f08d3-a1c3-46b5-b99a-9fb303a16334 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:39.991046 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f08d3-a1c3-46b5-b99a-9fb303a16334 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:39.991517 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f08d3-a1c3-46b5-b99a-9fb303a16334 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:40.002655 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f08d3-a1c3-46b5-b99a-9fb303a16334 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:40.010207 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-9c3f08d3-a1c3-46b5-b99a-9fb303a16334 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 02:17:40.011629 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 146/287] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:17:39 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:17:40.018035 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0f077-dfec-4d0c-b7a1-cd466395d77f None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:40.027262 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0f077-dfec-4d0c-b7a1-cd466395d77f None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:40.037565 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5740fa-d2a0-44d9-9215-abe12676843b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:40.038689 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5740fa-d2a0-44d9-9215-abe12676843b admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:40.039185 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5740fa-d2a0-44d9-9215-abe12676843b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:40.039664 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5740fa-d2a0-44d9-9215-abe12676843b admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:40.040611 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5740fa-d2a0-44d9-9215-abe12676843b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:40.041131 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5740fa-d2a0-44d9-9215-abe12676843b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:40.042914 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5740fa-d2a0-44d9-9215-abe12676843b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:40.056086 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 142/288] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:40 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:40.062437 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f08d3-a1c3-46b5-b99a-9fb303a16334 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:40.077957 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f08d3-a1c3-46b5-b99a-9fb303a16334 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:40.085480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea43ba-94d1-4956-99c5-bf6ac7002d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:40.086581 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea43ba-94d1-4956-99c5-bf6ac7002d13 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:40.087064 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea43ba-94d1-4956-99c5-bf6ac7002d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:40.087555 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea43ba-94d1-4956-99c5-bf6ac7002d13 admin admin] PATH_INFO: `/v3/groups/e8b118db9c9f4778986061b5d747c527` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:40.089034 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea43ba-94d1-4956-99c5-bf6ac7002d13 admin admin] RBAC: Authorizing `identity:get_group(group_id=e8b118db9c9f4778986061b5d747c527)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:40.090258 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING py.warnings [None req-9bea43ba-94d1-4956-99c5-bf6ac7002d13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:17:40.090258 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: warnings.warn(msg) Sep 15 02:17:40.090258 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: Sep 15 02:17:40.091793 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea43ba-94d1-4956-99c5-bf6ac7002d13 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:40.093649 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 147/289] 10.222.0.32 () {56 vars in 1202 bytes} [Wed Sep 15 02:17:40 2021] GET /identity/v3/groups/e8b118db9c9f4778986061b5d747c527 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:40.100230 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5740fa-d2a0-44d9-9215-abe12676843b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:40.114173 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5740fa-d2a0-44d9-9215-abe12676843b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:40.122348 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86024bd7-9969-4475-a586-c56b6796d6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:40.123469 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86024bd7-9969-4475-a586-c56b6796d6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:40.123961 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86024bd7-9969-4475-a586-c56b6796d6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:40.124432 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86024bd7-9969-4475-a586-c56b6796d6d5 admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:40.125862 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86024bd7-9969-4475-a586-c56b6796d6d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=911c2d8152d7481fad6c6c9125f3d5a0)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:40.128097 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86024bd7-9969-4475-a586-c56b6796d6d5 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:40.131018 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 143/290] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:40 2021] GET /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:40.137427 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea43ba-94d1-4956-99c5-bf6ac7002d13 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:40.154016 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea43ba-94d1-4956-99c5-bf6ac7002d13 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:40.160605 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014854a-5e79-4a32-92d5-54e7ccb0f5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:40.161741 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014854a-5e79-4a32-92d5-54e7ccb0f5f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:40.162245 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014854a-5e79-4a32-92d5-54e7ccb0f5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:40.162737 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014854a-5e79-4a32-92d5-54e7ccb0f5f6 admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0/groups/e8b118db9c9f4778986061b5d747c527/roles/4449685a6c854c46a265236ba82cd668` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:40.170702 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014854a-5e79-4a32-92d5-54e7ccb0f5f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=911c2d8152d7481fad6c6c9125f3d5a0, group_id=e8b118db9c9f4778986061b5d747c527, role_id=4449685a6c854c46a265236ba82cd668)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:40.173600 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014854a-5e79-4a32-92d5-54e7ccb0f5f6 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:40.197387 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 148/291] 10.222.0.32 () {58 vars in 1464 bytes} [Wed Sep 15 02:17:40 2021] PUT /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0/groups/e8b118db9c9f4778986061b5d747c527/roles/4449685a6c854c46a265236ba82cd668 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:17:40.639734 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ac694-8ccc-4330-9d03-473fa8328938 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:40.640516 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ac694-8ccc-4330-9d03-473fa8328938 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:40.641042 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ac694-8ccc-4330-9d03-473fa8328938 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:40.643024 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 144/292] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:40.651185 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ed003-32fe-4821-8eae-2a8462164974 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:40.651462 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ed003-32fe-4821-8eae-2a8462164974 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:40.651740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ed003-32fe-4821-8eae-2a8462164974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:40.669618 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-703ed003-32fe-4821-8eae-2a8462164974 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:40.670779 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-703ed003-32fe-4821-8eae-2a8462164974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:40.747813 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 149/293] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:40.781742 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ac694-8ccc-4330-9d03-473fa8328938 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:40.805962 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ac694-8ccc-4330-9d03-473fa8328938 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:40.817425 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa145f-4830-43dc-8b0d-c88e18a607e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:40.818504 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa145f-4830-43dc-8b0d-c88e18a607e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:40.818963 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa145f-4830-43dc-8b0d-c88e18a607e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:40.819377 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa145f-4830-43dc-8b0d-c88e18a607e0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:40.837951 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa145f-4830-43dc-8b0d-c88e18a607e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:40.845575 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-c5fa145f-4830-43dc-8b0d-c88e18a607e0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 02:17:40.847614 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 145/294] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:40 2021] GET /identity/v3/roles/member => generated 84 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:40.854545 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ed003-32fe-4821-8eae-2a8462164974 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:40.864863 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ed003-32fe-4821-8eae-2a8462164974 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:40.876387 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099001af-e95f-4172-b728-ae1b1ece804f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:40.877215 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099001af-e95f-4172-b728-ae1b1ece804f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:40.877609 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099001af-e95f-4172-b728-ae1b1ece804f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:40.877977 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099001af-e95f-4172-b728-ae1b1ece804f admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:40.878933 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099001af-e95f-4172-b728-ae1b1ece804f admin admin] RBAC: Adding query filter params (name=member) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:40.879333 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099001af-e95f-4172-b728-ae1b1ece804f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:40.881151 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099001af-e95f-4172-b728-ae1b1ece804f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:40.897300 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 150/295] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Sep 15 02:17:40 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:40.903417 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa145f-4830-43dc-8b0d-c88e18a607e0 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:40.921821 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa145f-4830-43dc-8b0d-c88e18a607e0 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:40.929602 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42688fe8-4d5b-41a7-9a86-351c990851eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:40.930623 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42688fe8-4d5b-41a7-9a86-351c990851eb admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:40.931065 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42688fe8-4d5b-41a7-9a86-351c990851eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:40.931563 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42688fe8-4d5b-41a7-9a86-351c990851eb admin admin] PATH_INFO: `/v3/groups/e8b118db9c9f4778986061b5d747c527` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:40.932871 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42688fe8-4d5b-41a7-9a86-351c990851eb admin admin] RBAC: Authorizing `identity:get_group(group_id=e8b118db9c9f4778986061b5d747c527)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:40.934916 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42688fe8-4d5b-41a7-9a86-351c990851eb admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:40.940800 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 146/296] 10.222.0.32 () {56 vars in 1202 bytes} [Wed Sep 15 02:17:40 2021] GET /identity/v3/groups/e8b118db9c9f4778986061b5d747c527 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:40.942795 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099001af-e95f-4172-b728-ae1b1ece804f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:40.958382 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099001af-e95f-4172-b728-ae1b1ece804f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:40.963206 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804f78d-18e6-4847-9900-efcc00ab5b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:40.964202 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804f78d-18e6-4847-9900-efcc00ab5b79 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:40.964553 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804f78d-18e6-4847-9900-efcc00ab5b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:40.964910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804f78d-18e6-4847-9900-efcc00ab5b79 admin admin] PATH_INFO: `/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:40.966194 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804f78d-18e6-4847-9900-efcc00ab5b79 admin admin] RBAC: Authorizing `identity:get_project(project_id=e95b7aee5cbe45d1ac7e1805bf0d46dd)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:40.968495 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804f78d-18e6-4847-9900-efcc00ab5b79 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:40.970607 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 151/297] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:40 2021] GET /identity/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:40.974043 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5e9e9-6065-41f3-a3a6-dc092d4ed15f None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:40.974327 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5e9e9-6065-41f3-a3a6-dc092d4ed15f None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:40.974597 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5e9e9-6065-41f3-a3a6-dc092d4ed15f None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:40.977107 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804f78d-18e6-4847-9900-efcc00ab5b79 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:40.982453 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 147/298] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:40 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:40.988046 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804f78d-18e6-4847-9900-efcc00ab5b79 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:40.997122 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2f69d-a226-4888-b9ef-06289bc3305d None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:40.997526 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2f69d-a226-4888-b9ef-06289bc3305d None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:40.997693 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2f69d-a226-4888-b9ef-06289bc3305d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:41.000469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab7980-ec02-46e9-9a06-5dc9427b14e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:41.001365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab7980-ec02-46e9-9a06-5dc9427b14e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:41.001655 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab7980-ec02-46e9-9a06-5dc9427b14e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:41.001936 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab7980-ec02-46e9-9a06-5dc9427b14e0 admin admin] PATH_INFO: `/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd/groups/e8b118db9c9f4778986061b5d747c527/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:41.007096 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab7980-ec02-46e9-9a06-5dc9427b14e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95b7aee5cbe45d1ac7e1805bf0d46dd, group_id=e8b118db9c9f4778986061b5d747c527, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:41.009803 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab7980-ec02-46e9-9a06-5dc9427b14e0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:41.020937 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-bba2f69d-a226-4888-b9ef-06289bc3305d None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:41.022183 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-bba2f69d-a226-4888-b9ef-06289bc3305d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:41.033851 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 152/299] 10.222.0.32 () {58 vars in 1464 bytes} [Wed Sep 15 02:17:40 2021] PUT /identity/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd/groups/e8b118db9c9f4778986061b5d747c527/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:17:41.038111 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 148/300] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:41.062523 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab7980-ec02-46e9-9a06-5dc9427b14e0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:41.135560 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab7980-ec02-46e9-9a06-5dc9427b14e0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:41.141773 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5775a-7dcd-438b-974c-68692316442b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:41.142630 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5775a-7dcd-438b-974c-68692316442b admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:41.142911 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5775a-7dcd-438b-974c-68692316442b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:41.143184 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5775a-7dcd-438b-974c-68692316442b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:41.157351 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5775a-7dcd-438b-974c-68692316442b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:41.165755 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-eec5775a-7dcd-438b-974c-68692316442b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 02:17:41.167278 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 153/301] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:17:41 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:41.173888 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2f69d-a226-4888-b9ef-06289bc3305d None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:41.182956 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2f69d-a226-4888-b9ef-06289bc3305d None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:41.187888 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8568d4-53ad-4d39-8fd6-cf2d57677190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:41.188630 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8568d4-53ad-4d39-8fd6-cf2d57677190 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:41.188944 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8568d4-53ad-4d39-8fd6-cf2d57677190 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:41.189222 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8568d4-53ad-4d39-8fd6-cf2d57677190 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:41.189997 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8568d4-53ad-4d39-8fd6-cf2d57677190 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:41.190302 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8568d4-53ad-4d39-8fd6-cf2d57677190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:41.192133 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8568d4-53ad-4d39-8fd6-cf2d57677190 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:41.201375 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 149/302] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:41 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:41.208308 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5775a-7dcd-438b-974c-68692316442b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:41.219314 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5775a-7dcd-438b-974c-68692316442b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:41.224475 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed6149-94a7-4372-b720-b6b0d00860a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:41.225431 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed6149-94a7-4372-b720-b6b0d00860a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:41.225713 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed6149-94a7-4372-b720-b6b0d00860a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:41.226073 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed6149-94a7-4372-b720-b6b0d00860a4 admin admin] PATH_INFO: `/v3/groups/e8b118db9c9f4778986061b5d747c527` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:41.227250 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed6149-94a7-4372-b720-b6b0d00860a4 admin admin] RBAC: Authorizing `identity:get_group(group_id=e8b118db9c9f4778986061b5d747c527)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:41.229292 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed6149-94a7-4372-b720-b6b0d00860a4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:41.231220 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 154/303] 10.222.0.32 () {56 vars in 1202 bytes} [Wed Sep 15 02:17:41 2021] GET /identity/v3/groups/e8b118db9c9f4778986061b5d747c527 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:41.237934 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8568d4-53ad-4d39-8fd6-cf2d57677190 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:41.248255 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8568d4-53ad-4d39-8fd6-cf2d57677190 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:41.253084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb3846-bf85-4261-be3d-555c1104a5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:41.253976 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb3846-bf85-4261-be3d-555c1104a5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:41.254253 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb3846-bf85-4261-be3d-555c1104a5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:41.254529 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb3846-bf85-4261-be3d-555c1104a5b1 admin admin] PATH_INFO: `/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:41.255751 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb3846-bf85-4261-be3d-555c1104a5b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=e95b7aee5cbe45d1ac7e1805bf0d46dd)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:41.257958 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb3846-bf85-4261-be3d-555c1104a5b1 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:41.259888 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 150/304] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:41 2021] GET /identity/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:41.269723 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed6149-94a7-4372-b720-b6b0d00860a4 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:41.279920 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed6149-94a7-4372-b720-b6b0d00860a4 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:41.284820 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7977db2-6ebb-4060-a870-153e93255391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:41.285782 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7977db2-6ebb-4060-a870-153e93255391 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:41.286061 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7977db2-6ebb-4060-a870-153e93255391 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:41.286330 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7977db2-6ebb-4060-a870-153e93255391 admin admin] PATH_INFO: `/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd/groups/e8b118db9c9f4778986061b5d747c527/roles/4449685a6c854c46a265236ba82cd668` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:41.288634 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7977db2-6ebb-4060-a870-153e93255391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95b7aee5cbe45d1ac7e1805bf0d46dd, group_id=e8b118db9c9f4778986061b5d747c527, role_id=4449685a6c854c46a265236ba82cd668)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:41.291455 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7977db2-6ebb-4060-a870-153e93255391 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:41.309262 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 155/305] 10.222.0.32 () {58 vars in 1464 bytes} [Wed Sep 15 02:17:41 2021] PUT /identity/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd/groups/e8b118db9c9f4778986061b5d747c527/roles/4449685a6c854c46a265236ba82cd668 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:17:41.932025 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07f164-5fbf-4944-ad68-9d65e8bf0a34 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:41.932402 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07f164-5fbf-4944-ad68-9d65e8bf0a34 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:41.932572 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07f164-5fbf-4944-ad68-9d65e8bf0a34 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:41.934614 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 151/306] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:41.942122 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75095f8a-82ed-40a6-b45f-9d38657b1768 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:41.942723 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75095f8a-82ed-40a6-b45f-9d38657b1768 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:41.943204 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75095f8a-82ed-40a6-b45f-9d38657b1768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:41.969861 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-75095f8a-82ed-40a6-b45f-9d38657b1768 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:41.971371 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-75095f8a-82ed-40a6-b45f-9d38657b1768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:42.042484 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 156/307] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:42.087197 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07f164-5fbf-4944-ad68-9d65e8bf0a34 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:42.106574 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07f164-5fbf-4944-ad68-9d65e8bf0a34 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:42.114930 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba4cdb-45c8-4c47-83b2-605aa789d9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:42.115721 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba4cdb-45c8-4c47-83b2-605aa789d9aa admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:42.116002 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba4cdb-45c8-4c47-83b2-605aa789d9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:42.116273 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba4cdb-45c8-4c47-83b2-605aa789d9aa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:42.126722 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba4cdb-45c8-4c47-83b2-605aa789d9aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:42.133674 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-55ba4cdb-45c8-4c47-83b2-605aa789d9aa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:17:42.135155 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 152/308] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:17:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:42.141505 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75095f8a-82ed-40a6-b45f-9d38657b1768 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:42.153491 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75095f8a-82ed-40a6-b45f-9d38657b1768 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:42.164753 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa964d-5516-4f48-a144-625f94b6118d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:42.166140 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa964d-5516-4f48-a144-625f94b6118d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:42.166635 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa964d-5516-4f48-a144-625f94b6118d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:42.167127 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa964d-5516-4f48-a144-625f94b6118d admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:42.168086 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa964d-5516-4f48-a144-625f94b6118d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:42.168586 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa964d-5516-4f48-a144-625f94b6118d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:42.170392 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa964d-5516-4f48-a144-625f94b6118d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:42.184903 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 157/309] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:42.191681 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba4cdb-45c8-4c47-83b2-605aa789d9aa admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:42.206964 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba4cdb-45c8-4c47-83b2-605aa789d9aa admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:42.217452 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c178f-7051-47bf-9d54-7a977dc7061a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:42.218343 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c178f-7051-47bf-9d54-7a977dc7061a admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:42.218622 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c178f-7051-47bf-9d54-7a977dc7061a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:42.218895 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c178f-7051-47bf-9d54-7a977dc7061a admin admin] PATH_INFO: `/v3/groups/dc6e07bfa57e441c95d8a3c455161955` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:42.225860 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c178f-7051-47bf-9d54-7a977dc7061a admin admin] RBAC: Authorizing `identity:get_group(group_id=dc6e07bfa57e441c95d8a3c455161955)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:42.227794 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c178f-7051-47bf-9d54-7a977dc7061a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:42.229550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 153/310] 10.222.0.32 () {56 vars in 1202 bytes} [Wed Sep 15 02:17:42 2021] GET /identity/v3/groups/dc6e07bfa57e441c95d8a3c455161955 => generated 229 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:42.236091 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa964d-5516-4f48-a144-625f94b6118d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:42.249988 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa964d-5516-4f48-a144-625f94b6118d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:42.260780 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc5388-4b88-4ff8-851f-52ea4e3ecca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:42.261688 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc5388-4b88-4ff8-851f-52ea4e3ecca1 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:42.261968 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc5388-4b88-4ff8-851f-52ea4e3ecca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:42.262246 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc5388-4b88-4ff8-851f-52ea4e3ecca1 admin admin] PATH_INFO: `/v3/projects/2c09835f6deb405b989b793378de873e` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:42.270229 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc5388-4b88-4ff8-851f-52ea4e3ecca1 admin admin] RBAC: Authorizing `identity:get_project(project_id=2c09835f6deb405b989b793378de873e)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:42.272047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc5388-4b88-4ff8-851f-52ea4e3ecca1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:42.274118 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 158/311] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:42 2021] GET /identity/v3/projects/2c09835f6deb405b989b793378de873e => generated 344 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:42.280590 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c178f-7051-47bf-9d54-7a977dc7061a admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:42.293786 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c178f-7051-47bf-9d54-7a977dc7061a admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:42.305010 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c454f1d-9bfb-447d-9bca-9117b6c4fdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:42.306128 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c454f1d-9bfb-447d-9bca-9117b6c4fdb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:42.306589 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c454f1d-9bfb-447d-9bca-9117b6c4fdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:42.307036 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c454f1d-9bfb-447d-9bca-9117b6c4fdb7 admin admin] PATH_INFO: `/v3/projects/2c09835f6deb405b989b793378de873e/groups/dc6e07bfa57e441c95d8a3c455161955/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:42.314486 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5157f04-107f-440b-9eda-32294d940550 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:42.314778 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5157f04-107f-440b-9eda-32294d940550 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:42.315057 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5157f04-107f-440b-9eda-32294d940550 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:42.317411 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 159/312] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:42.317814 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c454f1d-9bfb-447d-9bca-9117b6c4fdb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c09835f6deb405b989b793378de873e, group_id=dc6e07bfa57e441c95d8a3c455161955, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:42.320554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c454f1d-9bfb-447d-9bca-9117b6c4fdb7 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:42.325458 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289f9ac-b6c1-4644-9964-f5d9884f9754 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:42.325749 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289f9ac-b6c1-4644-9964-f5d9884f9754 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:42.326030 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289f9ac-b6c1-4644-9964-f5d9884f9754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:42.353970 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 154/313] 10.222.0.32 () {58 vars in 1464 bytes} [Wed Sep 15 02:17:42 2021] PUT /identity/v3/projects/2c09835f6deb405b989b793378de873e/groups/dc6e07bfa57e441c95d8a3c455161955/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:17:42.477297 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-3289f9ac-b6c1-4644-9964-f5d9884f9754 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:42.478621 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-3289f9ac-b6c1-4644-9964-f5d9884f9754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:42.560734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 160/314] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:42.587599 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c454f1d-9bfb-447d-9bca-9117b6c4fdb7 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:42.598443 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c454f1d-9bfb-447d-9bca-9117b6c4fdb7 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:42.609695 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000bdaf-84f8-484e-939d-81e03c537e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:42.610524 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000bdaf-84f8-484e-939d-81e03c537e31 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:42.610802 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000bdaf-84f8-484e-939d-81e03c537e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:42.611071 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000bdaf-84f8-484e-939d-81e03c537e31 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:42.626614 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000bdaf-84f8-484e-939d-81e03c537e31 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:42.633721 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-0000bdaf-84f8-484e-939d-81e03c537e31 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 02:17:42.634979 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 155/315] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:42 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:42.641634 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289f9ac-b6c1-4644-9964-f5d9884f9754 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:42.653823 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289f9ac-b6c1-4644-9964-f5d9884f9754 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:42.660698 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab895066-d381-4ec3-856d-95c3363cf1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:42.661402 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab895066-d381-4ec3-856d-95c3363cf1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:42.661687 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab895066-d381-4ec3-856d-95c3363cf1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:42.662026 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab895066-d381-4ec3-856d-95c3363cf1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:42.662791 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab895066-d381-4ec3-856d-95c3363cf1b1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:42.663136 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab895066-d381-4ec3-856d-95c3363cf1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:42.664743 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab895066-d381-4ec3-856d-95c3363cf1b1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:42.676089 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 161/316] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Sep 15 02:17:42 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:42.682529 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000bdaf-84f8-484e-939d-81e03c537e31 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:42.692348 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000bdaf-84f8-484e-939d-81e03c537e31 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:42.698059 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651da0d1-f299-42a4-a94a-4296f364d254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:42.698702 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651da0d1-f299-42a4-a94a-4296f364d254 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:42.698982 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651da0d1-f299-42a4-a94a-4296f364d254 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:42.699255 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651da0d1-f299-42a4-a94a-4296f364d254 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:42.709901 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651da0d1-f299-42a4-a94a-4296f364d254 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:42.711669 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651da0d1-f299-42a4-a94a-4296f364d254 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:42.721790 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 156/317] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:42 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:42.729050 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab895066-d381-4ec3-856d-95c3363cf1b1 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:42.741146 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab895066-d381-4ec3-856d-95c3363cf1b1 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:42.747906 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fca85-ab83-49c0-9611-15fe04a41ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:42.748831 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fca85-ab83-49c0-9611-15fe04a41ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:42.749294 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fca85-ab83-49c0-9611-15fe04a41ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:42.749585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fca85-ab83-49c0-9611-15fe04a41ee3 admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:42.752584 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fca85-ab83-49c0-9611-15fe04a41ee3 admin admin] RBAC: Authorizing `identity:get_project(project_id=911c2d8152d7481fad6c6c9125f3d5a0)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:42.754739 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fca85-ab83-49c0-9611-15fe04a41ee3 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:42.756481 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 162/318] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:42 2021] GET /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:42.762854 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651da0d1-f299-42a4-a94a-4296f364d254 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:42.772842 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651da0d1-f299-42a4-a94a-4296f364d254 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:42.777611 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d47ec-82bf-4bbf-8e7c-73a685155a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:42.778484 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d47ec-82bf-4bbf-8e7c-73a685155a4c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:42.778760 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d47ec-82bf-4bbf-8e7c-73a685155a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:42.779078 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d47ec-82bf-4bbf-8e7c-73a685155a4c admin admin] PATH_INFO: `/v3/groups/e8b118db9c9f4778986061b5d747c527` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:42.780239 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d47ec-82bf-4bbf-8e7c-73a685155a4c admin admin] RBAC: Authorizing `identity:get_group(group_id=e8b118db9c9f4778986061b5d747c527)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:42.782291 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d47ec-82bf-4bbf-8e7c-73a685155a4c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:42.784222 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 157/319] 10.222.0.32 () {56 vars in 1202 bytes} [Wed Sep 15 02:17:42 2021] GET /identity/v3/groups/e8b118db9c9f4778986061b5d747c527 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:42.790974 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fca85-ab83-49c0-9611-15fe04a41ee3 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:42.802803 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fca85-ab83-49c0-9611-15fe04a41ee3 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:42.808292 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62788655-0d25-470e-ba6a-bd5b581ce9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:42.809034 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62788655-0d25-470e-ba6a-bd5b581ce9ec admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:42.809316 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62788655-0d25-470e-ba6a-bd5b581ce9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:42.809589 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62788655-0d25-470e-ba6a-bd5b581ce9ec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:42.810570 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62788655-0d25-470e-ba6a-bd5b581ce9ec admin admin] RBAC: Adding query filter params (group.id=e8b118db9c9f4778986061b5d747c527, role.id=6f4a40def5d74f0a95ae44fd686a92e5, scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:42.810889 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62788655-0d25-470e-ba6a-bd5b581ce9ec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:42.812811 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62788655-0d25-470e-ba6a-bd5b581ce9ec admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:42.820203 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 163/320] 10.222.0.32 () {56 vars in 1398 bytes} [Wed Sep 15 02:17:42 2021] GET /identity/v3/role_assignments?group.id=e8b118db9c9f4778986061b5d747c527&scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0&role.id=6f4a40def5d74f0a95ae44fd686a92e5 => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:43.074114 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364c81f-ea1a-414e-9fa5-377421cef882 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:43.074407 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364c81f-ea1a-414e-9fa5-377421cef882 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:43.074582 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364c81f-ea1a-414e-9fa5-377421cef882 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:43.076482 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 158/321] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:43.084807 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf082a0-b463-4a9e-84ff-607561f7a04d None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:43.085125 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf082a0-b463-4a9e-84ff-607561f7a04d None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:43.085402 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf082a0-b463-4a9e-84ff-607561f7a04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:43.103833 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-cbf082a0-b463-4a9e-84ff-607561f7a04d None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:43.105028 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-cbf082a0-b463-4a9e-84ff-607561f7a04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:43.114254 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 164/322] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:43.139952 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364c81f-ea1a-414e-9fa5-377421cef882 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:43.152871 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364c81f-ea1a-414e-9fa5-377421cef882 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:43.157484 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3d04b-3ea0-40dd-8a4e-1d8b9b834c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:43.158343 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3d04b-3ea0-40dd-8a4e-1d8b9b834c76 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:43.158731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3d04b-3ea0-40dd-8a4e-1d8b9b834c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:43.159058 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3d04b-3ea0-40dd-8a4e-1d8b9b834c76 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:43.173851 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3d04b-3ea0-40dd-8a4e-1d8b9b834c76 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:43.183592 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-d1a3d04b-3ea0-40dd-8a4e-1d8b9b834c76 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 02:17:43.185208 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 159/323] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:17:43 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:43.192161 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf082a0-b463-4a9e-84ff-607561f7a04d None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:43.203775 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf082a0-b463-4a9e-84ff-607561f7a04d None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:43.209371 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfd4a3-6b57-485e-a2fb-b23e5aa22807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:43.210038 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfd4a3-6b57-485e-a2fb-b23e5aa22807 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:43.210318 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfd4a3-6b57-485e-a2fb-b23e5aa22807 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:43.210591 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfd4a3-6b57-485e-a2fb-b23e5aa22807 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:43.211340 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dfd4a3-6b57-485e-a2fb-b23e5aa22807 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:43.211642 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dfd4a3-6b57-485e-a2fb-b23e5aa22807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:43.213378 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dfd4a3-6b57-485e-a2fb-b23e5aa22807 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:43.227646 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 165/324] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:43 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:43.233775 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3d04b-3ea0-40dd-8a4e-1d8b9b834c76 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:43.246288 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3d04b-3ea0-40dd-8a4e-1d8b9b834c76 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:43.250812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99864e48-8f02-4b0a-8b49-3dc50f077c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:43.251452 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99864e48-8f02-4b0a-8b49-3dc50f077c63 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:43.251736 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99864e48-8f02-4b0a-8b49-3dc50f077c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:43.252010 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99864e48-8f02-4b0a-8b49-3dc50f077c63 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:43.260701 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99864e48-8f02-4b0a-8b49-3dc50f077c63 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:43.262466 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99864e48-8f02-4b0a-8b49-3dc50f077c63 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:43.273526 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 160/325] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:43.279798 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfd4a3-6b57-485e-a2fb-b23e5aa22807 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:43.292230 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfd4a3-6b57-485e-a2fb-b23e5aa22807 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:43.301117 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb88dd-0106-44b6-912c-1d9dc634acc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:43.302036 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb88dd-0106-44b6-912c-1d9dc634acc0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:43.302366 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb88dd-0106-44b6-912c-1d9dc634acc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:43.302645 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb88dd-0106-44b6-912c-1d9dc634acc0 admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:43.303842 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb88dd-0106-44b6-912c-1d9dc634acc0 admin admin] RBAC: Authorizing `identity:get_project(project_id=911c2d8152d7481fad6c6c9125f3d5a0)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:43.306113 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb88dd-0106-44b6-912c-1d9dc634acc0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:43.313277 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 166/326] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:43 2021] GET /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:43.314238 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99864e48-8f02-4b0a-8b49-3dc50f077c63 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:43.323223 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99864e48-8f02-4b0a-8b49-3dc50f077c63 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:43.332129 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d0d690-e4ea-4b44-b8a7-d80be121149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:43.333294 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0d690-e4ea-4b44-b8a7-d80be121149b admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:43.333752 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0d690-e4ea-4b44-b8a7-d80be121149b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:43.334246 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d0d690-e4ea-4b44-b8a7-d80be121149b admin admin] PATH_INFO: `/v3/groups/e8b118db9c9f4778986061b5d747c527` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:43.335892 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0d690-e4ea-4b44-b8a7-d80be121149b admin admin] RBAC: Authorizing `identity:get_group(group_id=e8b118db9c9f4778986061b5d747c527)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:43.338169 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d0d690-e4ea-4b44-b8a7-d80be121149b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:43.340001 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 161/327] 10.222.0.32 () {56 vars in 1202 bytes} [Wed Sep 15 02:17:43 2021] GET /identity/v3/groups/e8b118db9c9f4778986061b5d747c527 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:43.346782 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb88dd-0106-44b6-912c-1d9dc634acc0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:43.359008 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb88dd-0106-44b6-912c-1d9dc634acc0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:43.366364 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00141205-c579-418f-a80d-76e8dfb30b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:43.367293 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00141205-c579-418f-a80d-76e8dfb30b5c admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:43.367748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00141205-c579-418f-a80d-76e8dfb30b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:43.368249 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00141205-c579-418f-a80d-76e8dfb30b5c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:43.369296 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00141205-c579-418f-a80d-76e8dfb30b5c admin admin] RBAC: Adding query filter params (group.id=e8b118db9c9f4778986061b5d747c527, role.id=4449685a6c854c46a265236ba82cd668, scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:43.369817 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00141205-c579-418f-a80d-76e8dfb30b5c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:43.371959 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00141205-c579-418f-a80d-76e8dfb30b5c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:43.378940 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 167/328] 10.222.0.32 () {56 vars in 1398 bytes} [Wed Sep 15 02:17:43 2021] GET /identity/v3/role_assignments?group.id=e8b118db9c9f4778986061b5d747c527&scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0&role.id=4449685a6c854c46a265236ba82cd668 => generated 611 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:43.962754 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3774890-a159-4333-aadc-832b3c1b7b0e None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:43.963131 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3774890-a159-4333-aadc-832b3c1b7b0e None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:43.963334 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3774890-a159-4333-aadc-832b3c1b7b0e None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:43.965233 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 162/329] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:43.972813 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e834b8f-bd92-4922-a816-90eff2e21565 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:43.973217 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e834b8f-bd92-4922-a816-90eff2e21565 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:43.973562 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e834b8f-bd92-4922-a816-90eff2e21565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:43.991596 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-3e834b8f-bd92-4922-a816-90eff2e21565 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:43.992773 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-3e834b8f-bd92-4922-a816-90eff2e21565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:44.000596 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 168/330] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:44.024384 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3774890-a159-4333-aadc-832b3c1b7b0e None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:44.037424 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3774890-a159-4333-aadc-832b3c1b7b0e None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:44.041889 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086009a8-ee0f-49f8-afce-e1b37e514b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:44.042879 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086009a8-ee0f-49f8-afce-e1b37e514b61 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:44.043330 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086009a8-ee0f-49f8-afce-e1b37e514b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:44.043767 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086009a8-ee0f-49f8-afce-e1b37e514b61 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:44.055089 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086009a8-ee0f-49f8-afce-e1b37e514b61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:44.062079 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-086009a8-ee0f-49f8-afce-e1b37e514b61 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 02:17:44.063409 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 163/331] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:44 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:44.069764 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e834b8f-bd92-4922-a816-90eff2e21565 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:44.078556 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e834b8f-bd92-4922-a816-90eff2e21565 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:44.082916 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014ccb5-a14d-485a-8cbd-fb4b4ac1e175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:44.083570 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014ccb5-a14d-485a-8cbd-fb4b4ac1e175 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:44.083849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014ccb5-a14d-485a-8cbd-fb4b4ac1e175 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:44.084119 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014ccb5-a14d-485a-8cbd-fb4b4ac1e175 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:44.084864 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014ccb5-a14d-485a-8cbd-fb4b4ac1e175 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:44.085194 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014ccb5-a14d-485a-8cbd-fb4b4ac1e175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:44.086777 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014ccb5-a14d-485a-8cbd-fb4b4ac1e175 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:44.095313 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 169/332] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Sep 15 02:17:44 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:44.102453 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086009a8-ee0f-49f8-afce-e1b37e514b61 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:44.114076 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086009a8-ee0f-49f8-afce-e1b37e514b61 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:44.119008 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc25037-5d66-4b4e-a120-c9c331e4da8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:44.120005 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc25037-5d66-4b4e-a120-c9c331e4da8b admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:44.120474 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc25037-5d66-4b4e-a120-c9c331e4da8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:44.120965 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc25037-5d66-4b4e-a120-c9c331e4da8b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:44.130691 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc25037-5d66-4b4e-a120-c9c331e4da8b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:44.132735 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc25037-5d66-4b4e-a120-c9c331e4da8b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:44.142286 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 164/333] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:44 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:44.149309 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014ccb5-a14d-485a-8cbd-fb4b4ac1e175 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:44.160158 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014ccb5-a14d-485a-8cbd-fb4b4ac1e175 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:44.164557 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f7197-0723-40bf-832e-0e356ec3c4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:44.165502 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f7197-0723-40bf-832e-0e356ec3c4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:44.165848 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f7197-0723-40bf-832e-0e356ec3c4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:44.166187 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f7197-0723-40bf-832e-0e356ec3c4e5 admin admin] PATH_INFO: `/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:44.167436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f7197-0723-40bf-832e-0e356ec3c4e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=e95b7aee5cbe45d1ac7e1805bf0d46dd)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:44.169699 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f7197-0723-40bf-832e-0e356ec3c4e5 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:44.171547 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 170/334] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:44 2021] GET /identity/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:44.177615 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc25037-5d66-4b4e-a120-c9c331e4da8b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:44.186836 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc25037-5d66-4b4e-a120-c9c331e4da8b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:44.191662 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c21e52-e1c1-4db7-b7da-dd1d56b8010e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:44.192741 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c21e52-e1c1-4db7-b7da-dd1d56b8010e admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:44.193221 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c21e52-e1c1-4db7-b7da-dd1d56b8010e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:44.193684 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c21e52-e1c1-4db7-b7da-dd1d56b8010e admin admin] PATH_INFO: `/v3/groups/e8b118db9c9f4778986061b5d747c527` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:44.194743 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb185f42-d782-4c16-a90c-81871b26606e None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:44.195186 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c21e52-e1c1-4db7-b7da-dd1d56b8010e admin admin] RBAC: Authorizing `identity:get_group(group_id=e8b118db9c9f4778986061b5d747c527)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:44.195262 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb185f42-d782-4c16-a90c-81871b26606e None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:44.195262 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb185f42-d782-4c16-a90c-81871b26606e None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:44.196689 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c21e52-e1c1-4db7-b7da-dd1d56b8010e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:44.197141 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 171/335] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:44.198405 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 165/336] 10.222.0.32 () {56 vars in 1202 bytes} [Wed Sep 15 02:17:44 2021] GET /identity/v3/groups/e8b118db9c9f4778986061b5d747c527 => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:44.204221 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c21e52-e1c1-4db7-b7da-dd1d56b8010e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:44.204340 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04af48-9cd1-49c3-80be-bc2879e4b836 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:44.204575 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04af48-9cd1-49c3-80be-bc2879e4b836 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:44.204979 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04af48-9cd1-49c3-80be-bc2879e4b836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:44.214685 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c21e52-e1c1-4db7-b7da-dd1d56b8010e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:44.219058 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ce712-6d5a-4cdb-ab35-c28d8822189d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:44.219735 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ce712-6d5a-4cdb-ab35-c28d8822189d admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:44.219970 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ce712-6d5a-4cdb-ab35-c28d8822189d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:44.220244 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ce712-6d5a-4cdb-ab35-c28d8822189d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:44.221092 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ce712-6d5a-4cdb-ab35-c28d8822189d admin admin] RBAC: Adding query filter params (group.id=e8b118db9c9f4778986061b5d747c527, role.id=6f4a40def5d74f0a95ae44fd686a92e5, scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:44.221403 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ce712-6d5a-4cdb-ab35-c28d8822189d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:44.223293 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ce712-6d5a-4cdb-ab35-c28d8822189d admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:44.223407 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-fa04af48-9cd1-49c3-80be-bc2879e4b836 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:44.224544 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-fa04af48-9cd1-49c3-80be-bc2879e4b836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:44.232904 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 166/337] 10.222.0.32 () {56 vars in 1398 bytes} [Wed Sep 15 02:17:44 2021] GET /identity/v3/role_assignments?group.id=e8b118db9c9f4778986061b5d747c527&scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd&role.id=6f4a40def5d74f0a95ae44fd686a92e5 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:44.233066 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 172/338] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:44.257561 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ce712-6d5a-4cdb-ab35-c28d8822189d admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:44.267671 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ce712-6d5a-4cdb-ab35-c28d8822189d admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:44.272258 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76fbbf-534d-419e-8210-16f0644939aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:44.273112 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76fbbf-534d-419e-8210-16f0644939aa admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:44.273395 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76fbbf-534d-419e-8210-16f0644939aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:44.273670 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76fbbf-534d-419e-8210-16f0644939aa admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:44.285476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76fbbf-534d-419e-8210-16f0644939aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:44.292931 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-1f76fbbf-534d-419e-8210-16f0644939aa admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 02:17:44.294411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 167/339] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:17:44 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:17:44.301302 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04af48-9cd1-49c3-80be-bc2879e4b836 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:44.311056 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04af48-9cd1-49c3-80be-bc2879e4b836 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:44.315665 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171ec66-2249-456b-bd3f-f933e45c1735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:44.316993 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171ec66-2249-456b-bd3f-f933e45c1735 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:44.317343 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171ec66-2249-456b-bd3f-f933e45c1735 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:44.317685 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171ec66-2249-456b-bd3f-f933e45c1735 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:44.318524 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171ec66-2249-456b-bd3f-f933e45c1735 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:44.318900 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171ec66-2249-456b-bd3f-f933e45c1735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:44.320640 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171ec66-2249-456b-bd3f-f933e45c1735 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:44.329779 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 173/340] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:44 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:44.336341 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76fbbf-534d-419e-8210-16f0644939aa admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:44.346413 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76fbbf-534d-419e-8210-16f0644939aa admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:44.350901 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2272f-a168-4950-8e49-10749eb1aeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:44.351569 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2272f-a168-4950-8e49-10749eb1aeac admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:44.351853 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2272f-a168-4950-8e49-10749eb1aeac admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:44.352129 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2272f-a168-4950-8e49-10749eb1aeac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:44.361385 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2272f-a168-4950-8e49-10749eb1aeac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:44.364105 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2272f-a168-4950-8e49-10749eb1aeac admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:44.374160 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 168/341] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:44 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:44.381050 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171ec66-2249-456b-bd3f-f933e45c1735 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:44.391321 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171ec66-2249-456b-bd3f-f933e45c1735 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:44.395801 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fbd09-4538-4d75-9a35-3d1d7f5d0b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:44.396654 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fbd09-4538-4d75-9a35-3d1d7f5d0b56 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:44.396968 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fbd09-4538-4d75-9a35-3d1d7f5d0b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:44.397244 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fbd09-4538-4d75-9a35-3d1d7f5d0b56 admin admin] PATH_INFO: `/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:44.398431 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fbd09-4538-4d75-9a35-3d1d7f5d0b56 admin admin] RBAC: Authorizing `identity:get_project(project_id=e95b7aee5cbe45d1ac7e1805bf0d46dd)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:44.400495 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fbd09-4538-4d75-9a35-3d1d7f5d0b56 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:44.402396 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 174/342] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:44 2021] GET /identity/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:44.408437 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2272f-a168-4950-8e49-10749eb1aeac admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:44.417468 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2272f-a168-4950-8e49-10749eb1aeac admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:44.423577 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734e5b3-82cc-4ae0-966e-c0faafe77eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:44.424421 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734e5b3-82cc-4ae0-966e-c0faafe77eec admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:44.424707 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734e5b3-82cc-4ae0-966e-c0faafe77eec admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:44.425535 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734e5b3-82cc-4ae0-966e-c0faafe77eec admin admin] PATH_INFO: `/v3/groups/e8b118db9c9f4778986061b5d747c527` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:44.426719 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734e5b3-82cc-4ae0-966e-c0faafe77eec admin admin] RBAC: Authorizing `identity:get_group(group_id=e8b118db9c9f4778986061b5d747c527)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:44.428597 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734e5b3-82cc-4ae0-966e-c0faafe77eec admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:44.430370 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 169/343] 10.222.0.32 () {56 vars in 1202 bytes} [Wed Sep 15 02:17:44 2021] GET /identity/v3/groups/e8b118db9c9f4778986061b5d747c527 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:44.436475 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fbd09-4538-4d75-9a35-3d1d7f5d0b56 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:44.447443 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fbd09-4538-4d75-9a35-3d1d7f5d0b56 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:44.452294 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed8209-66f9-4415-923c-2d4be99de0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:44.452526 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed8209-66f9-4415-923c-2d4be99de0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:44.453496 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed8209-66f9-4415-923c-2d4be99de0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:44.453496 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed8209-66f9-4415-923c-2d4be99de0e7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:44.453912 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed8209-66f9-4415-923c-2d4be99de0e7 admin admin] RBAC: Adding query filter params (group.id=e8b118db9c9f4778986061b5d747c527, role.id=4449685a6c854c46a265236ba82cd668, scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:44.454221 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed8209-66f9-4415-923c-2d4be99de0e7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:44.456139 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed8209-66f9-4415-923c-2d4be99de0e7 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:44.462571 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 175/344] 10.222.0.32 () {56 vars in 1398 bytes} [Wed Sep 15 02:17:44 2021] GET /identity/v3/role_assignments?group.id=e8b118db9c9f4778986061b5d747c527&scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd&role.id=4449685a6c854c46a265236ba82cd668 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:44.930935 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58ed93-30a5-44ee-98c0-7e6191ee1320 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:44.931218 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58ed93-30a5-44ee-98c0-7e6191ee1320 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:44.931497 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58ed93-30a5-44ee-98c0-7e6191ee1320 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:44.933317 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 170/345] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:44.940289 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55346ed-de5d-4e4b-b33b-727482c412aa None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:44.940610 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55346ed-de5d-4e4b-b33b-727482c412aa None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:44.940898 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55346ed-de5d-4e4b-b33b-727482c412aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:44.958419 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-c55346ed-de5d-4e4b-b33b-727482c412aa None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:44.959589 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-c55346ed-de5d-4e4b-b33b-727482c412aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:44.966947 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 176/346] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:44.991071 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58ed93-30a5-44ee-98c0-7e6191ee1320 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:45.002714 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58ed93-30a5-44ee-98c0-7e6191ee1320 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:45.006904 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1ef13-e719-4f01-bb3c-db1895aca38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:45.007658 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1ef13-e719-4f01-bb3c-db1895aca38f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:45.007938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1ef13-e719-4f01-bb3c-db1895aca38f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:45.008211 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1ef13-e719-4f01-bb3c-db1895aca38f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:45.018043 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1ef13-e719-4f01-bb3c-db1895aca38f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:45.025302 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-cfb1ef13-e719-4f01-bb3c-db1895aca38f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:17:45.026408 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 171/347] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:17:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:45.032120 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55346ed-de5d-4e4b-b33b-727482c412aa None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:45.040699 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55346ed-de5d-4e4b-b33b-727482c412aa None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:45.045052 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b95310-2c2a-4da7-875f-29425ce93d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:45.045690 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b95310-2c2a-4da7-875f-29425ce93d90 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:45.045971 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b95310-2c2a-4da7-875f-29425ce93d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:45.046247 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b95310-2c2a-4da7-875f-29425ce93d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:45.046985 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b95310-2c2a-4da7-875f-29425ce93d90 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:45.047292 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b95310-2c2a-4da7-875f-29425ce93d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:45.048865 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b95310-2c2a-4da7-875f-29425ce93d90 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:45.057267 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 177/348] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:45.062813 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1ef13-e719-4f01-bb3c-db1895aca38f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:45.071989 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1ef13-e719-4f01-bb3c-db1895aca38f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:45.076163 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeddc7a-fc5a-4945-a088-e0d68186311c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:45.076776 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeddc7a-fc5a-4945-a088-e0d68186311c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:45.077082 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeddc7a-fc5a-4945-a088-e0d68186311c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:45.077358 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeddc7a-fc5a-4945-a088-e0d68186311c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:45.085768 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeddc7a-fc5a-4945-a088-e0d68186311c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:45.087494 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeddc7a-fc5a-4945-a088-e0d68186311c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:45.095932 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 172/349] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:45 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:45.102130 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b95310-2c2a-4da7-875f-29425ce93d90 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:45.111091 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b95310-2c2a-4da7-875f-29425ce93d90 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:45.115802 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9ac00-f06f-43fe-98d5-b28dc0a7bdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:45.116611 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9ac00-f06f-43fe-98d5-b28dc0a7bdc0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:45.116918 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9ac00-f06f-43fe-98d5-b28dc0a7bdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:45.117199 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9ac00-f06f-43fe-98d5-b28dc0a7bdc0 admin admin] PATH_INFO: `/v3/projects/2c09835f6deb405b989b793378de873e` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:45.118344 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9ac00-f06f-43fe-98d5-b28dc0a7bdc0 admin admin] RBAC: Authorizing `identity:get_project(project_id=2c09835f6deb405b989b793378de873e)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:45.120083 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9ac00-f06f-43fe-98d5-b28dc0a7bdc0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:45.121715 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 178/350] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:17:45 2021] GET /identity/v3/projects/2c09835f6deb405b989b793378de873e => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:45.127053 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeddc7a-fc5a-4945-a088-e0d68186311c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:45.135225 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeddc7a-fc5a-4945-a088-e0d68186311c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:45.139427 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fdc1f0-2616-457f-9d5e-97782678d237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:45.140210 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdc1f0-2616-457f-9d5e-97782678d237 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:45.140485 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdc1f0-2616-457f-9d5e-97782678d237 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:45.140752 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fdc1f0-2616-457f-9d5e-97782678d237 admin admin] PATH_INFO: `/v3/groups/dc6e07bfa57e441c95d8a3c455161955` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:45.141928 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fdc1f0-2616-457f-9d5e-97782678d237 admin admin] RBAC: Authorizing `identity:get_group(group_id=dc6e07bfa57e441c95d8a3c455161955)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:45.144245 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fdc1f0-2616-457f-9d5e-97782678d237 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:45.145797 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 173/351] 10.222.0.32 () {56 vars in 1202 bytes} [Wed Sep 15 02:17:45 2021] GET /identity/v3/groups/dc6e07bfa57e441c95d8a3c455161955 => generated 229 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:45.151850 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9ac00-f06f-43fe-98d5-b28dc0a7bdc0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:45.161556 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9ac00-f06f-43fe-98d5-b28dc0a7bdc0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:45.165786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b45801-8020-4613-b9a9-088def6a45ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:45.166390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b45801-8020-4613-b9a9-088def6a45ef admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:45.166669 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b45801-8020-4613-b9a9-088def6a45ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:45.166938 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b45801-8020-4613-b9a9-088def6a45ef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:45.167736 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b45801-8020-4613-b9a9-088def6a45ef admin admin] RBAC: Adding query filter params (group.id=dc6e07bfa57e441c95d8a3c455161955, role.id=19308d3515f546e9a04e44ae278cd111, scope.project.id=2c09835f6deb405b989b793378de873e) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:45.168042 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b45801-8020-4613-b9a9-088def6a45ef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:45.169857 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b45801-8020-4613-b9a9-088def6a45ef admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:45.175286 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 179/352] 10.222.0.32 () {56 vars in 1398 bytes} [Wed Sep 15 02:17:45 2021] GET /identity/v3/role_assignments?group.id=dc6e07bfa57e441c95d8a3c455161955&scope.project.id=2c09835f6deb405b989b793378de873e&role.id=19308d3515f546e9a04e44ae278cd111 => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:47.941743 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedfb5a-9dd8-4dc2-bb00-73707c53ad76 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:47.942468 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedfb5a-9dd8-4dc2-bb00-73707c53ad76 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:47.942468 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedfb5a-9dd8-4dc2-bb00-73707c53ad76 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:47.944063 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 174/353] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:47.951817 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f004e1-465f-4597-a7c1-723ee8264590 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:47.952397 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f004e1-465f-4597-a7c1-723ee8264590 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:47.952397 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f004e1-465f-4597-a7c1-723ee8264590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:47.970261 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-73f004e1-465f-4597-a7c1-723ee8264590 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:47.971458 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-73f004e1-465f-4597-a7c1-723ee8264590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:47.984175 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 180/354] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:48.012690 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedfb5a-9dd8-4dc2-bb00-73707c53ad76 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:48.036662 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedfb5a-9dd8-4dc2-bb00-73707c53ad76 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:48.043604 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3554442-54ae-4dd4-b7b3-6c5827f907fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:48.044470 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3554442-54ae-4dd4-b7b3-6c5827f907fa admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:48.044755 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3554442-54ae-4dd4-b7b3-6c5827f907fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:48.045058 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3554442-54ae-4dd4-b7b3-6c5827f907fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:48.065157 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3554442-54ae-4dd4-b7b3-6c5827f907fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:48.067587 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3554442-54ae-4dd4-b7b3-6c5827f907fa admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:48.085333 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-d3554442-54ae-4dd4-b7b3-6c5827f907fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:48.086894 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 175/355] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:48.093813 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f004e1-465f-4597-a7c1-723ee8264590 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:48.111346 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f004e1-465f-4597-a7c1-723ee8264590 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:48.121068 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b66f6-c342-4f06-91e2-a25659af7d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:48.121741 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b66f6-c342-4f06-91e2-a25659af7d7b admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:48.122024 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b66f6-c342-4f06-91e2-a25659af7d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:48.122301 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b66f6-c342-4f06-91e2-a25659af7d7b admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:48.123035 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b66f6-c342-4f06-91e2-a25659af7d7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:48.123339 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b66f6-c342-4f06-91e2-a25659af7d7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:48.124353 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING py.warnings [None req-416b66f6-c342-4f06-91e2-a25659af7d7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:17:48.124353 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: warnings.warn(msg) Sep 15 02:17:48.124353 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: Sep 15 02:17:48.125272 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b66f6-c342-4f06-91e2-a25659af7d7b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:48.142707 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20171d21-a319-48e4-8000-0f5a53a9c0ee None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:48.143011 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20171d21-a319-48e4-8000-0f5a53a9c0ee None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:48.143267 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20171d21-a319-48e4-8000-0f5a53a9c0ee None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:48.145391 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 176/356] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:17:48.152986 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 181/357] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:48.153930 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4ff75-8c53-4dd1-bd58-c2f319fe3d37 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:48.154269 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4ff75-8c53-4dd1-bd58-c2f319fe3d37 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:48.154589 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4ff75-8c53-4dd1-bd58-c2f319fe3d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:48.157704 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f885ab-7e6b-4a0e-82e5-734955fc0b6b None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:48.157986 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f885ab-7e6b-4a0e-82e5-734955fc0b6b None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:48.158257 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f885ab-7e6b-4a0e-82e5-734955fc0b6b None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:48.160566 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 182/358] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:48.161369 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f885ab-7e6b-4a0e-82e5-734955fc0b6b None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:48.177076 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f885ab-7e6b-4a0e-82e5-734955fc0b6b None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:48.179511 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-72e4ff75-8c53-4dd1-bd58-c2f319fe3d37 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:48.180791 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-72e4ff75-8c53-4dd1-bd58-c2f319fe3d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:48.181599 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a420a66-ad10-46ac-8a3b-657021450a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:48.182272 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a420a66-ad10-46ac-8a3b-657021450a2d admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:48.182556 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a420a66-ad10-46ac-8a3b-657021450a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:48.182834 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a420a66-ad10-46ac-8a3b-657021450a2d admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:48.183552 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a420a66-ad10-46ac-8a3b-657021450a2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:48.184573 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING py.warnings [None req-9a420a66-ad10-46ac-8a3b-657021450a2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:17:48.184573 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: warnings.warn(msg) Sep 15 02:17:48.184573 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: Sep 15 02:17:48.185811 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a420a66-ad10-46ac-8a3b-657021450a2d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:48.188973 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 177/359] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:48.190232 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd8211-13af-44aa-ba7f-0b6ae82d3612 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:48.190621 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd8211-13af-44aa-ba7f-0b6ae82d3612 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:48.191358 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd8211-13af-44aa-ba7f-0b6ae82d3612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:48.218095 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 183/360] 10.222.0.32 () {60 vars in 1154 bytes} [Wed Sep 15 02:17:48 2021] POST /identity/v3/users => generated 246 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:17:48.226281 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-fbbd8211-13af-44aa-ba7f-0b6ae82d3612 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:48.227514 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-fbbd8211-13af-44aa-ba7f-0b6ae82d3612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:48.246809 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 178/361] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:48.249479 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a420a66-ad10-46ac-8a3b-657021450a2d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:48.260172 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a420a66-ad10-46ac-8a3b-657021450a2d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:48.264837 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a2695-fc2d-4f05-9242-bd63428b5d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:48.265705 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a2695-fc2d-4f05-9242-bd63428b5d80 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:48.265985 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a2695-fc2d-4f05-9242-bd63428b5d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:48.266264 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a2695-fc2d-4f05-9242-bd63428b5d80 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:48.278185 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a2695-fc2d-4f05-9242-bd63428b5d80 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:48.280098 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a2695-fc2d-4f05-9242-bd63428b5d80 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:48.299145 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd8211-13af-44aa-ba7f-0b6ae82d3612 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:48.305843 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-f36a2695-fc2d-4f05-9242-bd63428b5d80 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:48.307113 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 184/362] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:48.315676 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd8211-13af-44aa-ba7f-0b6ae82d3612 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:48.321456 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a2695-fc2d-4f05-9242-bd63428b5d80 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:48.322352 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd9d39-c585-4371-9242-f18109747c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:48.323177 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd9d39-c585-4371-9242-f18109747c54 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:48.323457 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd9d39-c585-4371-9242-f18109747c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:48.323729 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd9d39-c585-4371-9242-f18109747c54 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:48.339891 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a2695-fc2d-4f05-9242-bd63428b5d80 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:48.348626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd9d39-c585-4371-9242-f18109747c54 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:48.349303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da6eda-1a1c-4eb9-af47-bbe1354e0d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:48.349982 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da6eda-1a1c-4eb9-af47-bbe1354e0d62 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:48.350259 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da6eda-1a1c-4eb9-af47-bbe1354e0d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:48.350529 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da6eda-1a1c-4eb9-af47-bbe1354e0d62 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:48.351269 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da6eda-1a1c-4eb9-af47-bbe1354e0d62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:48.351575 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da6eda-1a1c-4eb9-af47-bbe1354e0d62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:48.353248 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da6eda-1a1c-4eb9-af47-bbe1354e0d62 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:48.355353 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd9d39-c585-4371-9242-f18109747c54 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:48.381929 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 185/363] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:48.386789 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-54cd9d39-c585-4371-9242-f18109747c54 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:48.394251 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da6eda-1a1c-4eb9-af47-bbe1354e0d62 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:48.399375 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 179/364] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:17:48.400416 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd9d39-c585-4371-9242-f18109747c54 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:48.410590 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da6eda-1a1c-4eb9-af47-bbe1354e0d62 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:48.420145 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a465f54-853c-47d6-af8b-eefc2d8e25ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:48.420841 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a465f54-853c-47d6-af8b-eefc2d8e25ea admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:48.421140 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a465f54-853c-47d6-af8b-eefc2d8e25ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:48.421376 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd9d39-c585-4371-9242-f18109747c54 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:48.422359 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a465f54-853c-47d6-af8b-eefc2d8e25ea admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:48.423486 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a465f54-853c-47d6-af8b-eefc2d8e25ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:48.427908 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a465f54-853c-47d6-af8b-eefc2d8e25ea admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:48.431248 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979281c4-807e-4dd4-900d-25e600f131c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:48.432797 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979281c4-807e-4dd4-900d-25e600f131c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:48.433108 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979281c4-807e-4dd4-900d-25e600f131c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:48.433384 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979281c4-807e-4dd4-900d-25e600f131c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:48.435529 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979281c4-807e-4dd4-900d-25e600f131c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:48.435835 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979281c4-807e-4dd4-900d-25e600f131c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:48.438505 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979281c4-807e-4dd4-900d-25e600f131c9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:48.454398 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 180/365] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:48.462960 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979281c4-807e-4dd4-900d-25e600f131c9 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:48.469108 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 186/366] 10.222.0.32 () {60 vars in 1154 bytes} [Wed Sep 15 02:17:48 2021] POST /identity/v3/users => generated 248 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:17:48.479911 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979281c4-807e-4dd4-900d-25e600f131c9 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:48.490482 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c052ab-ac56-405c-bff4-5fe8cb36ef65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:48.491273 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c052ab-ac56-405c-bff4-5fe8cb36ef65 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:48.491562 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c052ab-ac56-405c-bff4-5fe8cb36ef65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:48.491839 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c052ab-ac56-405c-bff4-5fe8cb36ef65 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:48.492683 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c052ab-ac56-405c-bff4-5fe8cb36ef65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:48.494733 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c052ab-ac56-405c-bff4-5fe8cb36ef65 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:48.523572 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 181/367] 10.222.0.32 () {60 vars in 1154 bytes} [Wed Sep 15 02:17:48 2021] POST /identity/v3/users => generated 248 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:17:48.635042 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568492b-11de-44b1-892a-3a0c7f616b11 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:48.635378 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568492b-11de-44b1-892a-3a0c7f616b11 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:48.635647 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568492b-11de-44b1-892a-3a0c7f616b11 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:48.637598 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 187/368] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:48.646470 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a045c-6eef-4cf4-962f-811ff531714a None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:48.647110 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a045c-6eef-4cf4-962f-811ff531714a None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:48.647587 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a045c-6eef-4cf4-962f-811ff531714a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:48.669369 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-599a045c-6eef-4cf4-962f-811ff531714a None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:48.671103 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-599a045c-6eef-4cf4-962f-811ff531714a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:48.681608 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 182/369] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:48.713319 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568492b-11de-44b1-892a-3a0c7f616b11 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:48.728358 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568492b-11de-44b1-892a-3a0c7f616b11 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:48.733411 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac745343-cbea-43e5-b731-3a0f579e7f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:48.734209 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac745343-cbea-43e5-b731-3a0f579e7f03 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:48.734497 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac745343-cbea-43e5-b731-3a0f579e7f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:48.734775 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac745343-cbea-43e5-b731-3a0f579e7f03 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:48.749424 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac745343-cbea-43e5-b731-3a0f579e7f03 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:48.751591 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac745343-cbea-43e5-b731-3a0f579e7f03 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:48.769120 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-ac745343-cbea-43e5-b731-3a0f579e7f03 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:48.770659 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 188/370] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:48.777133 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a045c-6eef-4cf4-962f-811ff531714a None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:48.788827 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a045c-6eef-4cf4-962f-811ff531714a None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:48.794533 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd618d06-b9e0-45c4-bbfd-31fb3401022e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:48.795421 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd618d06-b9e0-45c4-bbfd-31fb3401022e admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:48.795881 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd618d06-b9e0-45c4-bbfd-31fb3401022e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:48.796349 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd618d06-b9e0-45c4-bbfd-31fb3401022e admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:48.797239 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd618d06-b9e0-45c4-bbfd-31fb3401022e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:48.797704 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd618d06-b9e0-45c4-bbfd-31fb3401022e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:48.799442 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd618d06-b9e0-45c4-bbfd-31fb3401022e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:48.813544 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 183/371] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:48.818970 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac745343-cbea-43e5-b731-3a0f579e7f03 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:48.829486 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac745343-cbea-43e5-b731-3a0f579e7f03 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:48.837004 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a300b6b-1513-4a6b-b690-fe9d94ddcaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:48.837737 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a300b6b-1513-4a6b-b690-fe9d94ddcaca admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:48.838029 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a300b6b-1513-4a6b-b690-fe9d94ddcaca admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:48.838308 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a300b6b-1513-4a6b-b690-fe9d94ddcaca admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:48.839032 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a300b6b-1513-4a6b-b690-fe9d94ddcaca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:48.841066 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a300b6b-1513-4a6b-b690-fe9d94ddcaca admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:48.873982 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 189/372] 10.222.0.32 () {60 vars in 1154 bytes} [Wed Sep 15 02:17:48 2021] POST /identity/v3/users => generated 249 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:17:49.486943 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a439f20-e016-4b23-9824-cd535ee1af0b None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:49.487912 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a439f20-e016-4b23-9824-cd535ee1af0b None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:49.488495 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a439f20-e016-4b23-9824-cd535ee1af0b None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:49.490743 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 184/373] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:49 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:49.498863 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4c49a-0243-4975-b94d-789d48b1f199 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:49.499734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4c49a-0243-4975-b94d-789d48b1f199 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:49.500207 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4c49a-0243-4975-b94d-789d48b1f199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:49.525323 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-72b4c49a-0243-4975-b94d-789d48b1f199 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:49.526875 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-72b4c49a-0243-4975-b94d-789d48b1f199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:49.535304 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 190/374] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:49.559022 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a439f20-e016-4b23-9824-cd535ee1af0b None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:49.571700 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a439f20-e016-4b23-9824-cd535ee1af0b None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:49.576301 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc837cb-7982-4872-883a-c02df40c852e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:49.577263 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc837cb-7982-4872-883a-c02df40c852e admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:49.577834 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc837cb-7982-4872-883a-c02df40c852e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:49.578310 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc837cb-7982-4872-883a-c02df40c852e admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:49.579249 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc837cb-7982-4872-883a-c02df40c852e admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:49.581613 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc837cb-7982-4872-883a-c02df40c852e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:49.600741 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.sql.core [None req-7cc837cb-7982-4872-883a-c02df40c852e admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 02:17:49.600741 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 15 02:17:49.600741 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [parameters: {'id': 'c3e6fe4418db451a9209b80b71e82cfc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 15 02:17:49.600741 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73403) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 02:17:49.616069 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-7cc837cb-7982-4872-883a-c02df40c852e admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 15 02:17:49.617760 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 185/375] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:17:49 2021] POST /identity/v3/roles => generated 144 bytes in 59 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:49.624484 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4c49a-0243-4975-b94d-789d48b1f199 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:49.634436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4c49a-0243-4975-b94d-789d48b1f199 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:49.639218 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a6b1a-2d29-49b0-9ea9-22acfafa2b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:49.640252 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a6b1a-2d29-49b0-9ea9-22acfafa2b46 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:49.640751 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a6b1a-2d29-49b0-9ea9-22acfafa2b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:49.641240 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a6b1a-2d29-49b0-9ea9-22acfafa2b46 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:49.652126 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a6b1a-2d29-49b0-9ea9-22acfafa2b46 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:49.659741 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-736a6b1a-2d29-49b0-9ea9-22acfafa2b46 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 02:17:49.664976 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 191/376] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:17:49 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:49.668099 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc837cb-7982-4872-883a-c02df40c852e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:49.679834 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc837cb-7982-4872-883a-c02df40c852e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:49.684610 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1aba4-a16f-44d3-95f1-c574e5ef2094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:49.685532 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1aba4-a16f-44d3-95f1-c574e5ef2094 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:49.686013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1aba4-a16f-44d3-95f1-c574e5ef2094 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:49.686503 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1aba4-a16f-44d3-95f1-c574e5ef2094 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:49.687646 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1aba4-a16f-44d3-95f1-c574e5ef2094 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:49.688146 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1aba4-a16f-44d3-95f1-c574e5ef2094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:49.690075 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e1aba4-a16f-44d3-95f1-c574e5ef2094 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:49.705076 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 186/377] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:49 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:50.965072 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27bf76-7fdb-4c2b-b89f-191e999ac4f4 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:50.966089 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27bf76-7fdb-4c2b-b89f-191e999ac4f4 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:50.966569 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27bf76-7fdb-4c2b-b89f-191e999ac4f4 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:50.968831 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 192/378] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:50.976401 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048fc57-bb58-42e9-92e6-f770ff3ea8a9 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:50.977286 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048fc57-bb58-42e9-92e6-f770ff3ea8a9 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:50.977763 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048fc57-bb58-42e9-92e6-f770ff3ea8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.000979 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-8048fc57-bb58-42e9-92e6-f770ff3ea8a9 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:51.002577 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8048fc57-bb58-42e9-92e6-f770ff3ea8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:51.017562 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 187/379] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:51.054177 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27bf76-7fdb-4c2b-b89f-191e999ac4f4 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.070885 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27bf76-7fdb-4c2b-b89f-191e999ac4f4 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.075568 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27192fdb-232d-4d82-a52c-8c9f838fa2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.076577 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27192fdb-232d-4d82-a52c-8c9f838fa2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.077112 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27192fdb-232d-4d82-a52c-8c9f838fa2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.077585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27192fdb-232d-4d82-a52c-8c9f838fa2e9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.093495 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27192fdb-232d-4d82-a52c-8c9f838fa2e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:51.099257 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062be097-4c35-470c-8b8c-4f60b79556d2 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.099553 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062be097-4c35-470c-8b8c-4f60b79556d2 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.099828 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062be097-4c35-470c-8b8c-4f60b79556d2 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.104015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 188/380] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:51.104893 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-27192fdb-232d-4d82-a52c-8c9f838fa2e9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 02:17:51.106304 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 193/381] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:51.108970 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc650bf4-f524-4f8a-a46b-5186922facd8 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.109258 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc650bf4-f524-4f8a-a46b-5186922facd8 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.109541 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc650bf4-f524-4f8a-a46b-5186922facd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.112863 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27192fdb-232d-4d82-a52c-8c9f838fa2e9 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.125693 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27192fdb-232d-4d82-a52c-8c9f838fa2e9 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.136010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b6ef5-8024-4497-a30e-3df9280cdcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.136958 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b6ef5-8024-4497-a30e-3df9280cdcfd admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.137462 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b6ef5-8024-4497-a30e-3df9280cdcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.138121 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b6ef5-8024-4497-a30e-3df9280cdcfd admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.141908 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b6ef5-8024-4497-a30e-3df9280cdcfd admin admin] RBAC: Adding query filter params (name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:51.142418 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b6ef5-8024-4497-a30e-3df9280cdcfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.144783 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b6ef5-8024-4497-a30e-3df9280cdcfd admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.145938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-fc650bf4-f524-4f8a-a46b-5186922facd8 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:51.147141 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-fc650bf4-f524-4f8a-a46b-5186922facd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:51.154705 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 194/382] 10.222.0.32 () {56 vars in 1125 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:51.161182 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b6ef5-8024-4497-a30e-3df9280cdcfd admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.163956 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 189/383] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:51.171529 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b6ef5-8024-4497-a30e-3df9280cdcfd admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.177198 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1623d-1fce-44fb-a133-d4b690299562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.178064 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1623d-1fce-44fb-a133-d4b690299562 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.178417 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1623d-1fce-44fb-a133-d4b690299562 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.178792 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1623d-1fce-44fb-a133-d4b690299562 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.198498 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1623d-1fce-44fb-a133-d4b690299562 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.199818 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc650bf4-f524-4f8a-a46b-5186922facd8 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.200532 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1623d-1fce-44fb-a133-d4b690299562 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.219297 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-aca1623d-1fce-44fb-a133-d4b690299562 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:51.219451 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc650bf4-f524-4f8a-a46b-5186922facd8 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.220628 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 195/384] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:51.226485 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1623d-1fce-44fb-a133-d4b690299562 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.228706 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033d54e-e79d-4afd-845e-64a9b495f170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.229549 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033d54e-e79d-4afd-845e-64a9b495f170 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.229832 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033d54e-e79d-4afd-845e-64a9b495f170 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.230111 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033d54e-e79d-4afd-845e-64a9b495f170 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.237241 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1623d-1fce-44fb-a133-d4b690299562 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.242817 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3b493-3706-4da6-b524-00dc654b66e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.243659 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3b493-3706-4da6-b524-00dc654b66e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.243948 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3b493-3706-4da6-b524-00dc654b66e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.244228 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3b493-3706-4da6-b524-00dc654b66e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.244981 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3b493-3706-4da6-b524-00dc654b66e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:51.245347 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3b493-3706-4da6-b524-00dc654b66e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.246995 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3b493-3706-4da6-b524-00dc654b66e1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.257879 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033d54e-e79d-4afd-845e-64a9b495f170 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:51.260649 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 196/385] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:51.264933 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-0033d54e-e79d-4afd-845e-64a9b495f170 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 02:17:51.266701 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3b493-3706-4da6-b524-00dc654b66e1 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.269613 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 190/386] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:51.284961 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033d54e-e79d-4afd-845e-64a9b495f170 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.286821 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3b493-3706-4da6-b524-00dc654b66e1 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.296510 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033d54e-e79d-4afd-845e-64a9b495f170 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.298267 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc5123-63e9-46c1-b1eb-e003c2080af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.299252 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc5123-63e9-46c1-b1eb-e003c2080af3 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.299696 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc5123-63e9-46c1-b1eb-e003c2080af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.300176 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc5123-63e9-46c1-b1eb-e003c2080af3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.301891 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fde6b-8d73-458f-bbb7-e55cb779c6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.302889 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fde6b-8d73-458f-bbb7-e55cb779c6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.303289 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fde6b-8d73-458f-bbb7-e55cb779c6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.303669 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fde6b-8d73-458f-bbb7-e55cb779c6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.304723 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fde6b-8d73-458f-bbb7-e55cb779c6f8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:51.305073 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fde6b-8d73-458f-bbb7-e55cb779c6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.306895 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fde6b-8d73-458f-bbb7-e55cb779c6f8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.310924 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc5123-63e9-46c1-b1eb-e003c2080af3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.317389 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 191/387] 10.222.0.32 () {56 vars in 1125 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:51.317808 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc5123-63e9-46c1-b1eb-e003c2080af3 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.323732 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fde6b-8d73-458f-bbb7-e55cb779c6f8 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.340903 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fde6b-8d73-458f-bbb7-e55cb779c6f8 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.341313 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-d2cc5123-63e9-46c1-b1eb-e003c2080af3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 02:17:51.341313 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 197/388] 10.222.0.32 () {56 vars in 1115 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/users/nova => generated 82 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:51.351409 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc5123-63e9-46c1-b1eb-e003c2080af3 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.354504 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65e5e5-9734-4421-b9dd-bb9aeba1b539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.355373 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65e5e5-9734-4421-b9dd-bb9aeba1b539 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.355656 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65e5e5-9734-4421-b9dd-bb9aeba1b539 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.355986 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65e5e5-9734-4421-b9dd-bb9aeba1b539 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.377778 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc5123-63e9-46c1-b1eb-e003c2080af3 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.381751 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65e5e5-9734-4421-b9dd-bb9aeba1b539 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.385883 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65e5e5-9734-4421-b9dd-bb9aeba1b539 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.390756 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146d67a-5ba4-42e1-b2b0-cdfeb85cfc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.394351 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146d67a-5ba4-42e1-b2b0-cdfeb85cfc39 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.394667 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146d67a-5ba4-42e1-b2b0-cdfeb85cfc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.394953 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146d67a-5ba4-42e1-b2b0-cdfeb85cfc39 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.395835 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146d67a-5ba4-42e1-b2b0-cdfeb85cfc39 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:51.396437 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146d67a-5ba4-42e1-b2b0-cdfeb85cfc39 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.399765 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING py.warnings [None req-8146d67a-5ba4-42e1-b2b0-cdfeb85cfc39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:17:51.399765 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: warnings.warn(msg) Sep 15 02:17:51.399765 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: Sep 15 02:17:51.400969 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146d67a-5ba4-42e1-b2b0-cdfeb85cfc39 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.421440 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-ba65e5e5-9734-4421-b9dd-bb9aeba1b539 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:51.428532 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 192/389] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:51.452862 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65e5e5-9734-4421-b9dd-bb9aeba1b539 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.463625 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65e5e5-9734-4421-b9dd-bb9aeba1b539 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.472996 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 198/390] 10.222.0.32 () {56 vars in 1155 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:51.473155 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb4530-15e8-4d6d-bc04-830db57f4bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.477894 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb4530-15e8-4d6d-bc04-830db57f4bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.478234 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb4530-15e8-4d6d-bc04-830db57f4bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.478513 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb4530-15e8-4d6d-bc04-830db57f4bd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.479263 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb4530-15e8-4d6d-bc04-830db57f4bd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:51.480143 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb4530-15e8-4d6d-bc04-830db57f4bd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.489002 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb4530-15e8-4d6d-bc04-830db57f4bd8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.492057 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146d67a-5ba4-42e1-b2b0-cdfeb85cfc39 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.500110 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 193/391] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:51.501696 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c93b5e-aa73-498e-b067-3094173b3c90 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.502312 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c93b5e-aa73-498e-b067-3094173b3c90 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.502811 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c93b5e-aa73-498e-b067-3094173b3c90 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.505269 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 194/392] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:51.510101 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146d67a-5ba4-42e1-b2b0-cdfeb85cfc39 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.511310 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c93b5e-aa73-498e-b067-3094173b3c90 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.520293 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23900b4f-10ba-4dd2-aea7-7b0ca3f750bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.521543 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23900b4f-10ba-4dd2-aea7-7b0ca3f750bd admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.522033 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23900b4f-10ba-4dd2-aea7-7b0ca3f750bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.522622 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23900b4f-10ba-4dd2-aea7-7b0ca3f750bd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.524079 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c93b5e-aa73-498e-b067-3094173b3c90 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.528869 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fe338-8245-4763-8e08-3e9dcd19f5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.529747 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fe338-8245-4763-8e08-3e9dcd19f5dd admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.530146 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fe338-8245-4763-8e08-3e9dcd19f5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.530493 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fe338-8245-4763-8e08-3e9dcd19f5dd admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.533964 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23900b4f-10ba-4dd2-aea7-7b0ca3f750bd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.536458 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23900b4f-10ba-4dd2-aea7-7b0ca3f750bd admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.539790 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fe338-8245-4763-8e08-3e9dcd19f5dd admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.541901 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fe338-8245-4763-8e08-3e9dcd19f5dd admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.553765 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 199/393] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:51.555057 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7b34a-ca39-44bc-9871-08d1e4db79e5 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.555348 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7b34a-ca39-44bc-9871-08d1e4db79e5 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.557133 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7b34a-ca39-44bc-9871-08d1e4db79e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.563003 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-e11fe338-8245-4763-8e08-3e9dcd19f5dd admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 02:17:51.569000 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 195/394] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/users/cinder => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:17:51.569000 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fe338-8245-4763-8e08-3e9dcd19f5dd admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.576686 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fe338-8245-4763-8e08-3e9dcd19f5dd admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.582316 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-35c7b34a-ca39-44bc-9871-08d1e4db79e5 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:51.582532 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5bb36-812c-41f5-966a-7698744d4082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.583624 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-35c7b34a-ca39-44bc-9871-08d1e4db79e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:51.583736 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5bb36-812c-41f5-966a-7698744d4082 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.584204 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5bb36-812c-41f5-966a-7698744d4082 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.584695 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5bb36-812c-41f5-966a-7698744d4082 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.592815 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 200/395] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:51.594455 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7b34a-ca39-44bc-9871-08d1e4db79e5 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.599000 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5bb36-812c-41f5-966a-7698744d4082 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.601930 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5bb36-812c-41f5-966a-7698744d4082 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.605533 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7b34a-ca39-44bc-9871-08d1e4db79e5 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.610007 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b61e8-c3c7-4b3d-bf18-15af54bc3565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.611158 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b61e8-c3c7-4b3d-bf18-15af54bc3565 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.611443 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b61e8-c3c7-4b3d-bf18-15af54bc3565 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.611973 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b61e8-c3c7-4b3d-bf18-15af54bc3565 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.613446 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b61e8-c3c7-4b3d-bf18-15af54bc3565 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:51.613763 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b61e8-c3c7-4b3d-bf18-15af54bc3565 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.616505 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b61e8-c3c7-4b3d-bf18-15af54bc3565 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.626062 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-a1f5bb36-812c-41f5-966a-7698744d4082 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:51.633411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 196/396] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:51.635561 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5bb36-812c-41f5-966a-7698744d4082 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.643214 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 201/397] 10.222.0.32 () {56 vars in 1159 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:51.644837 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b61e8-c3c7-4b3d-bf18-15af54bc3565 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.648955 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5bb36-812c-41f5-966a-7698744d4082 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.659841 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b61e8-c3c7-4b3d-bf18-15af54bc3565 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.660350 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8a539-f386-4cc2-ba6b-c18956d41e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.661679 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8a539-f386-4cc2-ba6b-c18956d41e47 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.662212 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8a539-f386-4cc2-ba6b-c18956d41e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.662713 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8a539-f386-4cc2-ba6b-c18956d41e47 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.664953 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809024c-7026-4910-bc42-80ea38916f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.665691 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809024c-7026-4910-bc42-80ea38916f52 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.666091 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809024c-7026-4910-bc42-80ea38916f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.666434 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809024c-7026-4910-bc42-80ea38916f52 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.667306 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809024c-7026-4910-bc42-80ea38916f52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:51.667695 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809024c-7026-4910-bc42-80ea38916f52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.669513 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809024c-7026-4910-bc42-80ea38916f52 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.678183 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8a539-f386-4cc2-ba6b-c18956d41e47 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:51.682599 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 202/398] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:51.688205 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809024c-7026-4910-bc42-80ea38916f52 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.688324 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-a1e8a539-f386-4cc2-ba6b-c18956d41e47 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 02:17:51.690187 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 197/399] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:51.691289 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8a539-f386-4cc2-ba6b-c18956d41e47 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.698920 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809024c-7026-4910-bc42-80ea38916f52 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.703385 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9252da5-fd3e-4f8b-b10c-8c8f65952f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.703764 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8a539-f386-4cc2-ba6b-c18956d41e47 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.704118 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9252da5-fd3e-4f8b-b10c-8c8f65952f2d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.704406 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9252da5-fd3e-4f8b-b10c-8c8f65952f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.704681 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9252da5-fd3e-4f8b-b10c-8c8f65952f2d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.710043 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03018d8-2796-4454-a544-35ca4dd23afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.711213 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03018d8-2796-4454-a544-35ca4dd23afc admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.712197 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03018d8-2796-4454-a544-35ca4dd23afc admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.712661 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03018d8-2796-4454-a544-35ca4dd23afc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.714184 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9252da5-fd3e-4f8b-b10c-8c8f65952f2d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.716203 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9252da5-fd3e-4f8b-b10c-8c8f65952f2d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.720948 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03018d8-2796-4454-a544-35ca4dd23afc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.723593 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03018d8-2796-4454-a544-35ca4dd23afc admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.725394 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 203/400] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:51.726243 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9252da5-fd3e-4f8b-b10c-8c8f65952f2d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.734990 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9252da5-fd3e-4f8b-b10c-8c8f65952f2d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.740082 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53661d-4a20-4fd5-b23a-80b7a6d2850e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.740715 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53661d-4a20-4fd5-b23a-80b7a6d2850e admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.741029 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53661d-4a20-4fd5-b23a-80b7a6d2850e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.741304 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53661d-4a20-4fd5-b23a-80b7a6d2850e admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.741635 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-c03018d8-2796-4454-a544-35ca4dd23afc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:17:51.742027 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53661d-4a20-4fd5-b23a-80b7a6d2850e admin admin] RBAC: Adding query filter params (name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:51.742332 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53661d-4a20-4fd5-b23a-80b7a6d2850e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.742944 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 198/401] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:51.747270 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53661d-4a20-4fd5-b23a-80b7a6d2850e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.747411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b4b00-cd61-4205-ac78-a9d2962f73ea None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.747411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b4b00-cd61-4205-ac78-a9d2962f73ea None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.747411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b4b00-cd61-4205-ac78-a9d2962f73ea None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.747411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 199/402] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:51.747411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b4b00-cd61-4205-ac78-a9d2962f73ea None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.759774 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 204/403] 10.222.0.32 () {56 vars in 1125 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:51.760720 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53661d-4a20-4fd5-b23a-80b7a6d2850e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.761685 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b4b00-cd61-4205-ac78-a9d2962f73ea None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.766117 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6e78b-b8cc-44a4-8188-e97cffaa467f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.766898 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6e78b-b8cc-44a4-8188-e97cffaa467f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.767229 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6e78b-b8cc-44a4-8188-e97cffaa467f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.767442 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6e78b-b8cc-44a4-8188-e97cffaa467f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.770417 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53661d-4a20-4fd5-b23a-80b7a6d2850e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.774739 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037e768-9e73-4e80-8206-a15c2e0cbacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.775368 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037e768-9e73-4e80-8206-a15c2e0cbacc admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.775651 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037e768-9e73-4e80-8206-a15c2e0cbacc admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.775926 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037e768-9e73-4e80-8206-a15c2e0cbacc admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.776697 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037e768-9e73-4e80-8206-a15c2e0cbacc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:51.777052 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037e768-9e73-4e80-8206-a15c2e0cbacc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.778078 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING py.warnings [None req-2037e768-9e73-4e80-8206-a15c2e0cbacc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:17:51.778078 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: warnings.warn(msg) Sep 15 02:17:51.778078 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: Sep 15 02:17:51.779173 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037e768-9e73-4e80-8206-a15c2e0cbacc admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.779488 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6e78b-b8cc-44a4-8188-e97cffaa467f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.781529 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6e78b-b8cc-44a4-8188-e97cffaa467f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.796085 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 205/404] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:51.797430 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8350e4-633f-4dee-a86a-2f8cb045b33e None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.797720 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8350e4-633f-4dee-a86a-2f8cb045b33e None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.797997 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8350e4-633f-4dee-a86a-2f8cb045b33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.799154 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-44a6e78b-b8cc-44a4-8188-e97cffaa467f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:51.801013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 200/405] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:51.801775 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6e78b-b8cc-44a4-8188-e97cffaa467f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.816157 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6e78b-b8cc-44a4-8188-e97cffaa467f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.820541 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0522dfa-d6b7-4c5d-b2ef-9ab19197ef51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.821313 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0522dfa-d6b7-4c5d-b2ef-9ab19197ef51 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.821599 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0522dfa-d6b7-4c5d-b2ef-9ab19197ef51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.821878 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0522dfa-d6b7-4c5d-b2ef-9ab19197ef51 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.822397 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-0e8350e4-633f-4dee-a86a-2f8cb045b33e None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:51.823574 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-0e8350e4-633f-4dee-a86a-2f8cb045b33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:51.831204 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 206/406] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:51.831899 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8350e4-633f-4dee-a86a-2f8cb045b33e None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.840595 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8350e4-633f-4dee-a86a-2f8cb045b33e None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.841804 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0522dfa-d6b7-4c5d-b2ef-9ab19197ef51 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.843980 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0522dfa-d6b7-4c5d-b2ef-9ab19197ef51 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.844950 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82375240-fd6f-4263-81ef-297b13834b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.845571 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82375240-fd6f-4263-81ef-297b13834b58 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.845853 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82375240-fd6f-4263-81ef-297b13834b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.846126 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82375240-fd6f-4263-81ef-297b13834b58 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.846866 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82375240-fd6f-4263-81ef-297b13834b58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:51.847169 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82375240-fd6f-4263-81ef-297b13834b58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.848744 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82375240-fd6f-4263-81ef-297b13834b58 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.859840 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 207/407] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:51.860676 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82375240-fd6f-4263-81ef-297b13834b58 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.866652 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-b0522dfa-d6b7-4c5d-b2ef-9ab19197ef51 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:51.868827 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 201/408] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:51.869826 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0522dfa-d6b7-4c5d-b2ef-9ab19197ef51 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.875136 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82375240-fd6f-4263-81ef-297b13834b58 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.879729 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e97a1-bfa7-46c3-85a2-8950194747da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.880362 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e97a1-bfa7-46c3-85a2-8950194747da admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.880645 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e97a1-bfa7-46c3-85a2-8950194747da admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.880951 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e97a1-bfa7-46c3-85a2-8950194747da admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.881254 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0522dfa-d6b7-4c5d-b2ef-9ab19197ef51 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.881770 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e97a1-bfa7-46c3-85a2-8950194747da admin admin] RBAC: Adding query filter params (role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=797b76e6f16d428198e7f7f05c9c0fd3) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:51.882082 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e97a1-bfa7-46c3-85a2-8950194747da admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.883912 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e97a1-bfa7-46c3-85a2-8950194747da admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.886489 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8723c97-5ca7-45d2-884a-6525be239d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.888039 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8723c97-5ca7-45d2-884a-6525be239d27 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.888491 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8723c97-5ca7-45d2-884a-6525be239d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.888936 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8723c97-5ca7-45d2-884a-6525be239d27 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.889580 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 208/409] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/role_assignments?user.id=797b76e6f16d428198e7f7f05c9c0fd3&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:51.890247 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e97a1-bfa7-46c3-85a2-8950194747da admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.909007 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e97a1-bfa7-46c3-85a2-8950194747da admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.913857 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97e45c-3f74-4a56-805f-16e84fe4184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.914421 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8723c97-5ca7-45d2-884a-6525be239d27 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:51.914676 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97e45c-3f74-4a56-805f-16e84fe4184a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.914958 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97e45c-3f74-4a56-805f-16e84fe4184a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.915234 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97e45c-3f74-4a56-805f-16e84fe4184a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.922954 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b97e45c-3f74-4a56-805f-16e84fe4184a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.923946 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-d8723c97-5ca7-45d2-884a-6525be239d27 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 02:17:51.925505 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b97e45c-3f74-4a56-805f-16e84fe4184a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.926174 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 202/410] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:51.927020 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8723c97-5ca7-45d2-884a-6525be239d27 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.938263 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8723c97-5ca7-45d2-884a-6525be239d27 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.943705 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb2bae-cf9d-4761-a410-253fc169c1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.944431 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb2bae-cf9d-4761-a410-253fc169c1be admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.944714 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb2bae-cf9d-4761-a410-253fc169c1be admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.945019 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb2bae-cf9d-4761-a410-253fc169c1be admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.945810 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb2bae-cf9d-4761-a410-253fc169c1be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:51.946075 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-2b97e45c-3f74-4a56-805f-16e84fe4184a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:17:51.946178 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb2bae-cf9d-4761-a410-253fc169c1be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.947587 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 209/411] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:51.947824 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb2bae-cf9d-4761-a410-253fc169c1be admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.948894 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97e45c-3f74-4a56-805f-16e84fe4184a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.959442 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97e45c-3f74-4a56-805f-16e84fe4184a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.967650 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 203/412] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:51.967650 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb2bae-cf9d-4761-a410-253fc169c1be admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:51.970464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ac4cb-2511-43c8-9fbc-1ec540d02965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.971813 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ac4cb-2511-43c8-9fbc-1ec540d02965 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.972239 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ac4cb-2511-43c8-9fbc-1ec540d02965 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.972654 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ac4cb-2511-43c8-9fbc-1ec540d02965 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.973583 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ac4cb-2511-43c8-9fbc-1ec540d02965 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:51.974086 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ac4cb-2511-43c8-9fbc-1ec540d02965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.974589 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb2bae-cf9d-4761-a410-253fc169c1be admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:51.976356 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ac4cb-2511-43c8-9fbc-1ec540d02965 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.980289 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc9b54-42cd-4263-8db0-471b361d7b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:51.981098 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc9b54-42cd-4263-8db0-471b361d7b91 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:51.981458 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc9b54-42cd-4263-8db0-471b361d7b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:51.981812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc9b54-42cd-4263-8db0-471b361d7b91 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:51.982696 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc9b54-42cd-4263-8db0-471b361d7b91 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:51.983083 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc9b54-42cd-4263-8db0-471b361d7b91 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:51.984820 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING py.warnings [None req-35bc9b54-42cd-4263-8db0-471b361d7b91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:17:51.984820 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: warnings.warn(msg) Sep 15 02:17:51.984820 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: Sep 15 02:17:51.986549 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc9b54-42cd-4263-8db0-471b361d7b91 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:51.989189 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 210/413] 10.222.0.32 () {56 vars in 1125 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:51.990384 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ac4cb-2511-43c8-9fbc-1ec540d02965 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.001023 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ac4cb-2511-43c8-9fbc-1ec540d02965 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.006710 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d64ee-920d-4f7e-84f7-dc6487fa281d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.007936 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d64ee-920d-4f7e-84f7-dc6487fa281d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.008230 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 204/414] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:52.008688 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d64ee-920d-4f7e-84f7-dc6487fa281d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.009149 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc9b54-42cd-4263-8db0-471b361d7b91 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.009502 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d64ee-920d-4f7e-84f7-dc6487fa281d admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.018382 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d64ee-920d-4f7e-84f7-dc6487fa281d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.020704 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d64ee-920d-4f7e-84f7-dc6487fa281d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.025231 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc9b54-42cd-4263-8db0-471b361d7b91 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.030407 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b92e3f-82ed-42d6-ad47-8c484d9e9d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.031296 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b92e3f-82ed-42d6-ad47-8c484d9e9d11 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.031661 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b92e3f-82ed-42d6-ad47-8c484d9e9d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.032017 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b92e3f-82ed-42d6-ad47-8c484d9e9d11 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.038805 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-a66d64ee-920d-4f7e-84f7-dc6487fa281d admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 02:17:52.040401 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 211/415] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:51 2021] GET /identity/v3/users/glance => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:52.045850 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b92e3f-82ed-42d6-ad47-8c484d9e9d11 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.046520 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b92e3f-82ed-42d6-ad47-8c484d9e9d11 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.047400 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d64ee-920d-4f7e-84f7-dc6487fa281d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.059069 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d64ee-920d-4f7e-84f7-dc6487fa281d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.064185 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc4b19-e687-4d80-a53a-32b6cc02e03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.065224 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc4b19-e687-4d80-a53a-32b6cc02e03e admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.066283 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc4b19-e687-4d80-a53a-32b6cc02e03e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.066556 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-d6b92e3f-82ed-42d6-ad47-8c484d9e9d11 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:52.066978 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc4b19-e687-4d80-a53a-32b6cc02e03e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.067807 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 205/416] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:52.068354 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc4b19-e687-4d80-a53a-32b6cc02e03e admin admin] RBAC: Adding query filter params (role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=e0c01428860e44fe9d0b15886add165f) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:52.068593 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b92e3f-82ed-42d6-ad47-8c484d9e9d11 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.069208 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc4b19-e687-4d80-a53a-32b6cc02e03e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.071270 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc4b19-e687-4d80-a53a-32b6cc02e03e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.078552 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 212/417] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:52 2021] GET /identity/v3/role_assignments?user.id=e0c01428860e44fe9d0b15886add165f&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:52.079846 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc4b19-e687-4d80-a53a-32b6cc02e03e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.080022 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b92e3f-82ed-42d6-ad47-8c484d9e9d11 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.085532 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2e570-e9b8-47d5-9942-3ae4848d308f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.086225 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2e570-e9b8-47d5-9942-3ae4848d308f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.086556 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2e570-e9b8-47d5-9942-3ae4848d308f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.086840 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2e570-e9b8-47d5-9942-3ae4848d308f admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.088030 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2e570-e9b8-47d5-9942-3ae4848d308f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:52.089042 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2e570-e9b8-47d5-9942-3ae4848d308f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.090498 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING py.warnings [None req-b9b2e570-e9b8-47d5-9942-3ae4848d308f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:17:52.090498 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: warnings.warn(msg) Sep 15 02:17:52.090498 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: Sep 15 02:17:52.091722 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2e570-e9b8-47d5-9942-3ae4848d308f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.092933 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc4b19-e687-4d80-a53a-32b6cc02e03e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.097895 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9aa73a-4ee5-4fb3-aeda-1345a55d6252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.098908 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9aa73a-4ee5-4fb3-aeda-1345a55d6252 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.099388 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9aa73a-4ee5-4fb3-aeda-1345a55d6252 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.099880 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9aa73a-4ee5-4fb3-aeda-1345a55d6252 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.100806 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9aa73a-4ee5-4fb3-aeda-1345a55d6252 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:52.101340 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9aa73a-4ee5-4fb3-aeda-1345a55d6252 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.103352 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9aa73a-4ee5-4fb3-aeda-1345a55d6252 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.116583 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 213/418] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:52.123226 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9aa73a-4ee5-4fb3-aeda-1345a55d6252 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.136215 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9aa73a-4ee5-4fb3-aeda-1345a55d6252 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.136409 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 206/419] 10.222.0.32 () {56 vars in 1159 bytes} [Wed Sep 15 02:17:52 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:52.142000 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b894b5d-32ab-4b9d-8835-f3cefe2dd546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.142900 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2e570-e9b8-47d5-9942-3ae4848d308f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.143428 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b894b5d-32ab-4b9d-8835-f3cefe2dd546 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.144613 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b894b5d-32ab-4b9d-8835-f3cefe2dd546 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.145151 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b894b5d-32ab-4b9d-8835-f3cefe2dd546 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.154541 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b894b5d-32ab-4b9d-8835-f3cefe2dd546 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.154851 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2e570-e9b8-47d5-9942-3ae4848d308f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.157313 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b894b5d-32ab-4b9d-8835-f3cefe2dd546 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.161602 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b254df8-66e1-499f-9d96-9d338347b80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.162541 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b254df8-66e1-499f-9d96-9d338347b80f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.162932 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b254df8-66e1-499f-9d96-9d338347b80f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.163315 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b254df8-66e1-499f-9d96-9d338347b80f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.172853 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b254df8-66e1-499f-9d96-9d338347b80f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.174459 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-9b894b5d-32ab-4b9d-8835-f3cefe2dd546 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 02:17:52.175018 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b254df8-66e1-499f-9d96-9d338347b80f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.177462 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 214/420] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:17:52 2021] GET /identity/v3/users/neutron => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:52.182313 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b894b5d-32ab-4b9d-8835-f3cefe2dd546 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.186068 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 207/421] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:52 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:52.192921 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b254df8-66e1-499f-9d96-9d338347b80f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.197475 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b894b5d-32ab-4b9d-8835-f3cefe2dd546 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.203397 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b254df8-66e1-499f-9d96-9d338347b80f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.204044 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7132bc-bf9b-4a0e-b7aa-16509855fbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.205023 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7132bc-bf9b-4a0e-b7aa-16509855fbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.205449 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7132bc-bf9b-4a0e-b7aa-16509855fbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.205927 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7132bc-bf9b-4a0e-b7aa-16509855fbc8 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.207279 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7132bc-bf9b-4a0e-b7aa-16509855fbc8 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:52.207598 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7132bc-bf9b-4a0e-b7aa-16509855fbc8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.209180 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d117f3-57a9-4e07-866e-04f89a058649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.209707 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7132bc-bf9b-4a0e-b7aa-16509855fbc8 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.210436 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d117f3-57a9-4e07-866e-04f89a058649 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.210938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d117f3-57a9-4e07-866e-04f89a058649 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.211434 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d117f3-57a9-4e07-866e-04f89a058649 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.226666 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d117f3-57a9-4e07-866e-04f89a058649 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.229387 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d117f3-57a9-4e07-866e-04f89a058649 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.232312 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 215/422] 10.222.0.32 () {56 vars in 1161 bytes} [Wed Sep 15 02:17:52 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:52.241943 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7132bc-bf9b-4a0e-b7aa-16509855fbc8 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.248306 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-82d117f3-57a9-4e07-866e-04f89a058649 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:52.249807 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 208/423] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:52.257536 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d117f3-57a9-4e07-866e-04f89a058649 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.258770 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7132bc-bf9b-4a0e-b7aa-16509855fbc8 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.268328 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d117f3-57a9-4e07-866e-04f89a058649 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.272226 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7449280-f36d-45e2-95e1-ff86cdb5ead1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.273029 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7449280-f36d-45e2-95e1-ff86cdb5ead1 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.273413 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7449280-f36d-45e2-95e1-ff86cdb5ead1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.273789 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7449280-f36d-45e2-95e1-ff86cdb5ead1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.274630 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734812f-3048-4931-aa9f-7605d7e6bcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.275545 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734812f-3048-4931-aa9f-7605d7e6bcfb admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.275959 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734812f-3048-4931-aa9f-7605d7e6bcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.276403 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734812f-3048-4931-aa9f-7605d7e6bcfb admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.277304 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734812f-3048-4931-aa9f-7605d7e6bcfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:52.277813 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734812f-3048-4931-aa9f-7605d7e6bcfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.279716 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734812f-3048-4931-aa9f-7605d7e6bcfb admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.294728 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 209/424] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:52.301165 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7449280-f36d-45e2-95e1-ff86cdb5ead1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.301358 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734812f-3048-4931-aa9f-7605d7e6bcfb admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.303245 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7449280-f36d-45e2-95e1-ff86cdb5ead1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.312253 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734812f-3048-4931-aa9f-7605d7e6bcfb admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.318708 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f409759-1564-43ae-b386-32beb369d627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.319917 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f409759-1564-43ae-b386-32beb369d627 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.320490 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f409759-1564-43ae-b386-32beb369d627 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.321020 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f409759-1564-43ae-b386-32beb369d627 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.323499 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 216/425] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:52 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:52.329219 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f409759-1564-43ae-b386-32beb369d627 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.329899 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7449280-f36d-45e2-95e1-ff86cdb5ead1 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.332262 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f409759-1564-43ae-b386-32beb369d627 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.347500 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-3f409759-1564-43ae-b386-32beb369d627 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:17:52.349226 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 210/426] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:52.352961 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7449280-f36d-45e2-95e1-ff86cdb5ead1 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.355797 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f409759-1564-43ae-b386-32beb369d627 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.364242 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f19df-50e4-400a-a55e-820bf1351c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.365284 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f19df-50e4-400a-a55e-820bf1351c5b admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.365753 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f19df-50e4-400a-a55e-820bf1351c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.366039 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f19df-50e4-400a-a55e-820bf1351c5b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.368387 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f409759-1564-43ae-b386-32beb369d627 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.374902 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e245320-1fe7-4467-a168-87347f884899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.375797 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e245320-1fe7-4467-a168-87347f884899 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.376281 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e245320-1fe7-4467-a168-87347f884899 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.376700 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e245320-1fe7-4467-a168-87347f884899 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.378692 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e245320-1fe7-4467-a168-87347f884899 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:52.379179 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e245320-1fe7-4467-a168-87347f884899 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.381944 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e245320-1fe7-4467-a168-87347f884899 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.382394 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f19df-50e4-400a-a55e-820bf1351c5b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.385460 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f19df-50e4-400a-a55e-820bf1351c5b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.395921 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 211/427] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:17:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:52.402546 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e245320-1fe7-4467-a168-87347f884899 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.406135 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-f85f19df-50e4-400a-a55e-820bf1351c5b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:52.407974 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 217/428] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:52.413273 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e245320-1fe7-4467-a168-87347f884899 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.413402 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f19df-50e4-400a-a55e-820bf1351c5b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.418183 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ac581-5b88-4016-9e9a-4b8cfe4d3d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.419060 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ac581-5b88-4016-9e9a-4b8cfe4d3d26 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.419583 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ac581-5b88-4016-9e9a-4b8cfe4d3d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.420061 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ac581-5b88-4016-9e9a-4b8cfe4d3d26 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.421127 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ac581-5b88-4016-9e9a-4b8cfe4d3d26 admin admin] RBAC: Adding query filter params (role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=a71d661d14d94fa597aee037599de7a8) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:52.421643 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ac581-5b88-4016-9e9a-4b8cfe4d3d26 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.423673 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ac581-5b88-4016-9e9a-4b8cfe4d3d26 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.424428 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f19df-50e4-400a-a55e-820bf1351c5b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.430379 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 212/429] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:52 2021] GET /identity/v3/role_assignments?user.id=a71d661d14d94fa597aee037599de7a8&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:52.430605 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e251d-dcfa-404b-a722-72f53fcdde19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.436983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e251d-dcfa-404b-a722-72f53fcdde19 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.436983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e251d-dcfa-404b-a722-72f53fcdde19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.436983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e251d-dcfa-404b-a722-72f53fcdde19 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.436983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e251d-dcfa-404b-a722-72f53fcdde19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:52.436983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e251d-dcfa-404b-a722-72f53fcdde19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.436983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e251d-dcfa-404b-a722-72f53fcdde19 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.448136 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 218/430] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:52.454114 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ac581-5b88-4016-9e9a-4b8cfe4d3d26 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.472217 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ac581-5b88-4016-9e9a-4b8cfe4d3d26 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.484753 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42d213-8000-4342-80f3-3beba57ffe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.485799 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42d213-8000-4342-80f3-3beba57ffe3f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.486252 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42d213-8000-4342-80f3-3beba57ffe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.486917 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42d213-8000-4342-80f3-3beba57ffe3f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.504654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42d213-8000-4342-80f3-3beba57ffe3f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.507129 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42d213-8000-4342-80f3-3beba57ffe3f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.528918 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-1c42d213-8000-4342-80f3-3beba57ffe3f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:17:52.530200 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 213/431] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:52.536824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e251d-dcfa-404b-a722-72f53fcdde19 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.551053 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e251d-dcfa-404b-a722-72f53fcdde19 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.563825 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb7d3c-7e60-4785-9651-65ddd2876441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.564524 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb7d3c-7e60-4785-9651-65ddd2876441 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.564809 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb7d3c-7e60-4785-9651-65ddd2876441 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.565236 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb7d3c-7e60-4785-9651-65ddd2876441 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.566666 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb7d3c-7e60-4785-9651-65ddd2876441 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:52.566983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb7d3c-7e60-4785-9651-65ddd2876441 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.568989 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb7d3c-7e60-4785-9651-65ddd2876441 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.592119 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 219/432] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:17:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:52.598485 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42d213-8000-4342-80f3-3beba57ffe3f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.615068 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42d213-8000-4342-80f3-3beba57ffe3f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.629771 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f50fc-841b-4ec4-97d7-6c04ab326b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.630455 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f50fc-841b-4ec4-97d7-6c04ab326b2d admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.630736 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f50fc-841b-4ec4-97d7-6c04ab326b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.631008 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f50fc-841b-4ec4-97d7-6c04ab326b2d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.631855 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f50fc-841b-4ec4-97d7-6c04ab326b2d admin admin] RBAC: Adding query filter params (role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=91566418241b40ab840e1c3bf9e096c9) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:52.632194 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f50fc-841b-4ec4-97d7-6c04ab326b2d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.634063 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f50fc-841b-4ec4-97d7-6c04ab326b2d admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.640562 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 214/433] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:52 2021] GET /identity/v3/role_assignments?user.id=91566418241b40ab840e1c3bf9e096c9&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8 => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:52.687753 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2b40a-6ce6-4c4c-8957-cd6ab9c8c7fb None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.688085 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2b40a-6ce6-4c4c-8957-cd6ab9c8c7fb None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.688320 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2b40a-6ce6-4c4c-8957-cd6ab9c8c7fb None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.690196 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 220/434] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:52.698663 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ec614-aba2-4a16-adee-2b8ee3b7d3df None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.698951 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ec614-aba2-4a16-adee-2b8ee3b7d3df None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.699229 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ec614-aba2-4a16-adee-2b8ee3b7d3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.726454 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-995ec614-aba2-4a16-adee-2b8ee3b7d3df None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:52.727653 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-995ec614-aba2-4a16-adee-2b8ee3b7d3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:52.741099 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 215/435] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:52.770194 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2b40a-6ce6-4c4c-8957-cd6ab9c8c7fb None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.793730 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2b40a-6ce6-4c4c-8957-cd6ab9c8c7fb None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.798623 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3eb58-a2c9-4597-884f-0cd636177e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.799432 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3eb58-a2c9-4597-884f-0cd636177e32 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.799745 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3eb58-a2c9-4597-884f-0cd636177e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.800566 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3eb58-a2c9-4597-884f-0cd636177e32 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.813362 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3eb58-a2c9-4597-884f-0cd636177e32 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.815268 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3eb58-a2c9-4597-884f-0cd636177e32 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.847990 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-d3c3eb58-a2c9-4597-884f-0cd636177e32 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:52.849674 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 221/436] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:52.855702 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ec614-aba2-4a16-adee-2b8ee3b7d3df None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.870225 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ec614-aba2-4a16-adee-2b8ee3b7d3df None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.887078 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69030d-13fb-471f-b529-38b6bc96210f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.887762 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69030d-13fb-471f-b529-38b6bc96210f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.888043 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69030d-13fb-471f-b529-38b6bc96210f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.888319 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69030d-13fb-471f-b529-38b6bc96210f admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.889073 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69030d-13fb-471f-b529-38b6bc96210f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:52.889378 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69030d-13fb-471f-b529-38b6bc96210f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.890987 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69030d-13fb-471f-b529-38b6bc96210f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.909945 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 216/437] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:52.916141 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3eb58-a2c9-4597-884f-0cd636177e32 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:52.929462 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3eb58-a2c9-4597-884f-0cd636177e32 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:52.936447 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d399da6-773d-4a2e-9b0f-ab03c453f2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:52.937152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d399da6-773d-4a2e-9b0f-ab03c453f2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:52.937436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d399da6-773d-4a2e-9b0f-ab03c453f2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:52.937714 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d399da6-773d-4a2e-9b0f-ab03c453f2e7 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:52.938421 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d399da6-773d-4a2e-9b0f-ab03c453f2e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:52.940908 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d399da6-773d-4a2e-9b0f-ab03c453f2e7 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:52.965588 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 222/438] 10.222.0.32 () {60 vars in 1154 bytes} [Wed Sep 15 02:17:52 2021] POST /identity/v3/users => generated 247 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:17:54.526952 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bf58a-5355-4577-bb00-96eb00ec36f3 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:54.527608 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bf58a-5355-4577-bb00-96eb00ec36f3 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:54.527608 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bf58a-5355-4577-bb00-96eb00ec36f3 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:54.529573 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 217/439] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:54.536861 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c91ad7-f786-4850-8825-e9c146855f28 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:54.537422 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c91ad7-f786-4850-8825-e9c146855f28 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:54.537422 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c91ad7-f786-4850-8825-e9c146855f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:54.561897 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-c5c91ad7-f786-4850-8825-e9c146855f28 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:54.563099 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-c5c91ad7-f786-4850-8825-e9c146855f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:54.571581 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 223/440] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:54.603629 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bf58a-5355-4577-bb00-96eb00ec36f3 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:54.618809 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bf58a-5355-4577-bb00-96eb00ec36f3 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:54.628018 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ecbab-2c96-4c49-a00b-1ec5f96eb6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:54.628810 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ecbab-2c96-4c49-a00b-1ec5f96eb6fc admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:54.629120 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ecbab-2c96-4c49-a00b-1ec5f96eb6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:54.629394 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ecbab-2c96-4c49-a00b-1ec5f96eb6fc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:54.648650 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ecbab-2c96-4c49-a00b-1ec5f96eb6fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:54.655734 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-8a3ecbab-2c96-4c49-a00b-1ec5f96eb6fc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 02:17:54.657259 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 218/441] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:17:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:54.663949 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c91ad7-f786-4850-8825-e9c146855f28 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:54.678141 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c91ad7-f786-4850-8825-e9c146855f28 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:54.698928 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2422ecc-52f2-4488-802c-da0da3772adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:54.699608 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2422ecc-52f2-4488-802c-da0da3772adf admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:54.699888 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2422ecc-52f2-4488-802c-da0da3772adf admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:54.700165 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2422ecc-52f2-4488-802c-da0da3772adf admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:54.700940 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2422ecc-52f2-4488-802c-da0da3772adf admin admin] RBAC: Adding query filter params (name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:54.701251 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2422ecc-52f2-4488-802c-da0da3772adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:54.702881 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2422ecc-52f2-4488-802c-da0da3772adf admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:54.720365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 224/442] 10.222.0.32 () {56 vars in 1125 bytes} [Wed Sep 15 02:17:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:54.727186 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ecbab-2c96-4c49-a00b-1ec5f96eb6fc admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:54.858478 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ecbab-2c96-4c49-a00b-1ec5f96eb6fc admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:54.868665 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4ef89-ea3a-4e79-b64e-db22a0eaa80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:54.869530 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4ef89-ea3a-4e79-b64e-db22a0eaa80d admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:54.869797 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4ef89-ea3a-4e79-b64e-db22a0eaa80d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:54.870081 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4ef89-ea3a-4e79-b64e-db22a0eaa80d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:54.885276 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4ef89-ea3a-4e79-b64e-db22a0eaa80d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:54.887141 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4ef89-ea3a-4e79-b64e-db22a0eaa80d admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:54.907513 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf5caa-c5c4-47ef-be2a-58b6f887a199 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:54.907861 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf5caa-c5c4-47ef-be2a-58b6f887a199 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:54.908050 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf5caa-c5c4-47ef-be2a-58b6f887a199 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:54.909320 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-b2b4ef89-ea3a-4e79-b64e-db22a0eaa80d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:54.910083 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 225/443] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:17:54.911173 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 219/444] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:54.917221 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf5caa-c5c4-47ef-be2a-58b6f887a199 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:54.919332 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94fe9a-217f-4c37-ad38-301c36313eec None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:54.919624 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94fe9a-217f-4c37-ad38-301c36313eec None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:54.919905 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94fe9a-217f-4c37-ad38-301c36313eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:54.939926 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-5c94fe9a-217f-4c37-ad38-301c36313eec None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:54.941866 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-5c94fe9a-217f-4c37-ad38-301c36313eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:54.949538 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf5caa-c5c4-47ef-be2a-58b6f887a199 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:54.957049 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 220/445] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:54.967894 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37b0cc-add1-484a-a41c-fb08a3d9191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:54.968577 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37b0cc-add1-484a-a41c-fb08a3d9191d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:54.968859 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37b0cc-add1-484a-a41c-fb08a3d9191d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:54.969159 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37b0cc-add1-484a-a41c-fb08a3d9191d admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:54.969889 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37b0cc-add1-484a-a41c-fb08a3d9191d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:54.970197 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37b0cc-add1-484a-a41c-fb08a3d9191d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:54.976481 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37b0cc-add1-484a-a41c-fb08a3d9191d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:54.976654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f06858-4440-4b72-b301-f31a5f795e42 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:54.976654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f06858-4440-4b72-b301-f31a5f795e42 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:54.976654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f06858-4440-4b72-b301-f31a5f795e42 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:54.976654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 221/446] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:17:54.976654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f06858-4440-4b72-b301-f31a5f795e42 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:54.991470 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f06858-4440-4b72-b301-f31a5f795e42 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:54.997154 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51009ad7-9cd3-4e4f-8cfc-bfb91947fa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:54.998024 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51009ad7-9cd3-4e4f-8cfc-bfb91947fa53 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:54.998355 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 226/447] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:54.998475 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51009ad7-9cd3-4e4f-8cfc-bfb91947fa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:54.998878 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51009ad7-9cd3-4e4f-8cfc-bfb91947fa53 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.000197 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbf3fe-1d0c-4688-9d43-2be9210feda7 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.000665 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbf3fe-1d0c-4688-9d43-2be9210feda7 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.001303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbf3fe-1d0c-4688-9d43-2be9210feda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.012501 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51009ad7-9cd3-4e4f-8cfc-bfb91947fa53 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:55.020304 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-51009ad7-9cd3-4e4f-8cfc-bfb91947fa53 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 02:17:55.021737 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 222/448] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:17:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:55.022605 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-c0cbf3fe-1d0c-4688-9d43-2be9210feda7 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:55.024012 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-c0cbf3fe-1d0c-4688-9d43-2be9210feda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:55.027756 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51009ad7-9cd3-4e4f-8cfc-bfb91947fa53 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.036119 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 227/449] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:55.037346 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbf3fe-1d0c-4688-9d43-2be9210feda7 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.043278 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51009ad7-9cd3-4e4f-8cfc-bfb91947fa53 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.055008 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cbf3fe-1d0c-4688-9d43-2be9210feda7 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.057487 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd4c43-1674-4b25-92b4-02b8e44531d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.058528 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd4c43-1674-4b25-92b4-02b8e44531d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.059023 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd4c43-1674-4b25-92b4-02b8e44531d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.059565 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd4c43-1674-4b25-92b4-02b8e44531d9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.067951 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143cf2e-d5a2-430d-876e-33c26cb8e5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.068937 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143cf2e-d5a2-430d-876e-33c26cb8e5ed admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.069278 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143cf2e-d5a2-430d-876e-33c26cb8e5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.069561 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143cf2e-d5a2-430d-876e-33c26cb8e5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.070015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd4c43-1674-4b25-92b4-02b8e44531d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.070362 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143cf2e-d5a2-430d-876e-33c26cb8e5ed admin admin] RBAC: Adding query filter params (name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:55.070673 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143cf2e-d5a2-430d-876e-33c26cb8e5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.072381 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143cf2e-d5a2-430d-876e-33c26cb8e5ed admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.072947 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd4c43-1674-4b25-92b4-02b8e44531d9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.082838 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 228/450] 10.222.0.32 () {56 vars in 1125 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:55.087523 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-9dfd4c43-1674-4b25-92b4-02b8e44531d9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 02:17:55.088617 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143cf2e-d5a2-430d-876e-33c26cb8e5ed admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.089261 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 223/451] 10.222.0.32 () {56 vars in 1115 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/users/nova => generated 82 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:55.095588 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd4c43-1674-4b25-92b4-02b8e44531d9 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.099205 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143cf2e-d5a2-430d-876e-33c26cb8e5ed admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.104670 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182a556-a501-4e87-999f-9c075e8f2fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.105641 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182a556-a501-4e87-999f-9c075e8f2fff admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.105928 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182a556-a501-4e87-999f-9c075e8f2fff admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.106157 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd4c43-1674-4b25-92b4-02b8e44531d9 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.106264 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182a556-a501-4e87-999f-9c075e8f2fff admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.111293 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c4de0-e116-4daf-89c5-891a79f67032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.112505 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c4de0-e116-4daf-89c5-891a79f67032 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.113114 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c4de0-e116-4daf-89c5-891a79f67032 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.113585 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c4de0-e116-4daf-89c5-891a79f67032 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.114725 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c4de0-e116-4daf-89c5-891a79f67032 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:55.115251 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c4de0-e116-4daf-89c5-891a79f67032 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.117364 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182a556-a501-4e87-999f-9c075e8f2fff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:55.117687 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c4de0-e116-4daf-89c5-891a79f67032 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.125058 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-f182a556-a501-4e87-999f-9c075e8f2fff admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 02:17:55.126496 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 229/452] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:55.127460 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182a556-a501-4e87-999f-9c075e8f2fff admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.145140 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182a556-a501-4e87-999f-9c075e8f2fff admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.145853 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 224/453] 10.222.0.32 () {56 vars in 1155 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:55.146873 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c4de0-e116-4daf-89c5-891a79f67032 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.154077 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dc259-777f-4241-8eae-619b2ab56fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.154892 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dc259-777f-4241-8eae-619b2ab56fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.155403 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dc259-777f-4241-8eae-619b2ab56fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.155525 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dc259-777f-4241-8eae-619b2ab56fc4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.161281 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c4de0-e116-4daf-89c5-891a79f67032 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.166204 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2027e9a-4597-4526-ae98-206c368345c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.166709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1dc259-777f-4241-8eae-619b2ab56fc4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.167362 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2027e9a-4597-4526-ae98-206c368345c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.167832 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2027e9a-4597-4526-ae98-206c368345c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.168272 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2027e9a-4597-4526-ae98-206c368345c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.168727 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1dc259-777f-4241-8eae-619b2ab56fc4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.169636 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2027e9a-4597-4526-ae98-206c368345c4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:55.170151 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2027e9a-4597-4526-ae98-206c368345c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.171907 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2027e9a-4597-4526-ae98-206c368345c4 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.184911 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 225/454] 10.222.0.32 () {56 vars in 1125 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:55.186064 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2027e9a-4597-4526-ae98-206c368345c4 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.186666 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-4f1dc259-777f-4241-8eae-619b2ab56fc4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:55.193009 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 230/455] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:55.193843 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dc259-777f-4241-8eae-619b2ab56fc4 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.198735 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2027e9a-4597-4526-ae98-206c368345c4 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.203578 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d3a4f-9f6a-4d52-a33e-750bb85796e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.204619 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d3a4f-9f6a-4d52-a33e-750bb85796e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.204985 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dc259-777f-4241-8eae-619b2ab56fc4 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.205376 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d3a4f-9f6a-4d52-a33e-750bb85796e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.206670 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d3a4f-9f6a-4d52-a33e-750bb85796e4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.211114 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a232d8-f4f7-47cf-9cc0-db3d4c59a141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.211948 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a232d8-f4f7-47cf-9cc0-db3d4c59a141 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.212229 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a232d8-f4f7-47cf-9cc0-db3d4c59a141 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.212505 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a232d8-f4f7-47cf-9cc0-db3d4c59a141 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.219848 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d3a4f-9f6a-4d52-a33e-750bb85796e4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.222070 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d3a4f-9f6a-4d52-a33e-750bb85796e4 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.223614 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a232d8-f4f7-47cf-9cc0-db3d4c59a141 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.225917 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a232d8-f4f7-47cf-9cc0-db3d4c59a141 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.239917 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-8f7d3a4f-9f6a-4d52-a33e-750bb85796e4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:55.241716 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 226/456] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:55.242780 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d3a4f-9f6a-4d52-a33e-750bb85796e4 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.249502 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-77a232d8-f4f7-47cf-9cc0-db3d4c59a141 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:55.250755 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 231/457] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:55.253314 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a232d8-f4f7-47cf-9cc0-db3d4c59a141 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.258412 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d3a4f-9f6a-4d52-a33e-750bb85796e4 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.263014 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735e963-68c8-490f-abf7-36061729e335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.263763 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735e963-68c8-490f-abf7-36061729e335 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.264143 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735e963-68c8-490f-abf7-36061729e335 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.264396 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a232d8-f4f7-47cf-9cc0-db3d4c59a141 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.264619 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735e963-68c8-490f-abf7-36061729e335 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.265477 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735e963-68c8-490f-abf7-36061729e335 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:55.265985 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735e963-68c8-490f-abf7-36061729e335 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.267955 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735e963-68c8-490f-abf7-36061729e335 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.270677 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34761e8c-1004-48d6-80ca-e14ec1200b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.271965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34761e8c-1004-48d6-80ca-e14ec1200b9a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.272411 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34761e8c-1004-48d6-80ca-e14ec1200b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.272901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34761e8c-1004-48d6-80ca-e14ec1200b9a admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.273795 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34761e8c-1004-48d6-80ca-e14ec1200b9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:55.274241 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34761e8c-1004-48d6-80ca-e14ec1200b9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.276081 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34761e8c-1004-48d6-80ca-e14ec1200b9a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.281233 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 227/458] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:55.282127 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735e963-68c8-490f-abf7-36061729e335 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.295385 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 232/459] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:55.295385 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34761e8c-1004-48d6-80ca-e14ec1200b9a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.303759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735e963-68c8-490f-abf7-36061729e335 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.308958 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34761e8c-1004-48d6-80ca-e14ec1200b9a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.310184 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dc7be-c113-406e-843c-1ddab0bdd140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.311411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dc7be-c113-406e-843c-1ddab0bdd140 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.312032 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dc7be-c113-406e-843c-1ddab0bdd140 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.312681 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dc7be-c113-406e-843c-1ddab0bdd140 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.313599 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ac996-24f0-4156-8683-30433bb7da30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.314015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894dc7be-c113-406e-843c-1ddab0bdd140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:55.314378 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ac996-24f0-4156-8683-30433bb7da30 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.314655 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ac996-24f0-4156-8683-30433bb7da30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.314929 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ac996-24f0-4156-8683-30433bb7da30 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.315248 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894dc7be-c113-406e-843c-1ddab0bdd140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.317962 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894dc7be-c113-406e-843c-1ddab0bdd140 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.323792 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ac996-24f0-4156-8683-30433bb7da30 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.325887 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ac996-24f0-4156-8683-30433bb7da30 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.334013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 228/460] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:55.335127 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dc7be-c113-406e-843c-1ddab0bdd140 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.345465 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dc7be-c113-406e-843c-1ddab0bdd140 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.346151 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-4e7ac996-24f0-4156-8683-30433bb7da30 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 02:17:55.350990 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e1e25-2a3e-4305-9d99-1c23510e0171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.352165 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e1e25-2a3e-4305-9d99-1c23510e0171 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.352608 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 233/461] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/users/cinder => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:55.352995 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e1e25-2a3e-4305-9d99-1c23510e0171 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.353489 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e1e25-2a3e-4305-9d99-1c23510e0171 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.353690 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ac996-24f0-4156-8683-30433bb7da30 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.364666 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e1e25-2a3e-4305-9d99-1c23510e0171 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.365284 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ac996-24f0-4156-8683-30433bb7da30 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.367875 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e1e25-2a3e-4305-9d99-1c23510e0171 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.370541 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b56a6-e186-4906-bffd-09f496e64fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.371246 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b56a6-e186-4906-bffd-09f496e64fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.371530 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b56a6-e186-4906-bffd-09f496e64fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.371802 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b56a6-e186-4906-bffd-09f496e64fa0 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.382079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b56a6-e186-4906-bffd-09f496e64fa0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.384257 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b56a6-e186-4906-bffd-09f496e64fa0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.387832 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-480e1e25-2a3e-4305-9d99-1c23510e0171 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:17:55.393105 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 229/462] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:55.395355 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e1e25-2a3e-4305-9d99-1c23510e0171 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.403268 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-a58b56a6-e186-4906-bffd-09f496e64fa0 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 02:17:55.404544 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 234/463] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/users/glance => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:55.406121 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e1e25-2a3e-4305-9d99-1c23510e0171 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.410123 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b56a6-e186-4906-bffd-09f496e64fa0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.411260 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91c732-cd3c-482b-9097-abca39e97120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.412210 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91c732-cd3c-482b-9097-abca39e97120 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.412715 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91c732-cd3c-482b-9097-abca39e97120 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.413213 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91c732-cd3c-482b-9097-abca39e97120 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.414240 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91c732-cd3c-482b-9097-abca39e97120 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:55.414744 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91c732-cd3c-482b-9097-abca39e97120 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.417647 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91c732-cd3c-482b-9097-abca39e97120 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.421390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b56a6-e186-4906-bffd-09f496e64fa0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.426405 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd04b07-e405-4240-abf2-1a9684f1e75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.426991 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd04b07-e405-4240-abf2-1a9684f1e75d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.427275 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd04b07-e405-4240-abf2-1a9684f1e75d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.427645 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd04b07-e405-4240-abf2-1a9684f1e75d admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.428429 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd04b07-e405-4240-abf2-1a9684f1e75d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:55.428800 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd04b07-e405-4240-abf2-1a9684f1e75d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.430805 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd04b07-e405-4240-abf2-1a9684f1e75d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.440342 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 230/464] 10.222.0.32 () {56 vars in 1159 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:55.441720 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91c732-cd3c-482b-9097-abca39e97120 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.446680 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 235/465] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:55.452073 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd04b07-e405-4240-abf2-1a9684f1e75d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.457871 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91c732-cd3c-482b-9097-abca39e97120 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.462792 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d938e-7903-4c61-a482-97a9bb3a5d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.462965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd04b07-e405-4240-abf2-1a9684f1e75d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.463640 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d938e-7903-4c61-a482-97a9bb3a5d63 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.464038 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d938e-7903-4c61-a482-97a9bb3a5d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.464412 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d938e-7903-4c61-a482-97a9bb3a5d63 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.465383 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d938e-7903-4c61-a482-97a9bb3a5d63 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:55.465791 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d938e-7903-4c61-a482-97a9bb3a5d63 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.468231 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d938e-7903-4c61-a482-97a9bb3a5d63 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.472374 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6bd62-35f4-4887-a18e-5de3e9856027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.473204 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6bd62-35f4-4887-a18e-5de3e9856027 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.475795 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6bd62-35f4-4887-a18e-5de3e9856027 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.475795 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6bd62-35f4-4887-a18e-5de3e9856027 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.486971 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 231/466] 10.222.0.32 () {56 vars in 1159 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:55.487911 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d938e-7903-4c61-a482-97a9bb3a5d63 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.489730 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6bd62-35f4-4887-a18e-5de3e9856027 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.491746 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6bd62-35f4-4887-a18e-5de3e9856027 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.500365 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d938e-7903-4c61-a482-97a9bb3a5d63 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.505817 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa9bdd-0f5d-41eb-bdb6-18028389d9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.506808 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa9bdd-0f5d-41eb-bdb6-18028389d9be admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.507210 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa9bdd-0f5d-41eb-bdb6-18028389d9be admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.507581 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa9bdd-0f5d-41eb-bdb6-18028389d9be admin admin] PATH_INFO: `/v3/projects/083ff2535d794e79a145a076aedeedd4/users/797b76e6f16d428198e7f7f05c9c0fd3/roles/33ed3f5cd26a4ea9a99eb0e09856c1a8` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.510199 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-7ec6bd62-35f4-4887-a18e-5de3e9856027 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:55.511380 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 236/467] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:55.517581 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa2291-8025-4c6d-854d-eca749947653 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.518067 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa2291-8025-4c6d-854d-eca749947653 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.518887 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa2291-8025-4c6d-854d-eca749947653 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.520824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 237/468] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:55 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:55.525800 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa2291-8025-4c6d-854d-eca749947653 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.526612 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa9bdd-0f5d-41eb-bdb6-18028389d9be admin admin] RBAC: Authorizing `identity:create_grant(project_id=083ff2535d794e79a145a076aedeedd4, user_id=797b76e6f16d428198e7f7f05c9c0fd3, role_id=33ed3f5cd26a4ea9a99eb0e09856c1a8)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.529391 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa9bdd-0f5d-41eb-bdb6-18028389d9be admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.539321 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa2291-8025-4c6d-854d-eca749947653 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.543978 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 232/469] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:17:55 2021] PUT /identity/v3/projects/083ff2535d794e79a145a076aedeedd4/users/797b76e6f16d428198e7f7f05c9c0fd3/roles/33ed3f5cd26a4ea9a99eb0e09856c1a8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:17:55.544753 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa9bdd-0f5d-41eb-bdb6-18028389d9be admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.617545 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b66d5-6610-4702-ac13-f3eec8ed7c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.618373 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b66d5-6610-4702-ac13-f3eec8ed7c08 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.618780 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b66d5-6610-4702-ac13-f3eec8ed7c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.619149 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b66d5-6610-4702-ac13-f3eec8ed7c08 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.625312 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa9bdd-0f5d-41eb-bdb6-18028389d9be admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.632546 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b66d5-6610-4702-ac13-f3eec8ed7c08 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.634429 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b66d5-6610-4702-ac13-f3eec8ed7c08 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.635536 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0888be-5b5d-4cb9-8f32-4da42247bc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.636215 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0888be-5b5d-4cb9-8f32-4da42247bc6e admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.636546 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0888be-5b5d-4cb9-8f32-4da42247bc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.636828 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0888be-5b5d-4cb9-8f32-4da42247bc6e admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.637609 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0888be-5b5d-4cb9-8f32-4da42247bc6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:55.637906 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0888be-5b5d-4cb9-8f32-4da42247bc6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.639532 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0888be-5b5d-4cb9-8f32-4da42247bc6e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.656931 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 233/470] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:55.656931 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2430f8a-22bc-4573-b02e-01b6b4ceb983 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.656931 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2430f8a-22bc-4573-b02e-01b6b4ceb983 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.656931 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2430f8a-22bc-4573-b02e-01b6b4ceb983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.668595 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-a90b66d5-6610-4702-ac13-f3eec8ed7c08 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:55.670171 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 238/471] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:55.673864 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b66d5-6610-4702-ac13-f3eec8ed7c08 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.681371 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-b2430f8a-22bc-4573-b02e-01b6b4ceb983 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:55.682977 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b2430f8a-22bc-4573-b02e-01b6b4ceb983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:55.687474 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b66d5-6610-4702-ac13-f3eec8ed7c08 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.692413 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 234/472] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:55.692730 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a016c6-d7cc-4417-951c-98f38d440c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.693604 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2430f8a-22bc-4573-b02e-01b6b4ceb983 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.693735 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a016c6-d7cc-4417-951c-98f38d440c68 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.694137 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a016c6-d7cc-4417-951c-98f38d440c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.694554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a016c6-d7cc-4417-951c-98f38d440c68 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.703211 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a016c6-d7cc-4417-951c-98f38d440c68 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.704637 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2430f8a-22bc-4573-b02e-01b6b4ceb983 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.705410 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a016c6-d7cc-4417-951c-98f38d440c68 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.710963 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2fd87-181b-4b33-a505-aef688319b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.711917 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2fd87-181b-4b33-a505-aef688319b8b admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.712607 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2fd87-181b-4b33-a505-aef688319b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.713180 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2fd87-181b-4b33-a505-aef688319b8b admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.714238 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2fd87-181b-4b33-a505-aef688319b8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:55.714723 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2fd87-181b-4b33-a505-aef688319b8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.716590 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2fd87-181b-4b33-a505-aef688319b8b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.721246 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-b5a016c6-d7cc-4417-951c-98f38d440c68 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:17:55.723507 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 239/473] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:55.729883 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a016c6-d7cc-4417-951c-98f38d440c68 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.738772 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 235/474] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:55.739706 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2fd87-181b-4b33-a505-aef688319b8b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.744290 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a016c6-d7cc-4417-951c-98f38d440c68 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.751258 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f424551-5a43-4d3d-a40a-7738629c0197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.752205 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f424551-5a43-4d3d-a40a-7738629c0197 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.752697 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f424551-5a43-4d3d-a40a-7738629c0197 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.753725 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f424551-5a43-4d3d-a40a-7738629c0197 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.754726 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f424551-5a43-4d3d-a40a-7738629c0197 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:55.754830 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2fd87-181b-4b33-a505-aef688319b8b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.755335 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f424551-5a43-4d3d-a40a-7738629c0197 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.757517 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f424551-5a43-4d3d-a40a-7738629c0197 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.759265 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509e36b-1039-4649-9e45-effe0bda0d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.760197 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509e36b-1039-4649-9e45-effe0bda0d4d admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.760480 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509e36b-1039-4649-9e45-effe0bda0d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.761156 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509e36b-1039-4649-9e45-effe0bda0d4d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.776909 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 240/475] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:55.776909 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f424551-5a43-4d3d-a40a-7738629c0197 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.778109 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509e36b-1039-4649-9e45-effe0bda0d4d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:55.784370 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f424551-5a43-4d3d-a40a-7738629c0197 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.785639 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-b509e36b-1039-4649-9e45-effe0bda0d4d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 02:17:55.787476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 236/476] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:55.788084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509e36b-1039-4649-9e45-effe0bda0d4d admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.794618 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464d72a-02cd-423a-8748-61aeae0f8510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.795482 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464d72a-02cd-423a-8748-61aeae0f8510 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.795860 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464d72a-02cd-423a-8748-61aeae0f8510 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.796026 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464d72a-02cd-423a-8748-61aeae0f8510 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.800808 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509e36b-1039-4649-9e45-effe0bda0d4d admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.803387 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464d72a-02cd-423a-8748-61aeae0f8510 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.805352 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1f20a-0944-4eb3-b27f-bd28d9830d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.805504 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464d72a-02cd-423a-8748-61aeae0f8510 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.806291 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1f20a-0944-4eb3-b27f-bd28d9830d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.806577 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1f20a-0944-4eb3-b27f-bd28d9830d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.806849 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1f20a-0944-4eb3-b27f-bd28d9830d55 admin admin] PATH_INFO: `/v3/projects/083ff2535d794e79a145a076aedeedd4/users/e0c01428860e44fe9d0b15886add165f/roles/33ed3f5cd26a4ea9a99eb0e09856c1a8` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.819747 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-7464d72a-02cd-423a-8748-61aeae0f8510 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:17:55.821249 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 241/477] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:55.821893 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464d72a-02cd-423a-8748-61aeae0f8510 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.822350 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1f20a-0944-4eb3-b27f-bd28d9830d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=083ff2535d794e79a145a076aedeedd4, user_id=e0c01428860e44fe9d0b15886add165f, role_id=33ed3f5cd26a4ea9a99eb0e09856c1a8)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.825110 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1f20a-0944-4eb3-b27f-bd28d9830d55 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.837053 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464d72a-02cd-423a-8748-61aeae0f8510 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.840681 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 237/478] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:17:55 2021] PUT /identity/v3/projects/083ff2535d794e79a145a076aedeedd4/users/e0c01428860e44fe9d0b15886add165f/roles/33ed3f5cd26a4ea9a99eb0e09856c1a8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:17:55.841570 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1f20a-0944-4eb3-b27f-bd28d9830d55 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.902108 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5cdf1-93e0-4685-ba6f-d8cc975a9142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.902783 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5cdf1-93e0-4685-ba6f-d8cc975a9142 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.903065 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5cdf1-93e0-4685-ba6f-d8cc975a9142 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.903388 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5cdf1-93e0-4685-ba6f-d8cc975a9142 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.904244 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5cdf1-93e0-4685-ba6f-d8cc975a9142 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:55.904557 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5cdf1-93e0-4685-ba6f-d8cc975a9142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.906406 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5cdf1-93e0-4685-ba6f-d8cc975a9142 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.920453 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1f20a-0944-4eb3-b27f-bd28d9830d55 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.925431 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e35a33-d145-4edb-a618-44e4a3dc883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.925824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 242/479] 10.222.0.32 () {56 vars in 1125 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:55.926105 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e35a33-d145-4edb-a618-44e4a3dc883c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.926383 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e35a33-d145-4edb-a618-44e4a3dc883c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.926654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e35a33-d145-4edb-a618-44e4a3dc883c admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.927521 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e35a33-d145-4edb-a618-44e4a3dc883c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:55.927747 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e35a33-d145-4edb-a618-44e4a3dc883c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.929615 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e35a33-d145-4edb-a618-44e4a3dc883c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.933528 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5cdf1-93e0-4685-ba6f-d8cc975a9142 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.943269 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 238/480] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:55.944588 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5cdf1-93e0-4685-ba6f-d8cc975a9142 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.952210 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e35a33-d145-4edb-a618-44e4a3dc883c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:55.960432 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58af21-95ae-4262-93fc-579fa928041e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.961739 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58af21-95ae-4262-93fc-579fa928041e admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.961739 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58af21-95ae-4262-93fc-579fa928041e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.961935 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58af21-95ae-4262-93fc-579fa928041e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.966154 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e35a33-d145-4edb-a618-44e4a3dc883c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:55.973386 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58af21-95ae-4262-93fc-579fa928041e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.975281 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58af21-95ae-4262-93fc-579fa928041e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:55.976751 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cffa9-7023-481d-a02f-5b0bddfcc812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:55.978603 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cffa9-7023-481d-a02f-5b0bddfcc812 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:55.979106 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cffa9-7023-481d-a02f-5b0bddfcc812 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:55.979609 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cffa9-7023-481d-a02f-5b0bddfcc812 admin admin] PATH_INFO: `/v3/projects/083ff2535d794e79a145a076aedeedd4/users/a71d661d14d94fa597aee037599de7a8/roles/33ed3f5cd26a4ea9a99eb0e09856c1a8` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:55.997050 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cffa9-7023-481d-a02f-5b0bddfcc812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=083ff2535d794e79a145a076aedeedd4, user_id=a71d661d14d94fa597aee037599de7a8, role_id=33ed3f5cd26a4ea9a99eb0e09856c1a8)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:55.999807 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cffa9-7023-481d-a02f-5b0bddfcc812 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:56.000313 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-5f58af21-95ae-4262-93fc-579fa928041e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:56.001798 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 243/481] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:17:56.004926 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677609cc-41ff-48bc-86e5-cbe9f76def4b None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.005585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677609cc-41ff-48bc-86e5-cbe9f76def4b None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.006027 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677609cc-41ff-48bc-86e5-cbe9f76def4b None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.008416 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 244/482] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:56 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:56.008416 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677609cc-41ff-48bc-86e5-cbe9f76def4b None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:56.026669 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 239/483] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:17:55 2021] PUT /identity/v3/projects/083ff2535d794e79a145a076aedeedd4/users/a71d661d14d94fa597aee037599de7a8/roles/33ed3f5cd26a4ea9a99eb0e09856c1a8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:17:56.028325 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731cd3c-8b70-4928-b294-2fbc19190d38 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.028842 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731cd3c-8b70-4928-b294-2fbc19190d38 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.029361 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731cd3c-8b70-4928-b294-2fbc19190d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.033873 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677609cc-41ff-48bc-86e5-cbe9f76def4b None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:56.067877 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-0731cd3c-8b70-4928-b294-2fbc19190d38 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:56.071158 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-0731cd3c-8b70-4928-b294-2fbc19190d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:56.130040 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe999c27-91b0-4dfe-85f5-91fc7a1dc86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:56.130624 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe999c27-91b0-4dfe-85f5-91fc7a1dc86a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.130910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe999c27-91b0-4dfe-85f5-91fc7a1dc86a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.131187 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe999c27-91b0-4dfe-85f5-91fc7a1dc86a admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.131983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe999c27-91b0-4dfe-85f5-91fc7a1dc86a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:56.132299 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe999c27-91b0-4dfe-85f5-91fc7a1dc86a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:56.134045 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe999c27-91b0-4dfe-85f5-91fc7a1dc86a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:56.146845 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 245/484] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:56.148536 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 240/485] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:56.154328 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe999c27-91b0-4dfe-85f5-91fc7a1dc86a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:56.165178 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe999c27-91b0-4dfe-85f5-91fc7a1dc86a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:56.170301 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb4bc1-8647-40d2-b3bf-6bfe7dcba194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:56.171456 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb4bc1-8647-40d2-b3bf-6bfe7dcba194 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.171966 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb4bc1-8647-40d2-b3bf-6bfe7dcba194 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.172436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb4bc1-8647-40d2-b3bf-6bfe7dcba194 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.177893 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731cd3c-8b70-4928-b294-2fbc19190d38 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:56.184330 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb4bc1-8647-40d2-b3bf-6bfe7dcba194 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:56.187023 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb4bc1-8647-40d2-b3bf-6bfe7dcba194 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:56.187660 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731cd3c-8b70-4928-b294-2fbc19190d38 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:56.193324 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac704270-2c70-4b92-bfd6-b1b32b1d53c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:56.194138 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac704270-2c70-4b92-bfd6-b1b32b1d53c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.194502 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac704270-2c70-4b92-bfd6-b1b32b1d53c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.194791 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac704270-2c70-4b92-bfd6-b1b32b1d53c5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.204978 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-95bb4bc1-8647-40d2-b3bf-6bfe7dcba194 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 02:17:56.206985 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 246/486] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:17:56 2021] GET /identity/v3/users/neutron => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:56.213286 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac704270-2c70-4b92-bfd6-b1b32b1d53c5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:56.213711 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb4bc1-8647-40d2-b3bf-6bfe7dcba194 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:56.220896 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-ac704270-2c70-4b92-bfd6-b1b32b1d53c5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 02:17:56.223473 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 241/487] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:17:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:56.224508 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb4bc1-8647-40d2-b3bf-6bfe7dcba194 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:56.228824 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac704270-2c70-4b92-bfd6-b1b32b1d53c5 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:56.232371 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377c684-0451-4f86-9640-81d70b3e4824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:56.233133 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377c684-0451-4f86-9640-81d70b3e4824 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.233413 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377c684-0451-4f86-9640-81d70b3e4824 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.233686 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377c684-0451-4f86-9640-81d70b3e4824 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.234579 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377c684-0451-4f86-9640-81d70b3e4824 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:56.234891 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377c684-0451-4f86-9640-81d70b3e4824 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:56.238523 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377c684-0451-4f86-9640-81d70b3e4824 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:56.241843 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac704270-2c70-4b92-bfd6-b1b32b1d53c5 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:56.246870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db978aec-2dce-4339-977f-eddb6e0f4e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:56.247830 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db978aec-2dce-4339-977f-eddb6e0f4e8f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.248403 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db978aec-2dce-4339-977f-eddb6e0f4e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.248893 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db978aec-2dce-4339-977f-eddb6e0f4e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.249889 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db978aec-2dce-4339-977f-eddb6e0f4e8f admin admin] RBAC: Adding query filter params (name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:56.250392 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db978aec-2dce-4339-977f-eddb6e0f4e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:56.252292 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db978aec-2dce-4339-977f-eddb6e0f4e8f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:56.258257 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 247/488] 10.222.0.32 () {56 vars in 1161 bytes} [Wed Sep 15 02:17:56 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:56.267179 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 242/489] 10.222.0.32 () {56 vars in 1125 bytes} [Wed Sep 15 02:17:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:56.267980 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377c684-0451-4f86-9640-81d70b3e4824 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:56.273492 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db978aec-2dce-4339-977f-eddb6e0f4e8f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:56.279244 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377c684-0451-4f86-9640-81d70b3e4824 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:56.283853 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db978aec-2dce-4339-977f-eddb6e0f4e8f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:56.284807 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf73a1-aa00-4375-ab8e-bbdf046d151d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:56.285686 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf73a1-aa00-4375-ab8e-bbdf046d151d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.285967 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf73a1-aa00-4375-ab8e-bbdf046d151d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.286240 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf73a1-aa00-4375-ab8e-bbdf046d151d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.290985 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e1d1d-371d-4916-9fba-925508aa074f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:56.291770 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e1d1d-371d-4916-9fba-925508aa074f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.292048 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e1d1d-371d-4916-9fba-925508aa074f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.292314 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e1d1d-371d-4916-9fba-925508aa074f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.298940 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf73a1-aa00-4375-ab8e-bbdf046d151d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:56.301785 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf73a1-aa00-4375-ab8e-bbdf046d151d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:56.305065 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e1d1d-371d-4916-9fba-925508aa074f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:56.307093 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e1d1d-371d-4916-9fba-925508aa074f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:56.321585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-63cf73a1-aa00-4375-ab8e-bbdf046d151d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:56.323105 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 248/490] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:56.325763 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-147e1d1d-371d-4916-9fba-925508aa074f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:56.332194 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 243/491] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:56.332320 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf73a1-aa00-4375-ab8e-bbdf046d151d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:56.333060 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e1d1d-371d-4916-9fba-925508aa074f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:56.340809 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf73a1-aa00-4375-ab8e-bbdf046d151d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:56.343581 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e1d1d-371d-4916-9fba-925508aa074f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:56.346077 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261baf8-aa69-4cf8-a530-945cd5320459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:56.347002 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261baf8-aa69-4cf8-a530-945cd5320459 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.347505 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261baf8-aa69-4cf8-a530-945cd5320459 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.347998 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261baf8-aa69-4cf8-a530-945cd5320459 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.348102 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385d3b3-188a-4226-8dd7-50ba3c3f2aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:56.348833 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385d3b3-188a-4226-8dd7-50ba3c3f2aed admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.349156 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385d3b3-188a-4226-8dd7-50ba3c3f2aed admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.349430 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385d3b3-188a-4226-8dd7-50ba3c3f2aed admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.349682 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261baf8-aa69-4cf8-a530-945cd5320459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:56.350177 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261baf8-aa69-4cf8-a530-945cd5320459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:56.350284 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385d3b3-188a-4226-8dd7-50ba3c3f2aed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:56.350486 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385d3b3-188a-4226-8dd7-50ba3c3f2aed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:56.352162 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385d3b3-188a-4226-8dd7-50ba3c3f2aed admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:56.352456 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261baf8-aa69-4cf8-a530-945cd5320459 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:56.367094 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 244/492] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:56.367614 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 249/493] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:56.373633 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385d3b3-188a-4226-8dd7-50ba3c3f2aed admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:56.373895 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261baf8-aa69-4cf8-a530-945cd5320459 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:56.384416 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261baf8-aa69-4cf8-a530-945cd5320459 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:56.384734 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385d3b3-188a-4226-8dd7-50ba3c3f2aed admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:56.392928 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad5c11-db61-4348-9e70-999450962ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:56.392928 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad5c11-db61-4348-9e70-999450962ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.392928 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad5c11-db61-4348-9e70-999450962ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.392928 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad5c11-db61-4348-9e70-999450962ff0 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.393848 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45554f-c724-445d-b5f0-73dfc0d2c26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:56.394811 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45554f-c724-445d-b5f0-73dfc0d2c26c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.395288 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45554f-c724-445d-b5f0-73dfc0d2c26c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.395768 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45554f-c724-445d-b5f0-73dfc0d2c26c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.398839 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad5c11-db61-4348-9e70-999450962ff0 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:56.400935 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad5c11-db61-4348-9e70-999450962ff0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:56.408672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45554f-c724-445d-b5f0-73dfc0d2c26c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:56.411001 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45554f-c724-445d-b5f0-73dfc0d2c26c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:56.416930 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-2cad5c11-db61-4348-9e70-999450962ff0 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 02:17:56.416930 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 250/494] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:17:56 2021] GET /identity/v3/users/swift => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:56.422096 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad5c11-db61-4348-9e70-999450962ff0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:56.432394 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad5c11-db61-4348-9e70-999450962ff0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:56.436992 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33208151-4516-4a0c-ba81-81fde18b92f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:56.437768 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33208151-4516-4a0c-ba81-81fde18b92f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.438147 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33208151-4516-4a0c-ba81-81fde18b92f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.438518 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33208151-4516-4a0c-ba81-81fde18b92f4 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.439445 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33208151-4516-4a0c-ba81-81fde18b92f4 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:56.439849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33208151-4516-4a0c-ba81-81fde18b92f4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:56.440184 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-7e45554f-c724-445d-b5f0-73dfc0d2c26c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:17:56.442263 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 245/495] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:56.448924 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33208151-4516-4a0c-ba81-81fde18b92f4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:56.449070 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45554f-c724-445d-b5f0-73dfc0d2c26c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:56.460834 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 251/496] 10.222.0.32 () {56 vars in 1157 bytes} [Wed Sep 15 02:17:56 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:56.469589 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33208151-4516-4a0c-ba81-81fde18b92f4 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:56.483124 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45554f-c724-445d-b5f0-73dfc0d2c26c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:56.484377 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33208151-4516-4a0c-ba81-81fde18b92f4 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:56.489909 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38689869-b284-42f0-a382-360a920965fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:56.490707 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38689869-b284-42f0-a382-360a920965fa admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.491159 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38689869-b284-42f0-a382-360a920965fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.491550 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38689869-b284-42f0-a382-360a920965fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.500216 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38689869-b284-42f0-a382-360a920965fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:56.502169 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38689869-b284-42f0-a382-360a920965fa admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:56.507079 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c87fa-4770-4cfc-9002-7bc3dd7362a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:56.507796 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c87fa-4770-4cfc-9002-7bc3dd7362a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.508125 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c87fa-4770-4cfc-9002-7bc3dd7362a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.508398 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c87fa-4770-4cfc-9002-7bc3dd7362a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.510685 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c87fa-4770-4cfc-9002-7bc3dd7362a1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:56.511010 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c87fa-4770-4cfc-9002-7bc3dd7362a1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:56.515655 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c87fa-4770-4cfc-9002-7bc3dd7362a1 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:56.519457 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 252/497] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:17:56.533321 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38689869-b284-42f0-a382-360a920965fa admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:56.534758 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38689869-b284-42f0-a382-360a920965fa admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:56.537724 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 246/498] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:17:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:56.539724 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac0c75-9107-47a3-b96c-2c566ae275ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:56.540607 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac0c75-9107-47a3-b96c-2c566ae275ea admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.541025 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac0c75-9107-47a3-b96c-2c566ae275ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.541480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac0c75-9107-47a3-b96c-2c566ae275ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.544472 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c87fa-4770-4cfc-9002-7bc3dd7362a1 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:56.553450 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac0c75-9107-47a3-b96c-2c566ae275ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:56.560898 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c87fa-4770-4cfc-9002-7bc3dd7362a1 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:56.561034 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac0c75-9107-47a3-b96c-2c566ae275ea admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:56.570953 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49af7f-00a7-4f84-a6a1-4f8e4a093e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:56.572057 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49af7f-00a7-4f84-a6a1-4f8e4a093e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.572490 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49af7f-00a7-4f84-a6a1-4f8e4a093e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.572927 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49af7f-00a7-4f84-a6a1-4f8e4a093e13 admin admin] PATH_INFO: `/v3/projects/083ff2535d794e79a145a076aedeedd4/users/91566418241b40ab840e1c3bf9e096c9/roles/33ed3f5cd26a4ea9a99eb0e09856c1a8` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.576900 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-44ac0c75-9107-47a3-b96c-2c566ae275ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:56.576900 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 253/499] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:56.581904 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac0c75-9107-47a3-b96c-2c566ae275ea admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:56.592538 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49af7f-00a7-4f84-a6a1-4f8e4a093e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=083ff2535d794e79a145a076aedeedd4, user_id=91566418241b40ab840e1c3bf9e096c9, role_id=33ed3f5cd26a4ea9a99eb0e09856c1a8)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:56.595487 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49af7f-00a7-4f84-a6a1-4f8e4a093e13 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:56.597088 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac0c75-9107-47a3-b96c-2c566ae275ea admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:56.610198 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4fcbb-c0ef-4fec-849e-56752969907b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:56.611036 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4fcbb-c0ef-4fec-849e-56752969907b admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.611349 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4fcbb-c0ef-4fec-849e-56752969907b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.611603 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4fcbb-c0ef-4fec-849e-56752969907b admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.613249 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4fcbb-c0ef-4fec-849e-56752969907b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:56.613558 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4fcbb-c0ef-4fec-849e-56752969907b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:56.615155 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4fcbb-c0ef-4fec-849e-56752969907b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:56.615938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 247/500] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:17:56 2021] PUT /identity/v3/projects/083ff2535d794e79a145a076aedeedd4/users/91566418241b40ab840e1c3bf9e096c9/roles/33ed3f5cd26a4ea9a99eb0e09856c1a8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:17:56.628942 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 254/501] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:56.636963 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49af7f-00a7-4f84-a6a1-4f8e4a093e13 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:56.755022 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49af7f-00a7-4f84-a6a1-4f8e4a093e13 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:56.760419 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385684e-f59f-48df-89ee-9e846cc5e38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:56.761249 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385684e-f59f-48df-89ee-9e846cc5e38d admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.761534 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385684e-f59f-48df-89ee-9e846cc5e38d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.761811 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385684e-f59f-48df-89ee-9e846cc5e38d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.774799 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385684e-f59f-48df-89ee-9e846cc5e38d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:56.776778 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385684e-f59f-48df-89ee-9e846cc5e38d admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:56.793888 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-8385684e-f59f-48df-89ee-9e846cc5e38d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:17:56.800837 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 248/502] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:56.802115 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4fcbb-c0ef-4fec-849e-56752969907b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:56.818373 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4fcbb-c0ef-4fec-849e-56752969907b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:56.823110 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f0d20-3861-474f-8ad7-35351c951e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:56.823786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f0d20-3861-474f-8ad7-35351c951e62 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.824069 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f0d20-3861-474f-8ad7-35351c951e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.824347 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f0d20-3861-474f-8ad7-35351c951e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.825178 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f0d20-3861-474f-8ad7-35351c951e62 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:56.825566 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f0d20-3861-474f-8ad7-35351c951e62 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:56.827432 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f0d20-3861-474f-8ad7-35351c951e62 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:56.844567 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 255/503] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:17:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:56.851873 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385684e-f59f-48df-89ee-9e846cc5e38d admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:56.867337 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385684e-f59f-48df-89ee-9e846cc5e38d admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:56.871750 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c0994f-700b-4102-bc06-3ce2f26106df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:56.872406 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0994f-700b-4102-bc06-3ce2f26106df admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:56.872688 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0994f-700b-4102-bc06-3ce2f26106df admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:56.873001 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c0994f-700b-4102-bc06-3ce2f26106df admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:56.873843 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0994f-700b-4102-bc06-3ce2f26106df admin admin] RBAC: Adding query filter params (role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=ea510f540b2d47dcb19c8715fd247786) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:56.874157 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0994f-700b-4102-bc06-3ce2f26106df admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:56.875998 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c0994f-700b-4102-bc06-3ce2f26106df admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:56.883739 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 249/504] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:56 2021] GET /identity/v3/role_assignments?user.id=ea510f540b2d47dcb19c8715fd247786&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:58.289263 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98632575-9def-4974-ab60-63af72185b08 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:58.289824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98632575-9def-4974-ab60-63af72185b08 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:58.289824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98632575-9def-4974-ab60-63af72185b08 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:58.291597 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 256/505] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:58.299099 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59b344-c7e9-4cc2-89db-ce5e7860a714 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:58.299549 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59b344-c7e9-4cc2-89db-ce5e7860a714 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:58.299690 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59b344-c7e9-4cc2-89db-ce5e7860a714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:58.322731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-8e59b344-c7e9-4cc2-89db-ce5e7860a714 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:58.323908 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8e59b344-c7e9-4cc2-89db-ce5e7860a714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:58.340642 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 250/506] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:58.365651 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98632575-9def-4974-ab60-63af72185b08 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:58.383925 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98632575-9def-4974-ab60-63af72185b08 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:58.388374 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68594758-912d-4e8d-83ec-895f9567997c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:58.389213 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68594758-912d-4e8d-83ec-895f9567997c admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:58.389498 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68594758-912d-4e8d-83ec-895f9567997c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:58.389777 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68594758-912d-4e8d-83ec-895f9567997c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:58.405811 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68594758-912d-4e8d-83ec-895f9567997c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:58.412757 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-68594758-912d-4e8d-83ec-895f9567997c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 02:17:58.414307 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 257/507] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:17:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:58.420402 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59b344-c7e9-4cc2-89db-ce5e7860a714 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:58.433765 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59b344-c7e9-4cc2-89db-ce5e7860a714 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:58.444689 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4c253-fa06-4e32-8847-4418598527a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:58.445388 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4c253-fa06-4e32-8847-4418598527a8 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:58.445673 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4c253-fa06-4e32-8847-4418598527a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:58.445949 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4c253-fa06-4e32-8847-4418598527a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:58.446697 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4c253-fa06-4e32-8847-4418598527a8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:58.447000 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4c253-fa06-4e32-8847-4418598527a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:58.448710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4c253-fa06-4e32-8847-4418598527a8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:58.459958 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 251/508] 10.222.0.32 () {56 vars in 1125 bytes} [Wed Sep 15 02:17:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:58.466438 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68594758-912d-4e8d-83ec-895f9567997c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:58.485050 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68594758-912d-4e8d-83ec-895f9567997c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:58.496247 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcc0b4-3798-48c9-b85c-d8776ce65614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:58.497110 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcc0b4-3798-48c9-b85c-d8776ce65614 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:58.497394 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcc0b4-3798-48c9-b85c-d8776ce65614 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:58.497674 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcc0b4-3798-48c9-b85c-d8776ce65614 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:58.513319 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcc0b4-3798-48c9-b85c-d8776ce65614 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:58.515213 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcc0b4-3798-48c9-b85c-d8776ce65614 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:58.538736 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-41dcc0b4-3798-48c9-b85c-d8776ce65614 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:58.540010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 258/509] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:58.546047 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4c253-fa06-4e32-8847-4418598527a8 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:58.555847 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4c253-fa06-4e32-8847-4418598527a8 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:58.560358 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35613b-8b13-483b-8521-7144b0559b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:58.561042 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35613b-8b13-483b-8521-7144b0559b76 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:58.561325 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35613b-8b13-483b-8521-7144b0559b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:58.561601 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35613b-8b13-483b-8521-7144b0559b76 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:58.562321 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35613b-8b13-483b-8521-7144b0559b76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:58.562627 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35613b-8b13-483b-8521-7144b0559b76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:58.564197 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35613b-8b13-483b-8521-7144b0559b76 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:58.576165 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 252/510] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:58.582479 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcc0b4-3798-48c9-b85c-d8776ce65614 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:58.589968 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057ea58-ff12-428e-955e-85388da1b109 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:58.590257 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057ea58-ff12-428e-955e-85388da1b109 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:58.590531 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057ea58-ff12-428e-955e-85388da1b109 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:58.593729 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 253/511] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:17:58.595870 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcc0b4-3798-48c9-b85c-d8776ce65614 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:58.600520 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440f0f3-1bff-4399-9f30-98449544cf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:58.601333 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440f0f3-1bff-4399-9f30-98449544cf49 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:58.601616 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440f0f3-1bff-4399-9f30-98449544cf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:58.601892 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440f0f3-1bff-4399-9f30-98449544cf49 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:58.604049 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f60ee-f8bb-4f27-9ac0-6edb1691a896 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:58.604327 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f60ee-f8bb-4f27-9ac0-6edb1691a896 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:58.604603 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f60ee-f8bb-4f27-9ac0-6edb1691a896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:58.618784 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440f0f3-1bff-4399-9f30-98449544cf49 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:58.620805 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440f0f3-1bff-4399-9f30-98449544cf49 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:58.636555 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-090f60ee-f8bb-4f27-9ac0-6edb1691a896 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:58.637764 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-090f60ee-f8bb-4f27-9ac0-6edb1691a896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:58.647113 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-b440f0f3-1bff-4399-9f30-98449544cf49 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 02:17:58.648322 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 259/512] 10.222.0.32 () {56 vars in 1115 bytes} [Wed Sep 15 02:17:58 2021] GET /identity/v3/users/nova => generated 82 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:17:58.658404 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 254/513] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:17:58.659947 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440f0f3-1bff-4399-9f30-98449544cf49 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:58.669568 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440f0f3-1bff-4399-9f30-98449544cf49 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:58.674053 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a608b9-7f52-4e74-a104-26a2378fdf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:58.675212 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a608b9-7f52-4e74-a104-26a2378fdf30 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:58.675492 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a608b9-7f52-4e74-a104-26a2378fdf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:58.675769 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a608b9-7f52-4e74-a104-26a2378fdf30 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:58.676597 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a608b9-7f52-4e74-a104-26a2378fdf30 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:58.676930 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a608b9-7f52-4e74-a104-26a2378fdf30 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:58.678761 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a608b9-7f52-4e74-a104-26a2378fdf30 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:58.697073 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 260/514] 10.222.0.32 () {56 vars in 1155 bytes} [Wed Sep 15 02:17:58 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:58.701617 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f60ee-f8bb-4f27-9ac0-6edb1691a896 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:58.710418 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a608b9-7f52-4e74-a104-26a2378fdf30 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:58.713376 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f60ee-f8bb-4f27-9ac0-6edb1691a896 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:58.723820 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954544b-f3ba-4d08-9402-a05503334982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:58.724650 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954544b-f3ba-4d08-9402-a05503334982 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:58.724970 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954544b-f3ba-4d08-9402-a05503334982 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:58.725252 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954544b-f3ba-4d08-9402-a05503334982 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:58.729968 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a608b9-7f52-4e74-a104-26a2378fdf30 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:58.741337 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fdc52-c2f4-4fbc-b2a5-da5b4e0c49fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:58.742956 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fdc52-c2f4-4fbc-b2a5-da5b4e0c49fb admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:58.743253 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fdc52-c2f4-4fbc-b2a5-da5b4e0c49fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:58.743530 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fdc52-c2f4-4fbc-b2a5-da5b4e0c49fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:58.745233 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0954544b-f3ba-4d08-9402-a05503334982 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:58.758319 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-0954544b-f3ba-4d08-9402-a05503334982 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 02:17:58.760589 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 255/515] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:17:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:58.761657 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fdc52-c2f4-4fbc-b2a5-da5b4e0c49fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:58.763466 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fdc52-c2f4-4fbc-b2a5-da5b4e0c49fb admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:58.766940 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954544b-f3ba-4d08-9402-a05503334982 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:58.780698 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 261/516] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:17:58.782409 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954544b-f3ba-4d08-9402-a05503334982 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:58.787689 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0505da-7daf-41c0-bd17-359cb834b4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:58.788354 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0505da-7daf-41c0-bd17-359cb834b4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:58.788683 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0505da-7daf-41c0-bd17-359cb834b4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:58.789846 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fdc52-c2f4-4fbc-b2a5-da5b4e0c49fb admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:58.794074 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0505da-7daf-41c0-bd17-359cb834b4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:58.797014 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0505da-7daf-41c0-bd17-359cb834b4f5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:58.797331 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0505da-7daf-41c0-bd17-359cb834b4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:58.799173 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0505da-7daf-41c0-bd17-359cb834b4f5 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:58.802676 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fdc52-c2f4-4fbc-b2a5-da5b4e0c49fb admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:58.811998 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b05502-6769-46ad-8f25-6e10264c6e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:58.812836 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b05502-6769-46ad-8f25-6e10264c6e5c admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:58.813142 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b05502-6769-46ad-8f25-6e10264c6e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:58.813416 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b05502-6769-46ad-8f25-6e10264c6e5c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:58.820727 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 256/517] 10.222.0.32 () {56 vars in 1125 bytes} [Wed Sep 15 02:17:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:58.825144 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0505da-7daf-41c0-bd17-359cb834b4f5 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:58.833681 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b05502-6769-46ad-8f25-6e10264c6e5c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:58.836853 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b05502-6769-46ad-8f25-6e10264c6e5c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:58.839412 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0505da-7daf-41c0-bd17-359cb834b4f5 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:58.847932 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95488bd-9ef1-4f30-8a79-758e6af9796c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:58.848732 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95488bd-9ef1-4f30-8a79-758e6af9796c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:58.849051 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95488bd-9ef1-4f30-8a79-758e6af9796c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:58.849332 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95488bd-9ef1-4f30-8a79-758e6af9796c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:58.859551 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-b5b05502-6769-46ad-8f25-6e10264c6e5c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:58.861357 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 262/518] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:17:58.868457 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b05502-6769-46ad-8f25-6e10264c6e5c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:58.873311 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95488bd-9ef1-4f30-8a79-758e6af9796c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:58.877490 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95488bd-9ef1-4f30-8a79-758e6af9796c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:58.888923 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b05502-6769-46ad-8f25-6e10264c6e5c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:58.900100 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f44651-9410-4db7-aaa5-813038f3a140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:58.902460 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f44651-9410-4db7-aaa5-813038f3a140 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:58.903026 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f44651-9410-4db7-aaa5-813038f3a140 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:58.903472 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f44651-9410-4db7-aaa5-813038f3a140 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:58.905080 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f44651-9410-4db7-aaa5-813038f3a140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:58.906320 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f44651-9410-4db7-aaa5-813038f3a140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:58.909734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f44651-9410-4db7-aaa5-813038f3a140 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:58.914807 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-d95488bd-9ef1-4f30-8a79-758e6af9796c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:58.916154 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 257/519] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:17:58.922389 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95488bd-9ef1-4f30-8a79-758e6af9796c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:58.926409 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 263/520] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:58.934716 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95488bd-9ef1-4f30-8a79-758e6af9796c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:58.935888 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f44651-9410-4db7-aaa5-813038f3a140 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:58.946875 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66837a53-5464-46ec-812b-9f50baa4ed78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:58.947836 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66837a53-5464-46ec-812b-9f50baa4ed78 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:58.948315 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66837a53-5464-46ec-812b-9f50baa4ed78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:58.948787 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66837a53-5464-46ec-812b-9f50baa4ed78 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:58.949755 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66837a53-5464-46ec-812b-9f50baa4ed78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:58.950256 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66837a53-5464-46ec-812b-9f50baa4ed78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:58.952046 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66837a53-5464-46ec-812b-9f50baa4ed78 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:58.954380 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f44651-9410-4db7-aaa5-813038f3a140 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:58.967014 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb1ce6-c64c-4d98-ab4b-95fd81cdd428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:58.968160 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb1ce6-c64c-4d98-ab4b-95fd81cdd428 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:58.968642 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb1ce6-c64c-4d98-ab4b-95fd81cdd428 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:58.969146 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb1ce6-c64c-4d98-ab4b-95fd81cdd428 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:58.974604 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 258/521] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:58.980544 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66837a53-5464-46ec-812b-9f50baa4ed78 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:58.981956 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb1ce6-c64c-4d98-ab4b-95fd81cdd428 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:58.985323 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb1ce6-c64c-4d98-ab4b-95fd81cdd428 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:58.992365 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66837a53-5464-46ec-812b-9f50baa4ed78 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:58.997562 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f9021-fa42-4b50-9a34-ad24f4697cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:58.998594 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f9021-fa42-4b50-9a34-ad24f4697cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:58.999098 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f9021-fa42-4b50-9a34-ad24f4697cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:58.999568 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f9021-fa42-4b50-9a34-ad24f4697cf4 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.000425 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-5ddb1ce6-c64c-4d98-ab4b-95fd81cdd428 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:17:59.007111 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 264/522] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:59.008358 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f9021-fa42-4b50-9a34-ad24f4697cf4 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.008480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ec622-ddab-4fcf-a3ec-2a7ad0559693 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.008766 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ec622-ddab-4fcf-a3ec-2a7ad0559693 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.009090 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ec622-ddab-4fcf-a3ec-2a7ad0559693 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.010811 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 265/523] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:59.011350 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f9021-fa42-4b50-9a34-ad24f4697cf4 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.011534 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ec622-ddab-4fcf-a3ec-2a7ad0559693 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.027274 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-c59f9021-fa42-4b50-9a34-ad24f4697cf4 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 02:17:59.029410 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 259/524] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:58 2021] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:17:59.030868 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc515d-bd21-490e-9a1c-9f935d56c7fc None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.031262 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ec622-ddab-4fcf-a3ec-2a7ad0559693 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.031589 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc515d-bd21-490e-9a1c-9f935d56c7fc None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.032059 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc515d-bd21-490e-9a1c-9f935d56c7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.037144 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7bad2-d4c0-42bf-a519-ae069a3c5e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.037939 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7bad2-d4c0-42bf-a519-ae069a3c5e8f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.038229 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7bad2-d4c0-42bf-a519-ae069a3c5e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.038510 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7bad2-d4c0-42bf-a519-ae069a3c5e8f admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.039374 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7bad2-d4c0-42bf-a519-ae069a3c5e8f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:59.039693 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7bad2-d4c0-42bf-a519-ae069a3c5e8f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.041692 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7bad2-d4c0-42bf-a519-ae069a3c5e8f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.054293 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-3ebc515d-bd21-490e-9a1c-9f935d56c7fc None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:59.055777 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-3ebc515d-bd21-490e-9a1c-9f935d56c7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:59.056959 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 266/525] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:59.058016 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7bad2-d4c0-42bf-a519-ae069a3c5e8f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.068908 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 260/526] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:59.069989 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc515d-bd21-490e-9a1c-9f935d56c7fc None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.079316 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7bad2-d4c0-42bf-a519-ae069a3c5e8f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.080074 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc515d-bd21-490e-9a1c-9f935d56c7fc None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.086195 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e763c9-a28d-4277-9185-0a70da9d2e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.087720 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e763c9-a28d-4277-9185-0a70da9d2e13 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.088494 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb159f1c-5fff-4f10-bda0-e9be3735b1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.089095 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e763c9-a28d-4277-9185-0a70da9d2e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.089851 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e763c9-a28d-4277-9185-0a70da9d2e13 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.090520 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb159f1c-5fff-4f10-bda0-e9be3735b1ac admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.091662 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb159f1c-5fff-4f10-bda0-e9be3735b1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.092221 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb159f1c-5fff-4f10-bda0-e9be3735b1ac admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.092754 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e763c9-a28d-4277-9185-0a70da9d2e13 admin admin] RBAC: Adding query filter params (role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=797b76e6f16d428198e7f7f05c9c0fd3) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:59.093509 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e763c9-a28d-4277-9185-0a70da9d2e13 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.094422 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb159f1c-5fff-4f10-bda0-e9be3735b1ac admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:59.096090 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb159f1c-5fff-4f10-bda0-e9be3735b1ac admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.097862 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e763c9-a28d-4277-9185-0a70da9d2e13 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.101355 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb159f1c-5fff-4f10-bda0-e9be3735b1ac admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.107035 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 261/527] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/role_assignments?user.id=797b76e6f16d428198e7f7f05c9c0fd3&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:59.112931 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e763c9-a28d-4277-9185-0a70da9d2e13 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.130608 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e763c9-a28d-4277-9185-0a70da9d2e13 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.135402 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 267/528] 10.222.0.32 () {56 vars in 1159 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:59.139002 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16884b1c-2bb7-4278-8361-4e851e1e19df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.139822 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16884b1c-2bb7-4278-8361-4e851e1e19df admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.140109 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16884b1c-2bb7-4278-8361-4e851e1e19df admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.140388 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16884b1c-2bb7-4278-8361-4e851e1e19df admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.141967 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb159f1c-5fff-4f10-bda0-e9be3735b1ac admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.160157 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb159f1c-5fff-4f10-bda0-e9be3735b1ac admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.166299 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16884b1c-2bb7-4278-8361-4e851e1e19df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:59.174015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-16884b1c-2bb7-4278-8361-4e851e1e19df admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 02:17:59.175610 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 262/529] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:59.184024 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e00af-dca8-45dd-bf51-67de7028d8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.184703 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e00af-dca8-45dd-bf51-67de7028d8ad admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.185103 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e00af-dca8-45dd-bf51-67de7028d8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.185428 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e00af-dca8-45dd-bf51-67de7028d8ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.192185 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16884b1c-2bb7-4278-8361-4e851e1e19df admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.202174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e00af-dca8-45dd-bf51-67de7028d8ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.204393 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e00af-dca8-45dd-bf51-67de7028d8ad admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.213053 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16884b1c-2bb7-4278-8361-4e851e1e19df admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.221748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 268/530] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:59.223015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50eeea-3ff7-46c1-88bb-d42f07fcbd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.223696 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50eeea-3ff7-46c1-88bb-d42f07fcbd18 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.223983 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50eeea-3ff7-46c1-88bb-d42f07fcbd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.224260 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50eeea-3ff7-46c1-88bb-d42f07fcbd18 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.225096 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50eeea-3ff7-46c1-88bb-d42f07fcbd18 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:59.225419 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50eeea-3ff7-46c1-88bb-d42f07fcbd18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.227184 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50eeea-3ff7-46c1-88bb-d42f07fcbd18 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.229628 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e00af-dca8-45dd-bf51-67de7028d8ad admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.244322 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e00af-dca8-45dd-bf51-67de7028d8ad admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.248481 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 263/531] 10.222.0.32 () {56 vars in 1125 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:59.251372 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae9ea9-f0f6-4336-990f-aa81c9935777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.252172 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae9ea9-f0f6-4336-990f-aa81c9935777 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.252456 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae9ea9-f0f6-4336-990f-aa81c9935777 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.252795 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae9ea9-f0f6-4336-990f-aa81c9935777 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.254854 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50eeea-3ff7-46c1-88bb-d42f07fcbd18 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.270337 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50eeea-3ff7-46c1-88bb-d42f07fcbd18 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.277369 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae9ea9-f0f6-4336-990f-aa81c9935777 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.279261 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae9ea9-f0f6-4336-990f-aa81c9935777 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.280839 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f3da3-f93a-49b7-8831-4f6f8827de91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.281672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f3da3-f93a-49b7-8831-4f6f8827de91 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.281956 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f3da3-f93a-49b7-8831-4f6f8827de91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.282230 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f3da3-f93a-49b7-8831-4f6f8827de91 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.306919 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f3da3-f93a-49b7-8831-4f6f8827de91 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.308109 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f3da3-f93a-49b7-8831-4f6f8827de91 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.313645 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-60ae9ea9-f0f6-4336-990f-aa81c9935777 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:59.315092 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 269/532] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:59.321833 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae9ea9-f0f6-4336-990f-aa81c9935777 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.330060 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-821f3da3-f93a-49b7-8831-4f6f8827de91 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:59.332146 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 264/533] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:17:59.337112 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae9ea9-f0f6-4336-990f-aa81c9935777 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.339121 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f3da3-f93a-49b7-8831-4f6f8827de91 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.341201 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91f6c1-8bc8-42e5-97fc-17d787354031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.341886 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91f6c1-8bc8-42e5-97fc-17d787354031 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.342184 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91f6c1-8bc8-42e5-97fc-17d787354031 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.342454 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91f6c1-8bc8-42e5-97fc-17d787354031 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.343201 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91f6c1-8bc8-42e5-97fc-17d787354031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:59.343514 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91f6c1-8bc8-42e5-97fc-17d787354031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.345239 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91f6c1-8bc8-42e5-97fc-17d787354031 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.352409 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f3da3-f93a-49b7-8831-4f6f8827de91 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.357700 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32406131-5b1c-4221-be70-a00841668621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.358708 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32406131-5b1c-4221-be70-a00841668621 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.359249 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32406131-5b1c-4221-be70-a00841668621 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.359721 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32406131-5b1c-4221-be70-a00841668621 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.359824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 270/534] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:59.360746 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32406131-5b1c-4221-be70-a00841668621 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:59.361354 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32406131-5b1c-4221-be70-a00841668621 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.364084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32406131-5b1c-4221-be70-a00841668621 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.366625 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91f6c1-8bc8-42e5-97fc-17d787354031 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.378602 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 265/535] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:59.378940 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91f6c1-8bc8-42e5-97fc-17d787354031 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.385037 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606666ca-a559-4b68-bde4-043b4843e7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.385771 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32406131-5b1c-4221-be70-a00841668621 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.385882 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606666ca-a559-4b68-bde4-043b4843e7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.386118 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606666ca-a559-4b68-bde4-043b4843e7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.386392 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606666ca-a559-4b68-bde4-043b4843e7f3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.397618 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606666ca-a559-4b68-bde4-043b4843e7f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.400138 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606666ca-a559-4b68-bde4-043b4843e7f3 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.404036 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32406131-5b1c-4221-be70-a00841668621 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.410210 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d382ef3-67bf-4a1b-95fd-6d9dbcabaa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.411032 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d382ef3-67bf-4a1b-95fd-6d9dbcabaa68 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.411320 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d382ef3-67bf-4a1b-95fd-6d9dbcabaa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.411598 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d382ef3-67bf-4a1b-95fd-6d9dbcabaa68 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.417476 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-606666ca-a559-4b68-bde4-043b4843e7f3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:17:59.419406 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 271/536] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:59.425638 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8d81f-3a74-4489-a076-3692243c60f3 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.425899 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8d81f-3a74-4489-a076-3692243c60f3 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.426701 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8d81f-3a74-4489-a076-3692243c60f3 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.426806 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d382ef3-67bf-4a1b-95fd-6d9dbcabaa68 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.428766 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d382ef3-67bf-4a1b-95fd-6d9dbcabaa68 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.430786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 272/537] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:59.431605 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8d81f-3a74-4489-a076-3692243c60f3 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.444110 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-8d382ef3-67bf-4a1b-95fd-6d9dbcabaa68 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 02:17:59.448942 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 266/538] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/users/glance => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:17:59.448942 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de6aa1-695c-47e8-b1a7-6012699caa8d None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.448942 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de6aa1-695c-47e8-b1a7-6012699caa8d None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.448942 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de6aa1-695c-47e8-b1a7-6012699caa8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.453074 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8d81f-3a74-4489-a076-3692243c60f3 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.457808 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc56dbc-544f-4f17-906a-44e841bffa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.458529 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc56dbc-544f-4f17-906a-44e841bffa66 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.458849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc56dbc-544f-4f17-906a-44e841bffa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.459174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc56dbc-544f-4f17-906a-44e841bffa66 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.459963 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc56dbc-544f-4f17-906a-44e841bffa66 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:59.460625 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc56dbc-544f-4f17-906a-44e841bffa66 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.462299 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc56dbc-544f-4f17-906a-44e841bffa66 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.469289 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-c7de6aa1-695c-47e8-b1a7-6012699caa8d None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:59.470536 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c7de6aa1-695c-47e8-b1a7-6012699caa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:59.476392 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 273/539] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:59.480965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc56dbc-544f-4f17-906a-44e841bffa66 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.489223 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 267/540] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:59.490293 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de6aa1-695c-47e8-b1a7-6012699caa8d None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.492852 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc56dbc-544f-4f17-906a-44e841bffa66 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.497575 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e7453-25e1-4f16-ab3c-25df09f3557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.498303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e7453-25e1-4f16-ab3c-25df09f3557b admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.498639 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e7453-25e1-4f16-ab3c-25df09f3557b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.498945 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e7453-25e1-4f16-ab3c-25df09f3557b admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.499899 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e7453-25e1-4f16-ab3c-25df09f3557b admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:59.500210 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e7453-25e1-4f16-ab3c-25df09f3557b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.502183 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de6aa1-695c-47e8-b1a7-6012699caa8d None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.502293 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e7453-25e1-4f16-ab3c-25df09f3557b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.508194 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053b142-a408-4460-ace7-2137b520917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.508843 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053b142-a408-4460-ace7-2137b520917a admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.509215 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053b142-a408-4460-ace7-2137b520917a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.509491 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053b142-a408-4460-ace7-2137b520917a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.510320 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053b142-a408-4460-ace7-2137b520917a admin admin] RBAC: Adding query filter params (role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=e0c01428860e44fe9d0b15886add165f) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:59.510807 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053b142-a408-4460-ace7-2137b520917a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.512641 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053b142-a408-4460-ace7-2137b520917a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.519202 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 268/541] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/role_assignments?user.id=e0c01428860e44fe9d0b15886add165f&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:59.520323 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6e3f0-9637-4f69-8a54-993e0ed5ff66 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.520612 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6e3f0-9637-4f69-8a54-993e0ed5ff66 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.521924 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6e3f0-9637-4f69-8a54-993e0ed5ff66 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.522681 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 274/542] 10.222.0.32 () {56 vars in 1159 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:59.523316 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 269/543] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:17:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:17:59.523892 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e7453-25e1-4f16-ab3c-25df09f3557b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.529215 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6e3f0-9637-4f69-8a54-993e0ed5ff66 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.537836 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e7453-25e1-4f16-ab3c-25df09f3557b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.543141 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e3a5f-fd53-4d84-aa5c-a141815e8a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.544073 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e3a5f-fd53-4d84-aa5c-a141815e8a18 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.544428 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e3a5f-fd53-4d84-aa5c-a141815e8a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.544790 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e3a5f-fd53-4d84-aa5c-a141815e8a18 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.544988 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6e3f0-9637-4f69-8a54-993e0ed5ff66 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.551905 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac443f1f-8d7d-4420-aba8-4c151d9beea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.552578 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac443f1f-8d7d-4420-aba8-4c151d9beea6 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.552861 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac443f1f-8d7d-4420-aba8-4c151d9beea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.553170 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac443f1f-8d7d-4420-aba8-4c151d9beea6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.560740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e3a5f-fd53-4d84-aa5c-a141815e8a18 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:59.562338 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac443f1f-8d7d-4420-aba8-4c151d9beea6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.564110 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac443f1f-8d7d-4420-aba8-4c151d9beea6 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.568072 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-f61e3a5f-fd53-4d84-aa5c-a141815e8a18 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 02:17:59.569470 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 275/544] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:59.575306 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 270/545] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:17:59.577259 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7610cf-5800-41e0-b6d9-a9e488ede142 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.577259 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7610cf-5800-41e0-b6d9-a9e488ede142 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.577259 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7610cf-5800-41e0-b6d9-a9e488ede142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.580145 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac443f1f-8d7d-4420-aba8-4c151d9beea6 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.590267 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac443f1f-8d7d-4420-aba8-4c151d9beea6 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.595086 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a891be-bfa9-4fa0-922a-ec536dcd0127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.595776 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a891be-bfa9-4fa0-922a-ec536dcd0127 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.596064 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a891be-bfa9-4fa0-922a-ec536dcd0127 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.596341 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a891be-bfa9-4fa0-922a-ec536dcd0127 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.597166 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-2c7610cf-5800-41e0-b6d9-a9e488ede142 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:17:59.597735 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a891be-bfa9-4fa0-922a-ec536dcd0127 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:59.598050 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a891be-bfa9-4fa0-922a-ec536dcd0127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.598405 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-2c7610cf-5800-41e0-b6d9-a9e488ede142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:17:59.599671 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a891be-bfa9-4fa0-922a-ec536dcd0127 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.606420 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 276/546] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:17:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:17:59.607470 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7610cf-5800-41e0-b6d9-a9e488ede142 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.615594 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 271/547] 10.222.0.32 () {56 vars in 1125 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:59.618209 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7610cf-5800-41e0-b6d9-a9e488ede142 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.622350 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a891be-bfa9-4fa0-922a-ec536dcd0127 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.623284 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fb05d-b43e-4b0d-ab3a-1fbc89e67f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.624156 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fb05d-b43e-4b0d-ab3a-1fbc89e67f90 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.624531 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fb05d-b43e-4b0d-ab3a-1fbc89e67f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.624903 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fb05d-b43e-4b0d-ab3a-1fbc89e67f90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.636555 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fb05d-b43e-4b0d-ab3a-1fbc89e67f90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.638552 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fb05d-b43e-4b0d-ab3a-1fbc89e67f90 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.640570 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a891be-bfa9-4fa0-922a-ec536dcd0127 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.652409 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10635774-56c8-4dbf-9c50-a2cf9f31a5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.653271 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10635774-56c8-4dbf-9c50-a2cf9f31a5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.653580 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10635774-56c8-4dbf-9c50-a2cf9f31a5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.653839 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10635774-56c8-4dbf-9c50-a2cf9f31a5e2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.657210 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-b98fb05d-b43e-4b0d-ab3a-1fbc89e67f90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:59.659492 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 277/548] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:59.660963 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fb05d-b43e-4b0d-ab3a-1fbc89e67f90 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.670773 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fb05d-b43e-4b0d-ab3a-1fbc89e67f90 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.674234 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10635774-56c8-4dbf-9c50-a2cf9f31a5e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.677111 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0f048-5f1b-4bd1-9ad2-92ccbc33c567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.677497 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10635774-56c8-4dbf-9c50-a2cf9f31a5e2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.678094 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0f048-5f1b-4bd1-9ad2-92ccbc33c567 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.678435 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0f048-5f1b-4bd1-9ad2-92ccbc33c567 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.678780 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0f048-5f1b-4bd1-9ad2-92ccbc33c567 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.692145 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0f048-5f1b-4bd1-9ad2-92ccbc33c567 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:17:59.697062 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-10635774-56c8-4dbf-9c50-a2cf9f31a5e2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:59.698835 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 272/549] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:17:59.699532 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-dbe0f048-5f1b-4bd1-9ad2-92ccbc33c567 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 02:17:59.699636 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10635774-56c8-4dbf-9c50-a2cf9f31a5e2 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.701033 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 278/550] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:59.704437 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0f048-5f1b-4bd1-9ad2-92ccbc33c567 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.713898 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10635774-56c8-4dbf-9c50-a2cf9f31a5e2 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.719255 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de26985-64b3-4538-bdbc-a2726aa103fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.719494 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0f048-5f1b-4bd1-9ad2-92ccbc33c567 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.719919 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de26985-64b3-4538-bdbc-a2726aa103fc admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.720219 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de26985-64b3-4538-bdbc-a2726aa103fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.720480 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de26985-64b3-4538-bdbc-a2726aa103fc admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.721338 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de26985-64b3-4538-bdbc-a2726aa103fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:59.722239 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de26985-64b3-4538-bdbc-a2726aa103fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.724097 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de26985-64b3-4538-bdbc-a2726aa103fc admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.724690 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317aa3fb-0cc2-421d-9b9c-419365312d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.725382 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317aa3fb-0cc2-421d-9b9c-419365312d40 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.725666 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317aa3fb-0cc2-421d-9b9c-419365312d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.725942 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317aa3fb-0cc2-421d-9b9c-419365312d40 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.726676 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317aa3fb-0cc2-421d-9b9c-419365312d40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:59.726978 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317aa3fb-0cc2-421d-9b9c-419365312d40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.728558 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317aa3fb-0cc2-421d-9b9c-419365312d40 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.738647 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 273/551] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:59.739315 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de26985-64b3-4538-bdbc-a2726aa103fc admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.742065 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 279/552] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:17:59.745471 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317aa3fb-0cc2-421d-9b9c-419365312d40 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.750223 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de26985-64b3-4538-bdbc-a2726aa103fc admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.756149 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ce3ea-9250-4d52-912a-ff05adef85c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.757088 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ce3ea-9250-4d52-912a-ff05adef85c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.757304 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317aa3fb-0cc2-421d-9b9c-419365312d40 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.757774 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ce3ea-9250-4d52-912a-ff05adef85c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.758249 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ce3ea-9250-4d52-912a-ff05adef85c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.759180 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ce3ea-9250-4d52-912a-ff05adef85c3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:59.759709 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ce3ea-9250-4d52-912a-ff05adef85c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.761539 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ce3ea-9250-4d52-912a-ff05adef85c3 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.764976 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a012d7-d72b-4bb2-a771-67a37d1eacad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.765765 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a012d7-d72b-4bb2-a771-67a37d1eacad admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.766049 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a012d7-d72b-4bb2-a771-67a37d1eacad admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.766323 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a012d7-d72b-4bb2-a771-67a37d1eacad admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.773853 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 274/553] 10.222.0.32 () {56 vars in 1125 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:59.774754 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ce3ea-9250-4d52-912a-ff05adef85c3 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.778012 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a012d7-d72b-4bb2-a771-67a37d1eacad admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.779990 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a012d7-d72b-4bb2-a771-67a37d1eacad admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.786621 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ce3ea-9250-4d52-912a-ff05adef85c3 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.795029 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-65a012d7-d72b-4bb2-a771-67a37d1eacad admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:17:59.796548 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 280/554] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:17:59.797703 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a012d7-d72b-4bb2-a771-67a37d1eacad admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.805926 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab37368-a1ba-40cf-967b-5ddcf683dde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.806738 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab37368-a1ba-40cf-967b-5ddcf683dde2 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.807178 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab37368-a1ba-40cf-967b-5ddcf683dde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.807590 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab37368-a1ba-40cf-967b-5ddcf683dde2 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.809853 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a012d7-d72b-4bb2-a771-67a37d1eacad admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.814782 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b197114-6471-4608-a440-efb19effd72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.816198 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab37368-a1ba-40cf-967b-5ddcf683dde2 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.816615 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b197114-6471-4608-a440-efb19effd72e admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.817196 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b197114-6471-4608-a440-efb19effd72e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.817698 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b197114-6471-4608-a440-efb19effd72e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.818238 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab37368-a1ba-40cf-967b-5ddcf683dde2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.828660 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b197114-6471-4608-a440-efb19effd72e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.830905 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b197114-6471-4608-a440-efb19effd72e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.835235 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-eab37368-a1ba-40cf-967b-5ddcf683dde2 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 02:17:59.836432 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 275/555] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/users/neutron => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:59.837227 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab37368-a1ba-40cf-967b-5ddcf683dde2 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.848155 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab37368-a1ba-40cf-967b-5ddcf683dde2 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.850679 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-0b197114-6471-4608-a440-efb19effd72e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:17:59.852421 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 281/556] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:59.852817 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29640c9d-cf9c-4b0f-a22e-ebaa619c1f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.853601 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29640c9d-cf9c-4b0f-a22e-ebaa619c1f0b admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.853885 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29640c9d-cf9c-4b0f-a22e-ebaa619c1f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.854138 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b197114-6471-4608-a440-efb19effd72e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.854239 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29640c9d-cf9c-4b0f-a22e-ebaa619c1f0b admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.854985 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29640c9d-cf9c-4b0f-a22e-ebaa619c1f0b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:59.855293 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29640c9d-cf9c-4b0f-a22e-ebaa619c1f0b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.857238 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29640c9d-cf9c-4b0f-a22e-ebaa619c1f0b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.865720 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b197114-6471-4608-a440-efb19effd72e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.870973 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a55d7-fe0a-4e5a-bf28-3cabb182a685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.871481 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 276/557] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:59.872184 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a55d7-fe0a-4e5a-bf28-3cabb182a685 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.872309 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29640c9d-cf9c-4b0f-a22e-ebaa619c1f0b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.872777 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a55d7-fe0a-4e5a-bf28-3cabb182a685 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.873346 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a55d7-fe0a-4e5a-bf28-3cabb182a685 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.874542 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a55d7-fe0a-4e5a-bf28-3cabb182a685 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:59.875047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a55d7-fe0a-4e5a-bf28-3cabb182a685 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.877283 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a55d7-fe0a-4e5a-bf28-3cabb182a685 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.890983 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29640c9d-cf9c-4b0f-a22e-ebaa619c1f0b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.896374 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0b947-c2bd-435e-bec5-3a2e93d20168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.897066 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0b947-c2bd-435e-bec5-3a2e93d20168 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.897359 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0b947-c2bd-435e-bec5-3a2e93d20168 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.897633 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0b947-c2bd-435e-bec5-3a2e93d20168 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.898353 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0b947-c2bd-435e-bec5-3a2e93d20168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:59.898655 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0b947-c2bd-435e-bec5-3a2e93d20168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.899656 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 282/558] 10.222.0.32 () {56 vars in 1161 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:59.900539 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0b947-c2bd-435e-bec5-3a2e93d20168 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.901064 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a55d7-fe0a-4e5a-bf28-3cabb182a685 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.911346 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a55d7-fe0a-4e5a-bf28-3cabb182a685 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.914185 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 277/559] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:59.915089 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0b947-c2bd-435e-bec5-3a2e93d20168 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.917163 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d22424-0f99-42d9-afeb-0b188c348324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.918049 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d22424-0f99-42d9-afeb-0b188c348324 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.918578 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d22424-0f99-42d9-afeb-0b188c348324 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.919183 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d22424-0f99-42d9-afeb-0b188c348324 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.920239 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d22424-0f99-42d9-afeb-0b188c348324 admin admin] RBAC: Adding query filter params (role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=a71d661d14d94fa597aee037599de7a8) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:17:59.920750 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d22424-0f99-42d9-afeb-0b188c348324 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.922997 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d22424-0f99-42d9-afeb-0b188c348324 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.924487 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0b947-c2bd-435e-bec5-3a2e93d20168 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.929944 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5396fc-3138-4eee-a226-d533eff14b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.930486 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 283/560] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/role_assignments?user.id=a71d661d14d94fa597aee037599de7a8&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:17:59.930725 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5396fc-3138-4eee-a226-d533eff14b5c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.930888 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5396fc-3138-4eee-a226-d533eff14b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.931164 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5396fc-3138-4eee-a226-d533eff14b5c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.932040 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d22424-0f99-42d9-afeb-0b188c348324 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.942850 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d22424-0f99-42d9-afeb-0b188c348324 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:17:59.949205 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ebd99-21cb-4064-9420-f3761bc7986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:17:59.950041 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5396fc-3138-4eee-a226-d533eff14b5c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.950659 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ebd99-21cb-4064-9420-f3761bc7986c admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:17:59.951138 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ebd99-21cb-4064-9420-f3761bc7986c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:17:59.951659 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ebd99-21cb-4064-9420-f3761bc7986c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:17:59.951792 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5396fc-3138-4eee-a226-d533eff14b5c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.961027 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ebd99-21cb-4064-9420-f3761bc7986c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:17:59.963508 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ebd99-21cb-4064-9420-f3761bc7986c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:17:59.978678 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 278/561] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:17:59.979462 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-999ebd99-21cb-4064-9420-f3761bc7986c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 02:17:59.981825 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 284/562] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:17:59.990738 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5396fc-3138-4eee-a226-d533eff14b5c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:17:59.991268 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ebd99-21cb-4064-9420-f3761bc7986c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:00.011173 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ebd99-21cb-4064-9420-f3761bc7986c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:00.013483 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5396fc-3138-4eee-a226-d533eff14b5c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:00.016639 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd8c04-6822-44c1-8bae-b47b7a3e5840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:00.017802 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd8c04-6822-44c1-8bae-b47b7a3e5840 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:00.018324 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd8c04-6822-44c1-8bae-b47b7a3e5840 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:00.018846 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd8c04-6822-44c1-8bae-b47b7a3e5840 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:00.031325 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd8c04-6822-44c1-8bae-b47b7a3e5840 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:00.033752 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd8c04-6822-44c1-8bae-b47b7a3e5840 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:00.041987 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14537f5-fb47-4989-b372-06e90da14925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:00.043130 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14537f5-fb47-4989-b372-06e90da14925 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:00.043623 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14537f5-fb47-4989-b372-06e90da14925 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:00.044109 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14537f5-fb47-4989-b372-06e90da14925 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:00.045708 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14537f5-fb47-4989-b372-06e90da14925 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:00.046360 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14537f5-fb47-4989-b372-06e90da14925 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:00.054297 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-74cd8c04-6822-44c1-8bae-b47b7a3e5840 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:00.055853 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 285/563] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:00.060976 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14537f5-fb47-4989-b372-06e90da14925 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:00.062312 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd8c04-6822-44c1-8bae-b47b7a3e5840 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:00.082508 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd8c04-6822-44c1-8bae-b47b7a3e5840 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:00.092192 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c418f5-ac5a-4b3a-b160-6e999b2cb72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:00.092836 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 279/564] 10.222.0.32 () {56 vars in 1157 bytes} [Wed Sep 15 02:17:59 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:00.093406 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c418f5-ac5a-4b3a-b160-6e999b2cb72e admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:00.093891 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c418f5-ac5a-4b3a-b160-6e999b2cb72e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:00.094296 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c418f5-ac5a-4b3a-b160-6e999b2cb72e admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:00.095219 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c418f5-ac5a-4b3a-b160-6e999b2cb72e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:00.095656 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c418f5-ac5a-4b3a-b160-6e999b2cb72e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:00.097547 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c418f5-ac5a-4b3a-b160-6e999b2cb72e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:00.106090 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14537f5-fb47-4989-b372-06e90da14925 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:00.117242 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 286/565] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:00.123174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c418f5-ac5a-4b3a-b160-6e999b2cb72e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:00.134585 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14537f5-fb47-4989-b372-06e90da14925 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:00.142467 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c418f5-ac5a-4b3a-b160-6e999b2cb72e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:00.145174 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb5954-7653-4fb9-9842-80f59759d6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:00.147500 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb5954-7653-4fb9-9842-80f59759d6fb admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:00.148492 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb5954-7653-4fb9-9842-80f59759d6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:00.149221 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb5954-7653-4fb9-9842-80f59759d6fb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:00.153382 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831c5dd-b063-4271-bdf0-86992f2f3f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:00.156326 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831c5dd-b063-4271-bdf0-86992f2f3f79 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:00.161303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831c5dd-b063-4271-bdf0-86992f2f3f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:00.161592 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831c5dd-b063-4271-bdf0-86992f2f3f79 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:00.165557 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb5954-7653-4fb9-9842-80f59759d6fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:00.167694 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb5954-7653-4fb9-9842-80f59759d6fb admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:00.182190 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831c5dd-b063-4271-bdf0-86992f2f3f79 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:00.184184 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831c5dd-b063-4271-bdf0-86992f2f3f79 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:00.187419 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-10cb5954-7653-4fb9-9842-80f59759d6fb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:00.188914 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 280/566] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:00.196030 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb5954-7653-4fb9-9842-80f59759d6fb admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:00.206374 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb5954-7653-4fb9-9842-80f59759d6fb admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:00.215371 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be120949-132a-4d6d-b078-25af6bbbd36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:00.217645 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be120949-132a-4d6d-b078-25af6bbbd36b admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:00.218125 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be120949-132a-4d6d-b078-25af6bbbd36b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:00.218637 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be120949-132a-4d6d-b078-25af6bbbd36b admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:00.221443 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be120949-132a-4d6d-b078-25af6bbbd36b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:00.222026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be120949-132a-4d6d-b078-25af6bbbd36b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:00.222770 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-f831c5dd-b063-4271-bdf0-86992f2f3f79 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:18:00.224609 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 287/567] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:00.226979 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be120949-132a-4d6d-b078-25af6bbbd36b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:00.234404 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831c5dd-b063-4271-bdf0-86992f2f3f79 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:00.244935 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 281/568] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:00.251834 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be120949-132a-4d6d-b078-25af6bbbd36b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:00.254639 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831c5dd-b063-4271-bdf0-86992f2f3f79 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:00.259982 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0327b3-4a93-4e73-aaee-970c805f0216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:00.260715 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0327b3-4a93-4e73-aaee-970c805f0216 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:00.261308 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0327b3-4a93-4e73-aaee-970c805f0216 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:00.261588 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0327b3-4a93-4e73-aaee-970c805f0216 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:00.262381 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0327b3-4a93-4e73-aaee-970c805f0216 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:00.262698 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0327b3-4a93-4e73-aaee-970c805f0216 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:00.263034 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be120949-132a-4d6d-b078-25af6bbbd36b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:00.264541 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0327b3-4a93-4e73-aaee-970c805f0216 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:00.268339 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856549aa-1d88-41c4-b0ee-41fb7cb7495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:00.269135 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856549aa-1d88-41c4-b0ee-41fb7cb7495b admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:00.269412 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856549aa-1d88-41c4-b0ee-41fb7cb7495b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:00.269677 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856549aa-1d88-41c4-b0ee-41fb7cb7495b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:00.279028 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 288/569] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:18:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:00.279389 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856549aa-1d88-41c4-b0ee-41fb7cb7495b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:00.281382 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856549aa-1d88-41c4-b0ee-41fb7cb7495b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:00.288711 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0327b3-4a93-4e73-aaee-970c805f0216 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:00.298458 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-856549aa-1d88-41c4-b0ee-41fb7cb7495b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:18:00.300412 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 282/570] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:18:00.300571 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0327b3-4a93-4e73-aaee-970c805f0216 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:00.305451 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ee297-0138-4f99-a12c-0f198d73ad84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:00.306382 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ee297-0138-4f99-a12c-0f198d73ad84 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:00.306691 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856549aa-1d88-41c4-b0ee-41fb7cb7495b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:00.306797 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ee297-0138-4f99-a12c-0f198d73ad84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:00.307074 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ee297-0138-4f99-a12c-0f198d73ad84 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:00.307910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ee297-0138-4f99-a12c-0f198d73ad84 admin admin] RBAC: Adding query filter params (role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=91566418241b40ab840e1c3bf9e096c9) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:00.308955 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ee297-0138-4f99-a12c-0f198d73ad84 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:00.310899 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ee297-0138-4f99-a12c-0f198d73ad84 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:00.317769 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856549aa-1d88-41c4-b0ee-41fb7cb7495b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:00.319021 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 289/571] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:18:00 2021] GET /identity/v3/role_assignments?user.id=91566418241b40ab840e1c3bf9e096c9&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:00.322718 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1623be-9e1d-4db5-918f-0afd5bc66f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:00.323391 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1623be-9e1d-4db5-918f-0afd5bc66f85 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:00.323673 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1623be-9e1d-4db5-918f-0afd5bc66f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:00.323950 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1623be-9e1d-4db5-918f-0afd5bc66f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:00.325127 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1623be-9e1d-4db5-918f-0afd5bc66f85 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:00.325444 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1623be-9e1d-4db5-918f-0afd5bc66f85 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:00.327408 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1623be-9e1d-4db5-918f-0afd5bc66f85 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:00.340579 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 283/572] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:18:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:00.348390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ee297-0138-4f99-a12c-0f198d73ad84 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:00.358594 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ee297-0138-4f99-a12c-0f198d73ad84 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:00.365989 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77d1ed-5b65-4cac-973f-635168e6ec8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:00.366902 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77d1ed-5b65-4cac-973f-635168e6ec8a admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:00.367178 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77d1ed-5b65-4cac-973f-635168e6ec8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:00.367449 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77d1ed-5b65-4cac-973f-635168e6ec8a admin admin] PATH_INFO: `/v3/projects/083ff2535d794e79a145a076aedeedd4/users/ea510f540b2d47dcb19c8715fd247786/roles/33ed3f5cd26a4ea9a99eb0e09856c1a8` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:00.385353 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77d1ed-5b65-4cac-973f-635168e6ec8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=083ff2535d794e79a145a076aedeedd4, user_id=ea510f540b2d47dcb19c8715fd247786, role_id=33ed3f5cd26a4ea9a99eb0e09856c1a8)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:00.388093 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e77d1ed-5b65-4cac-973f-635168e6ec8a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:00.403963 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 290/573] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:18:00 2021] PUT /identity/v3/projects/083ff2535d794e79a145a076aedeedd4/users/ea510f540b2d47dcb19c8715fd247786/roles/33ed3f5cd26a4ea9a99eb0e09856c1a8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:18:02.059415 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afcb18-f934-4dc8-8925-254b3a7e1d8c None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:02.060132 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afcb18-f934-4dc8-8925-254b3a7e1d8c None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:02.060132 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afcb18-f934-4dc8-8925-254b3a7e1d8c None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:02.061965 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 284/574] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:02.069437 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad755d-938f-4501-abf9-9e3203b32737 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:02.069952 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad755d-938f-4501-abf9-9e3203b32737 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:02.070104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad755d-938f-4501-abf9-9e3203b32737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:02.087080 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-29ad755d-938f-4501-abf9-9e3203b32737 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:02.088254 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-29ad755d-938f-4501-abf9-9e3203b32737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:02.174403 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 291/575] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:02.210302 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afcb18-f934-4dc8-8925-254b3a7e1d8c None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:02.233603 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afcb18-f934-4dc8-8925-254b3a7e1d8c None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:02.241471 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d0294-963a-482c-906f-23cc2a44bd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:02.242296 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d0294-963a-482c-906f-23cc2a44bd02 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:02.242578 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d0294-963a-482c-906f-23cc2a44bd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:02.242855 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d0294-963a-482c-906f-23cc2a44bd02 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:02.243515 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d0294-963a-482c-906f-23cc2a44bd02 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:02.244522 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING py.warnings [None req-493d0294-963a-482c-906f-23cc2a44bd02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:18:02.244522 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: warnings.warn(msg) Sep 15 02:18:02.244522 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: Sep 15 02:18:02.245419 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d0294-963a-482c-906f-23cc2a44bd02 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:02.258724 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-493d0294-963a-482c-906f-23cc2a44bd02 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 02:18:02.260210 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 285/576] 10.222.0.32 () {56 vars in 1151 bytes} [Wed Sep 15 02:18:02 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:02.266319 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad755d-938f-4501-abf9-9e3203b32737 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:02.275860 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad755d-938f-4501-abf9-9e3203b32737 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:02.289081 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb8cd2-f675-4038-9b92-54752647f1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:02.289758 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb8cd2-f675-4038-9b92-54752647f1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:02.290034 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb8cd2-f675-4038-9b92-54752647f1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:02.290303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb8cd2-f675-4038-9b92-54752647f1d1 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:02.291010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb8cd2-f675-4038-9b92-54752647f1d1 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:02.291315 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb8cd2-f675-4038-9b92-54752647f1d1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:02.292326 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING py.warnings [None req-5eeb8cd2-f675-4038-9b92-54752647f1d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:18:02.292326 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: warnings.warn(msg) Sep 15 02:18:02.292326 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: Sep 15 02:18:02.297301 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb8cd2-f675-4038-9b92-54752647f1d1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:02.303139 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 292/577] 10.222.0.32 () {56 vars in 1146 bytes} [Wed Sep 15 02:18:02 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:02.309390 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d0294-963a-482c-906f-23cc2a44bd02 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:02.325953 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d0294-963a-482c-906f-23cc2a44bd02 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:02.328296 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef87bf8-ab85-4ef4-ab7a-2d93a25b1214 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:02.328585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef87bf8-ab85-4ef4-ab7a-2d93a25b1214 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:02.328864 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef87bf8-ab85-4ef4-ab7a-2d93a25b1214 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:02.331405 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 293/578] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:18:02.336054 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e259a-5f39-4ddd-bb78-23cc559c94cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:02.336726 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e259a-5f39-4ddd-bb78-23cc559c94cb admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:02.337036 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e259a-5f39-4ddd-bb78-23cc559c94cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:02.337574 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e259a-5f39-4ddd-bb78-23cc559c94cb admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:02.338292 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e259a-5f39-4ddd-bb78-23cc559c94cb admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:02.338560 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc9a08-e722-4dd4-9724-aeba18309cb0 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:02.338746 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e259a-5f39-4ddd-bb78-23cc559c94cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:02.338905 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc9a08-e722-4dd4-9724-aeba18309cb0 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:02.339102 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc9a08-e722-4dd4-9724-aeba18309cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:02.339596 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING py.warnings [None req-505e259a-5f39-4ddd-bb78-23cc559c94cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:18:02.339596 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: warnings.warn(msg) Sep 15 02:18:02.339596 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: Sep 15 02:18:02.340473 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e259a-5f39-4ddd-bb78-23cc559c94cb admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:02.351598 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 286/579] 10.222.0.32 () {56 vars in 1146 bytes} [Wed Sep 15 02:18:02 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:02.368441 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-d0cc9a08-e722-4dd4-9724-aeba18309cb0 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:02.369701 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d0cc9a08-e722-4dd4-9724-aeba18309cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:02.378959 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 294/580] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:02.420575 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e259a-5f39-4ddd-bb78-23cc559c94cb admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:02.434304 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e259a-5f39-4ddd-bb78-23cc559c94cb admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:02.441750 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f23eb8-0109-4b28-adba-beed161d4f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:02.442587 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f23eb8-0109-4b28-adba-beed161d4f5c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:02.442872 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f23eb8-0109-4b28-adba-beed161d4f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:02.443150 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f23eb8-0109-4b28-adba-beed161d4f5c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:02.457976 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f23eb8-0109-4b28-adba-beed161d4f5c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:18:02.465036 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-65f23eb8-0109-4b28-adba-beed161d4f5c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:18:02.472326 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 287/581] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:18:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:02.478616 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc9a08-e722-4dd4-9724-aeba18309cb0 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:02.495776 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc9a08-e722-4dd4-9724-aeba18309cb0 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:02.504026 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72712654-7454-43e6-bd72-596dc5ae15c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:02.504750 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72712654-7454-43e6-bd72-596dc5ae15c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:02.505053 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72712654-7454-43e6-bd72-596dc5ae15c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:02.505324 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72712654-7454-43e6-bd72-596dc5ae15c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:02.506079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72712654-7454-43e6-bd72-596dc5ae15c8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:02.506382 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72712654-7454-43e6-bd72-596dc5ae15c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:02.508079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72712654-7454-43e6-bd72-596dc5ae15c8 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:02.524301 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 295/582] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:18:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:02.530345 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f23eb8-0109-4b28-adba-beed161d4f5c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:02.546417 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f23eb8-0109-4b28-adba-beed161d4f5c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:02.556135 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d525d-e1c6-4fa7-87ac-05e055dda50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:02.556990 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d525d-e1c6-4fa7-87ac-05e055dda50d admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:02.557277 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d525d-e1c6-4fa7-87ac-05e055dda50d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:02.557552 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d525d-e1c6-4fa7-87ac-05e055dda50d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:02.577264 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d525d-e1c6-4fa7-87ac-05e055dda50d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:02.579050 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d525d-e1c6-4fa7-87ac-05e055dda50d admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:02.605803 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-083d525d-e1c6-4fa7-87ac-05e055dda50d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:02.607308 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 288/583] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:02.613687 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72712654-7454-43e6-bd72-596dc5ae15c8 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:02.623864 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72712654-7454-43e6-bd72-596dc5ae15c8 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:02.632228 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fe4cb-2ee6-4273-b0e2-6bf0e3b01e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:02.632955 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fe4cb-2ee6-4273-b0e2-6bf0e3b01e70 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:02.633237 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fe4cb-2ee6-4273-b0e2-6bf0e3b01e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:02.633563 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fe4cb-2ee6-4273-b0e2-6bf0e3b01e70 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:02.634285 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fe4cb-2ee6-4273-b0e2-6bf0e3b01e70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:02.634587 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fe4cb-2ee6-4273-b0e2-6bf0e3b01e70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:02.637045 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fe4cb-2ee6-4273-b0e2-6bf0e3b01e70 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:02.650738 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 296/584] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:02.656669 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d525d-e1c6-4fa7-87ac-05e055dda50d admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:02.666847 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d525d-e1c6-4fa7-87ac-05e055dda50d admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:02.677119 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac48070-9674-44fe-9742-5085634ad7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:02.677922 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac48070-9674-44fe-9742-5085634ad7ad admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:02.678204 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac48070-9674-44fe-9742-5085634ad7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:02.678477 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac48070-9674-44fe-9742-5085634ad7ad admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:02.691969 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac48070-9674-44fe-9742-5085634ad7ad admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:02.691969 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac48070-9674-44fe-9742-5085634ad7ad admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:02.706978 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-6ac48070-9674-44fe-9742-5085634ad7ad admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 02:18:02.708718 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 289/585] 10.222.0.32 () {56 vars in 1115 bytes} [Wed Sep 15 02:18:02 2021] GET /identity/v3/users/nova => generated 82 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:02.716923 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fe4cb-2ee6-4273-b0e2-6bf0e3b01e70 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:02.726986 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fe4cb-2ee6-4273-b0e2-6bf0e3b01e70 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:02.732110 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade2698-3806-434d-b216-32882bf5cf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:02.732775 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade2698-3806-434d-b216-32882bf5cf0c admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:02.733104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade2698-3806-434d-b216-32882bf5cf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:02.733375 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade2698-3806-434d-b216-32882bf5cf0c admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:02.734225 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade2698-3806-434d-b216-32882bf5cf0c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:02.734534 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade2698-3806-434d-b216-32882bf5cf0c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:02.736378 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade2698-3806-434d-b216-32882bf5cf0c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:02.764471 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 297/586] 10.222.0.32 () {56 vars in 1155 bytes} [Wed Sep 15 02:18:02 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:02.770713 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac48070-9674-44fe-9742-5085634ad7ad admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:02.786772 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac48070-9674-44fe-9742-5085634ad7ad admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:02.792844 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e381b4f-585b-4bd4-9272-6f6c4ab7a0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:02.793789 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e381b4f-585b-4bd4-9272-6f6c4ab7a0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:02.794325 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e381b4f-585b-4bd4-9272-6f6c4ab7a0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:02.794802 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e381b4f-585b-4bd4-9272-6f6c4ab7a0d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:02.808674 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e381b4f-585b-4bd4-9272-6f6c4ab7a0d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:02.810881 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e381b4f-585b-4bd4-9272-6f6c4ab7a0d7 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:02.823575 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 290/587] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:18:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:18:02.829440 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade2698-3806-434d-b216-32882bf5cf0c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:02.842392 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade2698-3806-434d-b216-32882bf5cf0c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:02.847786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d022a-a067-4a6f-adf8-780b7e5ef186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:02.848611 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d022a-a067-4a6f-adf8-780b7e5ef186 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:02.848906 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d022a-a067-4a6f-adf8-780b7e5ef186 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:02.849197 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d022a-a067-4a6f-adf8-780b7e5ef186 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:02.861128 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d022a-a067-4a6f-adf8-780b7e5ef186 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:02.863866 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d022a-a067-4a6f-adf8-780b7e5ef186 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:02.882746 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-1a4d022a-a067-4a6f-adf8-780b7e5ef186 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:02.884318 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 298/588] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:02.890455 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e381b4f-585b-4bd4-9272-6f6c4ab7a0d7 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:02.900099 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e381b4f-585b-4bd4-9272-6f6c4ab7a0d7 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:02.905303 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fdd0e-b666-4673-8e2f-9804d39d9ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:02.905952 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fdd0e-b666-4673-8e2f-9804d39d9ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:02.906277 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fdd0e-b666-4673-8e2f-9804d39d9ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:02.906557 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fdd0e-b666-4673-8e2f-9804d39d9ab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:02.907274 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301fdd0e-b666-4673-8e2f-9804d39d9ab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:02.907577 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301fdd0e-b666-4673-8e2f-9804d39d9ab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:02.909837 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301fdd0e-b666-4673-8e2f-9804d39d9ab0 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:02.923044 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 291/589] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:02.929037 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d022a-a067-4a6f-adf8-780b7e5ef186 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:02.939481 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d022a-a067-4a6f-adf8-780b7e5ef186 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:02.941508 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8228ddf-bcd8-44bd-b555-5cbbd10a9669 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:02.941798 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8228ddf-bcd8-44bd-b555-5cbbd10a9669 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:02.942079 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8228ddf-bcd8-44bd-b555-5cbbd10a9669 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:02.944112 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 292/590] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:02.944447 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c468e2-1451-403e-b9a6-1720e6b4dac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:02.945334 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c468e2-1451-403e-b9a6-1720e6b4dac2 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:02.945616 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c468e2-1451-403e-b9a6-1720e6b4dac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:02.945939 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c468e2-1451-403e-b9a6-1720e6b4dac2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:02.956462 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c468e2-1451-403e-b9a6-1720e6b4dac2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:02.959146 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c468e2-1451-403e-b9a6-1720e6b4dac2 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:02.959304 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473d9cd-4e00-4c40-b23b-e0365c61aa9e None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:02.959562 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473d9cd-4e00-4c40-b23b-e0365c61aa9e None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:02.959843 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473d9cd-4e00-4c40-b23b-e0365c61aa9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:02.974856 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-49c468e2-1451-403e-b9a6-1720e6b4dac2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:18:02.976402 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 299/591] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:02.983627 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c468e2-1451-403e-b9a6-1720e6b4dac2 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:02.995397 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c468e2-1451-403e-b9a6-1720e6b4dac2 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:03.000529 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a6322-5db7-470c-9ee6-37f08cc5c622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:03.000871 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-3473d9cd-4e00-4c40-b23b-e0365c61aa9e None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:03.001243 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a6322-5db7-470c-9ee6-37f08cc5c622 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.001570 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a6322-5db7-470c-9ee6-37f08cc5c622 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.001767 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-3473d9cd-4e00-4c40-b23b-e0365c61aa9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:03.001928 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a6322-5db7-470c-9ee6-37f08cc5c622 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.002904 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a6322-5db7-470c-9ee6-37f08cc5c622 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:03.003258 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a6322-5db7-470c-9ee6-37f08cc5c622 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:03.005571 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a6322-5db7-470c-9ee6-37f08cc5c622 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:03.020391 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 300/592] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:18:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:03.023155 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 293/593] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:03.027178 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a6322-5db7-470c-9ee6-37f08cc5c622 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:03.038345 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a6322-5db7-470c-9ee6-37f08cc5c622 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:03.043132 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58d398-f8bc-4fd3-aaa7-8b30b4a9e8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:03.043837 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58d398-f8bc-4fd3-aaa7-8b30b4a9e8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.044118 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58d398-f8bc-4fd3-aaa7-8b30b4a9e8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.044394 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58d398-f8bc-4fd3-aaa7-8b30b4a9e8d5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.045416 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58d398-f8bc-4fd3-aaa7-8b30b4a9e8d5 admin admin] RBAC: Adding query filter params (role.id=19308d3515f546e9a04e44ae278cd111, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=797b76e6f16d428198e7f7f05c9c0fd3) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:03.045727 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58d398-f8bc-4fd3-aaa7-8b30b4a9e8d5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:03.047719 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58d398-f8bc-4fd3-aaa7-8b30b4a9e8d5 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:03.053496 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cbd73-61cd-45cf-8c1e-da65de3312b2 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.054048 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cbd73-61cd-45cf-8c1e-da65de3312b2 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.054533 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1cbd73-61cd-45cf-8c1e-da65de3312b2 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.054725 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 301/594] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:18:03 2021] GET /identity/v3/role_assignments?user.id=797b76e6f16d428198e7f7f05c9c0fd3&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=19308d3515f546e9a04e44ae278cd111 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:03.056675 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 294/595] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:18:03.064369 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58d398-f8bc-4fd3-aaa7-8b30b4a9e8d5 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:03.065816 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd5918-7be8-459a-805e-c0914f7d6fbf None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.066659 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd5918-7be8-459a-805e-c0914f7d6fbf None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.067159 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd5918-7be8-459a-805e-c0914f7d6fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.076296 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58d398-f8bc-4fd3-aaa7-8b30b4a9e8d5 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:03.081428 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c4a46-eb03-4cf5-af2e-7e28e2318749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:03.082163 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c4a46-eb03-4cf5-af2e-7e28e2318749 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.082493 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c4a46-eb03-4cf5-af2e-7e28e2318749 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.082764 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c4a46-eb03-4cf5-af2e-7e28e2318749 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.096654 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c4a46-eb03-4cf5-af2e-7e28e2318749 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:18:03.101289 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-8dcd5918-7be8-459a-805e-c0914f7d6fbf None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:03.102750 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8dcd5918-7be8-459a-805e-c0914f7d6fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:03.104842 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-c02c4a46-eb03-4cf5-af2e-7e28e2318749 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 02:18:03.106727 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 302/596] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:18:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:03.108149 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31c6b6-12ea-4e0f-836e-7133cc4fd4f6 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.108437 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31c6b6-12ea-4e0f-836e-7133cc4fd4f6 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.108677 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31c6b6-12ea-4e0f-836e-7133cc4fd4f6 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.110640 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 303/597] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:03.113590 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 295/598] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:03.118029 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31c6b6-12ea-4e0f-836e-7133cc4fd4f6 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:03.122144 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf99d5-6176-4bc6-aa30-cc9634043a84 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.122668 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf99d5-6176-4bc6-aa30-cc9634043a84 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.123142 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf99d5-6176-4bc6-aa30-cc9634043a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.132606 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31c6b6-12ea-4e0f-836e-7133cc4fd4f6 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:03.137511 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bae741-fece-4960-b74f-1136b6c0a3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:03.138191 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bae741-fece-4960-b74f-1136b6c0a3ff admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.138469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bae741-fece-4960-b74f-1136b6c0a3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.138743 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bae741-fece-4960-b74f-1136b6c0a3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.140527 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bae741-fece-4960-b74f-1136b6c0a3ff admin admin] RBAC: Adding query filter params (name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:03.140853 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bae741-fece-4960-b74f-1136b6c0a3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:03.142553 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bae741-fece-4960-b74f-1136b6c0a3ff admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:03.152152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 304/599] 10.222.0.32 () {56 vars in 1125 bytes} [Wed Sep 15 02:18:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:03.158480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bae741-fece-4960-b74f-1136b6c0a3ff admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:03.163488 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-2dbf99d5-6176-4bc6-aa30-cc9634043a84 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:03.164797 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-2dbf99d5-6176-4bc6-aa30-cc9634043a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:03.171509 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bae741-fece-4960-b74f-1136b6c0a3ff admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:03.179140 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 296/600] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:03.179140 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf99d5-6176-4bc6-aa30-cc9634043a84 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:03.184354 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd3c87-f7da-46c6-baac-28bd34986265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:03.185515 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd3c87-f7da-46c6-baac-28bd34986265 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.185923 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd3c87-f7da-46c6-baac-28bd34986265 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.186356 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd3c87-f7da-46c6-baac-28bd34986265 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.187145 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd3c87-f7da-46c6-baac-28bd34986265 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:03.188419 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING py.warnings [None req-94cd3c87-f7da-46c6-baac-28bd34986265 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:18:03.188419 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: warnings.warn(msg) Sep 15 02:18:03.188419 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: Sep 15 02:18:03.189618 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd3c87-f7da-46c6-baac-28bd34986265 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:03.193546 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf99d5-6176-4bc6-aa30-cc9634043a84 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:03.205809 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-94cd3c87-f7da-46c6-baac-28bd34986265 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 02:18:03.207355 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a444061-8684-4ba4-b4c9-fec4ad114187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:03.207855 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 305/601] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:03 2021] GET /identity/v3/services/network => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:03.212232 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a444061-8684-4ba4-b4c9-fec4ad114187 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.212232 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a444061-8684-4ba4-b4c9-fec4ad114187 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.212232 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a444061-8684-4ba4-b4c9-fec4ad114187 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.213702 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd3c87-f7da-46c6-baac-28bd34986265 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:03.223814 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a444061-8684-4ba4-b4c9-fec4ad114187 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:03.227116 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a444061-8684-4ba4-b4c9-fec4ad114187 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:03.227650 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd3c87-f7da-46c6-baac-28bd34986265 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:03.233148 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4edff-4423-4a96-9b41-dc9ae11f0d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:03.234194 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4edff-4423-4a96-9b41-dc9ae11f0d78 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.235129 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4edff-4423-4a96-9b41-dc9ae11f0d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.235567 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4edff-4423-4a96-9b41-dc9ae11f0d78 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.247452 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-5a444061-8684-4ba4-b4c9-fec4ad114187 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:03.249239 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 297/602] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:03.250175 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a444061-8684-4ba4-b4c9-fec4ad114187 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:03.250800 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4edff-4423-4a96-9b41-dc9ae11f0d78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:03.253442 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4edff-4423-4a96-9b41-dc9ae11f0d78 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:03.261995 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a444061-8684-4ba4-b4c9-fec4ad114187 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:03.267690 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18744940-37c4-414b-a229-413f68dabe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:03.268502 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18744940-37c4-414b-a229-413f68dabe1d admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.268818 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18744940-37c4-414b-a229-413f68dabe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.269221 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18744940-37c4-414b-a229-413f68dabe1d admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.269963 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18744940-37c4-414b-a229-413f68dabe1d admin admin] RBAC: Adding query filter params (name=network) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:03.270273 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18744940-37c4-414b-a229-413f68dabe1d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:03.271856 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18744940-37c4-414b-a229-413f68dabe1d admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:03.273197 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-2ac4edff-4423-4a96-9b41-dc9ae11f0d78 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:03.274819 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 306/603] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:03.275718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4edff-4423-4a96-9b41-dc9ae11f0d78 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:03.276768 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 298/604] 10.222.0.32 () {56 vars in 1134 bytes} [Wed Sep 15 02:18:03 2021] GET /identity/v3/services?name=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:03.281105 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18744940-37c4-414b-a229-413f68dabe1d admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:03.290758 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4edff-4423-4a96-9b41-dc9ae11f0d78 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:03.291937 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18744940-37c4-414b-a229-413f68dabe1d admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:03.295177 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c4513-7d98-4fcb-9110-da44a2ac7bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:03.295828 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c4513-7d98-4fcb-9110-da44a2ac7bbf admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.296085 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c4513-7d98-4fcb-9110-da44a2ac7bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.296359 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c4513-7d98-4fcb-9110-da44a2ac7bbf admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.297092 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c4513-7d98-4fcb-9110-da44a2ac7bbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:03.297392 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c4513-7d98-4fcb-9110-da44a2ac7bbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:03.298089 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa497004-1692-4c93-b902-b758cfb0e9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:03.298895 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa497004-1692-4c93-b902-b758cfb0e9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.299006 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c4513-7d98-4fcb-9110-da44a2ac7bbf admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:03.299465 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa497004-1692-4c93-b902-b758cfb0e9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.300524 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa497004-1692-4c93-b902-b758cfb0e9d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.301467 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa497004-1692-4c93-b902-b758cfb0e9d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:03.301976 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa497004-1692-4c93-b902-b758cfb0e9d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:03.304943 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa497004-1692-4c93-b902-b758cfb0e9d4 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:03.312216 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 307/605] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:03.313071 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c4513-7d98-4fcb-9110-da44a2ac7bbf admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:03.317892 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 299/606] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:03.318956 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa497004-1692-4c93-b902-b758cfb0e9d4 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:03.322524 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c4513-7d98-4fcb-9110-da44a2ac7bbf admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:03.327731 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037821c-614f-4b66-b9b8-f997e6e2fd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:03.328427 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037821c-614f-4b66-b9b8-f997e6e2fd7d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.328709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037821c-614f-4b66-b9b8-f997e6e2fd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.329034 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037821c-614f-4b66-b9b8-f997e6e2fd7d admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.329785 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037821c-614f-4b66-b9b8-f997e6e2fd7d admin admin] RBAC: Adding query filter params (type=network) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:03.330004 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa497004-1692-4c93-b902-b758cfb0e9d4 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:03.330113 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037821c-614f-4b66-b9b8-f997e6e2fd7d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:03.331907 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037821c-614f-4b66-b9b8-f997e6e2fd7d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:03.334985 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff76507-7219-4d32-a6fd-b89d416880b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:03.335919 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff76507-7219-4d32-a6fd-b89d416880b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.336343 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff76507-7219-4d32-a6fd-b89d416880b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.336759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff76507-7219-4d32-a6fd-b89d416880b9 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.338025 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 308/607] 10.222.0.32 () {56 vars in 1134 bytes} [Wed Sep 15 02:18:03 2021] GET /identity/v3/services?type=network => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:03.344500 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037821c-614f-4b66-b9b8-f997e6e2fd7d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:03.359832 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff76507-7219-4d32-a6fd-b89d416880b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:03.364983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037821c-614f-4b66-b9b8-f997e6e2fd7d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:03.365679 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff76507-7219-4d32-a6fd-b89d416880b9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:03.370341 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0fb0a-f273-4e12-a740-30139820a16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:03.370775 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0fb0a-f273-4e12-a740-30139820a16c admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.371055 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0fb0a-f273-4e12-a740-30139820a16c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.371585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0fb0a-f273-4e12-a740-30139820a16c admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.372348 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0fb0a-f273-4e12-a740-30139820a16c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:03.374455 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0fb0a-f273-4e12-a740-30139820a16c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:03.390866 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-1ff76507-7219-4d32-a6fd-b89d416880b9 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 02:18:03.392667 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 300/608] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:18:03 2021] GET /identity/v3/users/swift => generated 83 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:03.397099 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 309/609] 10.222.0.32 () {60 vars in 1154 bytes} [Wed Sep 15 02:18:03 2021] POST /identity/v3/users => generated 254 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:18:03.398876 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff76507-7219-4d32-a6fd-b89d416880b9 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:03.411657 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff76507-7219-4d32-a6fd-b89d416880b9 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:03.416767 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e451c5-995d-4b33-bfd4-6b9cef9f8681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:03.417524 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e451c5-995d-4b33-bfd4-6b9cef9f8681 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.417896 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e451c5-995d-4b33-bfd4-6b9cef9f8681 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.418220 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e451c5-995d-4b33-bfd4-6b9cef9f8681 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.419092 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e451c5-995d-4b33-bfd4-6b9cef9f8681 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:03.419454 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e451c5-995d-4b33-bfd4-6b9cef9f8681 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:03.421468 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e451c5-995d-4b33-bfd4-6b9cef9f8681 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:03.443436 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 301/610] 10.222.0.32 () {56 vars in 1157 bytes} [Wed Sep 15 02:18:03 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:03.449838 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0fb0a-f273-4e12-a740-30139820a16c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:03.461029 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0fb0a-f273-4e12-a740-30139820a16c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:03.472417 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1ae42-37e3-419c-b409-280277454b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:03.472417 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1ae42-37e3-419c-b409-280277454b0d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.472417 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1ae42-37e3-419c-b409-280277454b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.472417 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1ae42-37e3-419c-b409-280277454b0d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.486502 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1ae42-37e3-419c-b409-280277454b0d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:03.489258 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1ae42-37e3-419c-b409-280277454b0d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:03.499886 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 310/611] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:18:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:18:03.506263 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e451c5-995d-4b33-bfd4-6b9cef9f8681 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:03.519806 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e451c5-995d-4b33-bfd4-6b9cef9f8681 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:03.526486 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68152e9-08df-43fa-9f15-08f4089ed0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:03.527308 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68152e9-08df-43fa-9f15-08f4089ed0ee admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.527649 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68152e9-08df-43fa-9f15-08f4089ed0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.527923 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68152e9-08df-43fa-9f15-08f4089ed0ee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.545417 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68152e9-08df-43fa-9f15-08f4089ed0ee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:03.547392 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68152e9-08df-43fa-9f15-08f4089ed0ee admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:03.569500 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-c68152e9-08df-43fa-9f15-08f4089ed0ee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:03.571066 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 302/612] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:03.577344 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1ae42-37e3-419c-b409-280277454b0d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:03.587139 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1ae42-37e3-419c-b409-280277454b0d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:03.598108 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb503d1-0e03-4069-801b-f1463ac958e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:03.598801 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb503d1-0e03-4069-801b-f1463ac958e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.599083 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb503d1-0e03-4069-801b-f1463ac958e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.599357 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb503d1-0e03-4069-801b-f1463ac958e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.600106 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb503d1-0e03-4069-801b-f1463ac958e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:03.600414 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb503d1-0e03-4069-801b-f1463ac958e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:03.602298 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb503d1-0e03-4069-801b-f1463ac958e9 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:03.617877 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 311/613] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:03.623980 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68152e9-08df-43fa-9f15-08f4089ed0ee admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:03.635108 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68152e9-08df-43fa-9f15-08f4089ed0ee admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:03.639995 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e60c6-8148-4109-8d34-4fd41f7ccd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:03.640850 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e60c6-8148-4109-8d34-4fd41f7ccd19 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.641164 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e60c6-8148-4109-8d34-4fd41f7ccd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.641491 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e60c6-8148-4109-8d34-4fd41f7ccd19 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.649574 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e60c6-8148-4109-8d34-4fd41f7ccd19 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:03.651647 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e60c6-8148-4109-8d34-4fd41f7ccd19 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:03.666584 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-c66e60c6-8148-4109-8d34-4fd41f7ccd19 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:18:03.668083 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 303/614] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:03.674231 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb503d1-0e03-4069-801b-f1463ac958e9 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:03.685261 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb503d1-0e03-4069-801b-f1463ac958e9 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:03.690041 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42c719-57b8-4bab-8327-3a0548ff6987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:03.690760 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42c719-57b8-4bab-8327-3a0548ff6987 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.691048 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42c719-57b8-4bab-8327-3a0548ff6987 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.691332 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42c719-57b8-4bab-8327-3a0548ff6987 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.692181 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42c719-57b8-4bab-8327-3a0548ff6987 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:03.692543 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42c719-57b8-4bab-8327-3a0548ff6987 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:03.694449 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42c719-57b8-4bab-8327-3a0548ff6987 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:03.707476 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 312/615] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:18:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:03.713741 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e60c6-8148-4109-8d34-4fd41f7ccd19 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:03.725928 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e60c6-8148-4109-8d34-4fd41f7ccd19 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:03.730617 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55eba1-7a87-497e-99d3-07c3d4f2f654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:03.731324 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55eba1-7a87-497e-99d3-07c3d4f2f654 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:03.731610 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55eba1-7a87-497e-99d3-07c3d4f2f654 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:03.731887 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55eba1-7a87-497e-99d3-07c3d4f2f654 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:03.732820 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55eba1-7a87-497e-99d3-07c3d4f2f654 admin admin] RBAC: Adding query filter params (role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=ea510f540b2d47dcb19c8715fd247786) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:03.733199 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55eba1-7a87-497e-99d3-07c3d4f2f654 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:03.735250 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55eba1-7a87-497e-99d3-07c3d4f2f654 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:03.742458 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 304/616] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:18:03 2021] GET /identity/v3/role_assignments?user.id=ea510f540b2d47dcb19c8715fd247786&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:05.392422 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37a42f-b429-4dfe-ac07-83d95f9953d4 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:05.392990 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37a42f-b429-4dfe-ac07-83d95f9953d4 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:05.392990 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37a42f-b429-4dfe-ac07-83d95f9953d4 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:05.395192 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 313/617] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:05.403397 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94b1a5-d233-4dc3-8a8c-3678542c1a8c None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:05.403916 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94b1a5-d233-4dc3-8a8c-3678542c1a8c None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:05.404013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94b1a5-d233-4dc3-8a8c-3678542c1a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:05.430426 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-6a94b1a5-d233-4dc3-8a8c-3678542c1a8c None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:05.431656 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-6a94b1a5-d233-4dc3-8a8c-3678542c1a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:05.441860 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 305/618] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:05.479177 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37a42f-b429-4dfe-ac07-83d95f9953d4 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:05.498450 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37a42f-b429-4dfe-ac07-83d95f9953d4 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:05.505204 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9f7a0-af00-48b9-b093-d255fd02b825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:05.506130 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9f7a0-af00-48b9-b093-d255fd02b825 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:05.506238 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9289e-3ae4-40ca-a71e-9d9b2ff2e602 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:05.506521 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9289e-3ae4-40ca-a71e-9d9b2ff2e602 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:05.506803 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9289e-3ae4-40ca-a71e-9d9b2ff2e602 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:05.507178 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9f7a0-af00-48b9-b093-d255fd02b825 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:05.507650 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9f7a0-af00-48b9-b093-d255fd02b825 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:05.508596 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9f7a0-af00-48b9-b093-d255fd02b825 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:05.508814 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 306/619] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:18:05.510038 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING py.warnings [None req-e6f9f7a0-af00-48b9-b093-d255fd02b825 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:18:05.510038 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: warnings.warn(msg) Sep 15 02:18:05.510038 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: Sep 15 02:18:05.511308 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9f7a0-af00-48b9-b093-d255fd02b825 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:05.525399 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e77ba9-28ef-4afd-9087-c7b75a2bc664 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:05.525744 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e77ba9-28ef-4afd-9087-c7b75a2bc664 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:05.526029 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e77ba9-28ef-4afd-9087-c7b75a2bc664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:05.533591 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 314/620] 10.222.0.32 () {60 vars in 1163 bytes} [Wed Sep 15 02:18:05 2021] POST /identity/v3/services => generated 251 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:18:05.550518 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-d5e77ba9-28ef-4afd-9087-c7b75a2bc664 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:05.552044 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-d5e77ba9-28ef-4afd-9087-c7b75a2bc664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:05.582656 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 307/621] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:05 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:05.607787 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9f7a0-af00-48b9-b093-d255fd02b825 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:05.619329 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9f7a0-af00-48b9-b093-d255fd02b825 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:05.624512 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a58de-e949-4b83-ae45-1ec24a3c7eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:05.625576 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a58de-e949-4b83-ae45-1ec24a3c7eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:05.626068 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a58de-e949-4b83-ae45-1ec24a3c7eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:05.626646 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a58de-e949-4b83-ae45-1ec24a3c7eb0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:05.645930 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a58de-e949-4b83-ae45-1ec24a3c7eb0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:18:05.653162 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-452a58de-e949-4b83-ae45-1ec24a3c7eb0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:18:05.654585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 315/622] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:18:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:05.661747 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e77ba9-28ef-4afd-9087-c7b75a2bc664 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:05.671414 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e77ba9-28ef-4afd-9087-c7b75a2bc664 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:05.683789 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb327bf-9354-42db-be99-ea7aa4eef682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:05.684926 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb327bf-9354-42db-be99-ea7aa4eef682 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:05.685479 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb327bf-9354-42db-be99-ea7aa4eef682 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:05.685958 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb327bf-9354-42db-be99-ea7aa4eef682 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:05.686938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb327bf-9354-42db-be99-ea7aa4eef682 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:05.687455 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb327bf-9354-42db-be99-ea7aa4eef682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:05.689317 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb327bf-9354-42db-be99-ea7aa4eef682 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:05.699549 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 308/623] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:18:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:05.706445 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a58de-e949-4b83-ae45-1ec24a3c7eb0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:05.716674 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a58de-e949-4b83-ae45-1ec24a3c7eb0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:05.722370 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ff30a-673d-474e-9305-709794d81f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:05.723627 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ff30a-673d-474e-9305-709794d81f87 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:05.724116 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ff30a-673d-474e-9305-709794d81f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:05.724595 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ff30a-673d-474e-9305-709794d81f87 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:05.737614 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ff30a-673d-474e-9305-709794d81f87 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:05.739986 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ff30a-673d-474e-9305-709794d81f87 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:05.758710 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-d85ff30a-673d-474e-9305-709794d81f87 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:05.760735 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 316/624] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:05.767341 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb327bf-9354-42db-be99-ea7aa4eef682 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:05.778204 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb327bf-9354-42db-be99-ea7aa4eef682 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:05.783425 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff145f-c9ff-4663-929d-c3c308e861ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:05.785097 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff145f-c9ff-4663-929d-c3c308e861ad admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:05.785655 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff145f-c9ff-4663-929d-c3c308e861ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:05.786132 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff145f-c9ff-4663-929d-c3c308e861ad admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:05.787164 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff145f-c9ff-4663-929d-c3c308e861ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:05.787700 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff145f-c9ff-4663-929d-c3c308e861ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:05.789902 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff145f-c9ff-4663-929d-c3c308e861ad admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:05.806388 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 309/625] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:05.813220 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ff30a-673d-474e-9305-709794d81f87 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:05.824589 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ff30a-673d-474e-9305-709794d81f87 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:05.830008 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7105b59-116f-42bd-91c9-67c965bc9eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:05.831248 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7105b59-116f-42bd-91c9-67c965bc9eda admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:05.831778 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7105b59-116f-42bd-91c9-67c965bc9eda admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:05.832250 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7105b59-116f-42bd-91c9-67c965bc9eda admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:05.841419 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7105b59-116f-42bd-91c9-67c965bc9eda admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:05.843766 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7105b59-116f-42bd-91c9-67c965bc9eda admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:05.858397 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-c7105b59-116f-42bd-91c9-67c965bc9eda admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 02:18:05.860193 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 317/626] 10.222.0.32 () {56 vars in 1115 bytes} [Wed Sep 15 02:18:05 2021] GET /identity/v3/users/nova => generated 82 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:05.867482 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff145f-c9ff-4663-929d-c3c308e861ad admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:05.878089 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff145f-c9ff-4663-929d-c3c308e861ad admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:05.883263 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ae020-b959-471a-bcac-088637357165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:05.884222 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ae020-b959-471a-bcac-088637357165 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:05.884711 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ae020-b959-471a-bcac-088637357165 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:05.885262 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ae020-b959-471a-bcac-088637357165 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:05.886341 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ae020-b959-471a-bcac-088637357165 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:05.886876 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ae020-b959-471a-bcac-088637357165 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:05.889013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ae020-b959-471a-bcac-088637357165 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:05.897763 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a86ce-0e5c-4a71-846d-6eb9ed0ad853 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:05.898028 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a86ce-0e5c-4a71-846d-6eb9ed0ad853 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:05.898256 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a86ce-0e5c-4a71-846d-6eb9ed0ad853 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:05.902877 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 318/627] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:18:05.907890 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c07837-c4e4-45b4-9513-a6e99de94bcd None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:05.908177 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c07837-c4e4-45b4-9513-a6e99de94bcd None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:05.908498 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c07837-c4e4-45b4-9513-a6e99de94bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:05.911604 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 310/628] 10.222.0.32 () {56 vars in 1155 bytes} [Wed Sep 15 02:18:05 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:05.921710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ae020-b959-471a-bcac-088637357165 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:05.931892 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ae020-b959-471a-bcac-088637357165 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:05.937413 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-a2c07837-c4e4-45b4-9513-a6e99de94bcd None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:05.937975 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575e5b7-9501-48e4-a9ee-3f60b9c4b4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:05.938606 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-a2c07837-c4e4-45b4-9513-a6e99de94bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:05.939269 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575e5b7-9501-48e4-a9ee-3f60b9c4b4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:05.939782 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575e5b7-9501-48e4-a9ee-3f60b9c4b4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:05.940229 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575e5b7-9501-48e4-a9ee-3f60b9c4b4e8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:05.948972 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 319/629] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:05 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:05.954739 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575e5b7-9501-48e4-a9ee-3f60b9c4b4e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:05.957387 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575e5b7-9501-48e4-a9ee-3f60b9c4b4e8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:05.973840 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c07837-c4e4-45b4-9513-a6e99de94bcd None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:05.975871 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-c575e5b7-9501-48e4-a9ee-3f60b9c4b4e8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:05.977474 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 311/630] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:05.984391 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575e5b7-9501-48e4-a9ee-3f60b9c4b4e8 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:05.987701 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c07837-c4e4-45b4-9513-a6e99de94bcd None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:05.993262 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ededd3-d53e-4903-b326-e2248534adf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:05.993931 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ededd3-d53e-4903-b326-e2248534adf0 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:05.994211 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ededd3-d53e-4903-b326-e2248534adf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:05.994487 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ededd3-d53e-4903-b326-e2248534adf0 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:05.995902 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ededd3-d53e-4903-b326-e2248534adf0 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:05.998115 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ededd3-d53e-4903-b326-e2248534adf0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:06.001470 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575e5b7-9501-48e4-a9ee-3f60b9c4b4e8 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:06.008860 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80280102-7a31-4ccc-a057-42a343ff50ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:06.009859 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80280102-7a31-4ccc-a057-42a343ff50ad admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:06.010347 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80280102-7a31-4ccc-a057-42a343ff50ad admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:06.010829 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80280102-7a31-4ccc-a057-42a343ff50ad admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:06.011773 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80280102-7a31-4ccc-a057-42a343ff50ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:06.012282 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80280102-7a31-4ccc-a057-42a343ff50ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:06.014245 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80280102-7a31-4ccc-a057-42a343ff50ad admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:06.020903 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 320/631] 10.222.0.32 () {60 vars in 1163 bytes} [Wed Sep 15 02:18:05 2021] POST /identity/v3/services => generated 240 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:18:06.034448 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 312/632] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:06.040723 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ededd3-d53e-4903-b326-e2248534adf0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:06.091053 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ededd3-d53e-4903-b326-e2248534adf0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:06.100638 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9bb2d-d991-4b77-b2ce-b0a4d98df221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:06.101480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9bb2d-d991-4b77-b2ce-b0a4d98df221 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:06.101761 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9bb2d-d991-4b77-b2ce-b0a4d98df221 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:06.102037 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9bb2d-d991-4b77-b2ce-b0a4d98df221 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:06.122334 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9bb2d-d991-4b77-b2ce-b0a4d98df221 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:06.124319 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9bb2d-d991-4b77-b2ce-b0a4d98df221 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:06.147027 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-f6a9bb2d-d991-4b77-b2ce-b0a4d98df221 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:18:06.148721 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 321/633] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:06.155254 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80280102-7a31-4ccc-a057-42a343ff50ad admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:06.177613 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80280102-7a31-4ccc-a057-42a343ff50ad admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:06.185196 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5332d2-04e1-4f20-9b49-9a6bc2f3c85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:06.186243 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5332d2-04e1-4f20-9b49-9a6bc2f3c85f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:06.186774 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5332d2-04e1-4f20-9b49-9a6bc2f3c85f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:06.187232 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5332d2-04e1-4f20-9b49-9a6bc2f3c85f admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:06.188225 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5332d2-04e1-4f20-9b49-9a6bc2f3c85f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:06.188782 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5332d2-04e1-4f20-9b49-9a6bc2f3c85f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:06.191077 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5332d2-04e1-4f20-9b49-9a6bc2f3c85f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:06.213240 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 313/634] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:18:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:06.219780 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9bb2d-d991-4b77-b2ce-b0a4d98df221 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:06.238999 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9bb2d-d991-4b77-b2ce-b0a4d98df221 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:06.243891 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4aa2a-893b-4651-9db7-5e35d3ed9e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:06.244973 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4aa2a-893b-4651-9db7-5e35d3ed9e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:06.245390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4aa2a-893b-4651-9db7-5e35d3ed9e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:06.245802 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4aa2a-893b-4651-9db7-5e35d3ed9e4c admin admin] PATH_INFO: `/v3/projects/083ff2535d794e79a145a076aedeedd4/users/797b76e6f16d428198e7f7f05c9c0fd3/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:06.247920 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4aa2a-893b-4651-9db7-5e35d3ed9e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=083ff2535d794e79a145a076aedeedd4, user_id=797b76e6f16d428198e7f7f05c9c0fd3, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:06.250712 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4aa2a-893b-4651-9db7-5e35d3ed9e4c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:06.266795 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 322/635] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:18:06 2021] PUT /identity/v3/projects/083ff2535d794e79a145a076aedeedd4/users/797b76e6f16d428198e7f7f05c9c0fd3/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:18:06.320691 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1b516-60d2-4204-aa9d-9b92afd8bc7a None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:06.321166 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1b516-60d2-4204-aa9d-9b92afd8bc7a None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:06.321558 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1b516-60d2-4204-aa9d-9b92afd8bc7a None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:06.323792 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 314/636] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:06.332365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed928826-2316-45bb-bf3c-d11f93285a01 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:06.332893 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed928826-2316-45bb-bf3c-d11f93285a01 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:06.333432 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed928826-2316-45bb-bf3c-d11f93285a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:06.356300 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-ed928826-2316-45bb-bf3c-d11f93285a01 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:06.357968 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ed928826-2316-45bb-bf3c-d11f93285a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:06.446831 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 323/637] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:06 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:06.474559 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1b516-60d2-4204-aa9d-9b92afd8bc7a None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:06.494440 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1b516-60d2-4204-aa9d-9b92afd8bc7a None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:06.503650 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02098c2-e139-4d1e-bfe6-121d09e13d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:06.504476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02098c2-e139-4d1e-bfe6-121d09e13d67 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:06.504758 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02098c2-e139-4d1e-bfe6-121d09e13d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:06.505058 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02098c2-e139-4d1e-bfe6-121d09e13d67 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:06.517818 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02098c2-e139-4d1e-bfe6-121d09e13d67 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:18:06.525131 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-d02098c2-e139-4d1e-bfe6-121d09e13d67 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 02:18:06.526829 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 315/638] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:18:06 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:06.533073 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed928826-2316-45bb-bf3c-d11f93285a01 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:06.542572 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed928826-2316-45bb-bf3c-d11f93285a01 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:06.547163 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0a723-fa52-43fb-99ad-d5bd4ad3261c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:06.547827 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0a723-fa52-43fb-99ad-d5bd4ad3261c admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:06.548110 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0a723-fa52-43fb-99ad-d5bd4ad3261c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:06.548389 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0a723-fa52-43fb-99ad-d5bd4ad3261c admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:06.551567 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0a723-fa52-43fb-99ad-d5bd4ad3261c admin admin] RBAC: Adding query filter params (name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:06.551883 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0a723-fa52-43fb-99ad-d5bd4ad3261c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:06.553525 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0a723-fa52-43fb-99ad-d5bd4ad3261c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:06.567542 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 324/639] 10.222.0.32 () {56 vars in 1125 bytes} [Wed Sep 15 02:18:06 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:06.568856 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02098c2-e139-4d1e-bfe6-121d09e13d67 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:06.581333 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02098c2-e139-4d1e-bfe6-121d09e13d67 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:06.588661 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f74503-21c4-4b04-b3e6-808132a07421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:06.589547 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f74503-21c4-4b04-b3e6-808132a07421 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:06.589828 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f74503-21c4-4b04-b3e6-808132a07421 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:06.590104 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f74503-21c4-4b04-b3e6-808132a07421 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:06.602271 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f74503-21c4-4b04-b3e6-808132a07421 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:06.604179 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f74503-21c4-4b04-b3e6-808132a07421 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:06.621861 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-c7f74503-21c4-4b04-b3e6-808132a07421 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:06.623415 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 316/640] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:06.629597 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0a723-fa52-43fb-99ad-d5bd4ad3261c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:06.646443 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0a723-fa52-43fb-99ad-d5bd4ad3261c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:06.657043 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebefa5-3dfd-4726-83ea-ce2c53447245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:06.657894 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebefa5-3dfd-4726-83ea-ce2c53447245 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:06.658322 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebefa5-3dfd-4726-83ea-ce2c53447245 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:06.658804 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebefa5-3dfd-4726-83ea-ce2c53447245 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:06.660162 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebefa5-3dfd-4726-83ea-ce2c53447245 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:06.660631 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebefa5-3dfd-4726-83ea-ce2c53447245 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:06.662396 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebefa5-3dfd-4726-83ea-ce2c53447245 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:06.682056 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 325/641] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:06.688376 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f74503-21c4-4b04-b3e6-808132a07421 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:06.698562 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f74503-21c4-4b04-b3e6-808132a07421 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:06.708813 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad42a9-923c-40d2-8d9e-01d56f130b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:06.709694 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad42a9-923c-40d2-8d9e-01d56f130b0b admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:06.709975 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad42a9-923c-40d2-8d9e-01d56f130b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:06.710240 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad42a9-923c-40d2-8d9e-01d56f130b0b admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:06.718775 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad42a9-923c-40d2-8d9e-01d56f130b0b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:06.720829 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad42a9-923c-40d2-8d9e-01d56f130b0b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:06.735054 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-6fad42a9-923c-40d2-8d9e-01d56f130b0b admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 02:18:06.736776 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 317/642] 10.222.0.32 () {56 vars in 1139 bytes} [Wed Sep 15 02:18:06 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:06.743440 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebefa5-3dfd-4726-83ea-ce2c53447245 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:06.757851 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebefa5-3dfd-4726-83ea-ce2c53447245 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:06.773767 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd5bb1-091a-4489-a914-4e8b5f1496fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:06.774881 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd5bb1-091a-4489-a914-4e8b5f1496fd admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:06.775391 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd5bb1-091a-4489-a914-4e8b5f1496fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:06.775884 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd5bb1-091a-4489-a914-4e8b5f1496fd admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:06.777015 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd5bb1-091a-4489-a914-4e8b5f1496fd admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:06.777554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd5bb1-091a-4489-a914-4e8b5f1496fd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:06.779681 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd5bb1-091a-4489-a914-4e8b5f1496fd admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:06.805786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 326/643] 10.222.0.32 () {56 vars in 1171 bytes} [Wed Sep 15 02:18:06 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:06.812119 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad42a9-923c-40d2-8d9e-01d56f130b0b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:06.822034 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad42a9-923c-40d2-8d9e-01d56f130b0b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:06.826629 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a178509-e8da-4a38-9f83-23af16a08269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:06.827319 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a178509-e8da-4a38-9f83-23af16a08269 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:06.827597 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a178509-e8da-4a38-9f83-23af16a08269 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:06.827870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a178509-e8da-4a38-9f83-23af16a08269 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:06.840380 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a178509-e8da-4a38-9f83-23af16a08269 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:06.842235 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a178509-e8da-4a38-9f83-23af16a08269 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:06.858165 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 318/644] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:18:06 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:18:06.864785 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a178509-e8da-4a38-9f83-23af16a08269 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:06.865479 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e0bcb-398a-4889-9400-9e2e4c7cac36 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:06.865772 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e0bcb-398a-4889-9400-9e2e4c7cac36 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:06.866053 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e0bcb-398a-4889-9400-9e2e4c7cac36 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:06.868074 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 327/645] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:06.875059 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fba68-ef5a-45bd-8ab1-aec8622bf5e4 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:06.875348 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fba68-ef5a-45bd-8ab1-aec8622bf5e4 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:06.875630 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fba68-ef5a-45bd-8ab1-aec8622bf5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:06.878057 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a178509-e8da-4a38-9f83-23af16a08269 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:06.890517 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3210c2d-1d61-4f73-a725-4801b4b811f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:06.891562 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3210c2d-1d61-4f73-a725-4801b4b811f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:06.892056 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3210c2d-1d61-4f73-a725-4801b4b811f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:06.892553 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3210c2d-1d61-4f73-a725-4801b4b811f6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:06.907188 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-771fba68-ef5a-45bd-8ab1-aec8622bf5e4 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:06.910618 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-771fba68-ef5a-45bd-8ab1-aec8622bf5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:06.917872 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3210c2d-1d61-4f73-a725-4801b4b811f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:06.921945 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3210c2d-1d61-4f73-a725-4801b4b811f6 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:06.926168 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 328/646] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:06 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:06.941554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-f3210c2d-1d61-4f73-a725-4801b4b811f6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:06.946412 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 319/647] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:06.949680 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fba68-ef5a-45bd-8ab1-aec8622bf5e4 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:06.959927 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fba68-ef5a-45bd-8ab1-aec8622bf5e4 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:06.965002 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb7456-a5b9-4a8b-97d9-11996b5f6694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:06.965883 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb7456-a5b9-4a8b-97d9-11996b5f6694 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:06.966400 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb7456-a5b9-4a8b-97d9-11996b5f6694 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:06.966895 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb7456-a5b9-4a8b-97d9-11996b5f6694 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:06.967815 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb7456-a5b9-4a8b-97d9-11996b5f6694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:06.968351 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb7456-a5b9-4a8b-97d9-11996b5f6694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:06.970369 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3210c2d-1d61-4f73-a725-4801b4b811f6 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:06.973896 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb7456-a5b9-4a8b-97d9-11996b5f6694 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:06.981366 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3210c2d-1d61-4f73-a725-4801b4b811f6 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:06.992783 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1ceb5-fe7f-42bc-ac0f-d1a226a82b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:06.993865 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1ceb5-fe7f-42bc-ac0f-d1a226a82b70 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:06.994047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 329/648] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:06.997437 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1ceb5-fe7f-42bc-ac0f-d1a226a82b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:06.997963 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1ceb5-fe7f-42bc-ac0f-d1a226a82b70 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:07.002146 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb7456-a5b9-4a8b-97d9-11996b5f6694 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:07.013167 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1ceb5-fe7f-42bc-ac0f-d1a226a82b70 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:18:07.021781 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-6ea1ceb5-fe7f-42bc-ac0f-d1a226a82b70 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:18:07.023250 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb7456-a5b9-4a8b-97d9-11996b5f6694 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:07.023737 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 320/649] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:18:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:18:07.029325 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1ceb5-fe7f-42bc-ac0f-d1a226a82b70 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:07.032838 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356af42-9aac-4203-b43d-0710ed7c18d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:07.035079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356af42-9aac-4203-b43d-0710ed7c18d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:07.035772 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356af42-9aac-4203-b43d-0710ed7c18d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:07.037142 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356af42-9aac-4203-b43d-0710ed7c18d5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:07.046188 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1ceb5-fe7f-42bc-ac0f-d1a226a82b70 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:07.052906 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356af42-9aac-4203-b43d-0710ed7c18d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:07.056985 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356af42-9aac-4203-b43d-0710ed7c18d5 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:07.057788 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28319cc-028d-427b-a672-e94fd4c499c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:07.059106 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28319cc-028d-427b-a672-e94fd4c499c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:07.061120 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28319cc-028d-427b-a672-e94fd4c499c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:07.061610 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28319cc-028d-427b-a672-e94fd4c499c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:07.063691 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28319cc-028d-427b-a672-e94fd4c499c9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:07.064373 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28319cc-028d-427b-a672-e94fd4c499c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:07.067530 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28319cc-028d-427b-a672-e94fd4c499c9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:07.086849 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 321/650] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:18:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:07.088604 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-9356af42-9aac-4203-b43d-0710ed7c18d5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:18:07.089660 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28319cc-028d-427b-a672-e94fd4c499c9 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:07.101037 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 330/651] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:18:07.104183 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356af42-9aac-4203-b43d-0710ed7c18d5 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:07.107783 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28319cc-028d-427b-a672-e94fd4c499c9 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:07.115627 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356af42-9aac-4203-b43d-0710ed7c18d5 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:07.120692 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce8531-e3a7-4ac3-89ea-ec6bdbd53748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:07.121194 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdc3a0-1166-4375-baab-5cdb1a34e86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:07.121554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce8531-e3a7-4ac3-89ea-ec6bdbd53748 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:07.121860 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce8531-e3a7-4ac3-89ea-ec6bdbd53748 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:07.122127 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce8531-e3a7-4ac3-89ea-ec6bdbd53748 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:07.122767 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdc3a0-1166-4375-baab-5cdb1a34e86c admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:07.123362 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdc3a0-1166-4375-baab-5cdb1a34e86c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:07.123839 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdc3a0-1166-4375-baab-5cdb1a34e86c admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:07.125086 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efdc3a0-1166-4375-baab-5cdb1a34e86c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:07.125604 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efdc3a0-1166-4375-baab-5cdb1a34e86c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:07.128351 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efdc3a0-1166-4375-baab-5cdb1a34e86c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:07.141773 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 331/652] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:18:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:07.149653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdc3a0-1166-4375-baab-5cdb1a34e86c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:07.157826 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce8531-e3a7-4ac3-89ea-ec6bdbd53748 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:07.159656 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce8531-e3a7-4ac3-89ea-ec6bdbd53748 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:07.160598 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdc3a0-1166-4375-baab-5cdb1a34e86c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:07.166303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd8d51-95d2-431e-9b8b-2d51741a15bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:07.167708 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd8d51-95d2-431e-9b8b-2d51741a15bc admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:07.168225 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd8d51-95d2-431e-9b8b-2d51741a15bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:07.168709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd8d51-95d2-431e-9b8b-2d51741a15bc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:07.169880 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd8d51-95d2-431e-9b8b-2d51741a15bc admin admin] RBAC: Adding query filter params (role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=a93401007dd64d88af5e41ff08679a28) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:07.170466 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd8d51-95d2-431e-9b8b-2d51741a15bc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:07.172575 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd8d51-95d2-431e-9b8b-2d51741a15bc admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:07.183593 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 332/653] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:18:07 2021] GET /identity/v3/role_assignments?user.id=a93401007dd64d88af5e41ff08679a28&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:07.191468 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-4dce8531-e3a7-4ac3-89ea-ec6bdbd53748 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:07.193027 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 322/654] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:07.199167 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd8d51-95d2-431e-9b8b-2d51741a15bc admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:07.212435 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd8d51-95d2-431e-9b8b-2d51741a15bc admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:07.221427 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e6b0b-9323-4746-8a1c-dcab8d5fc672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:07.222091 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e6b0b-9323-4746-8a1c-dcab8d5fc672 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:07.222372 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e6b0b-9323-4746-8a1c-dcab8d5fc672 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:07.222646 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e6b0b-9323-4746-8a1c-dcab8d5fc672 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:07.223376 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e6b0b-9323-4746-8a1c-dcab8d5fc672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:07.223680 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e6b0b-9323-4746-8a1c-dcab8d5fc672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:07.225301 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e6b0b-9323-4746-8a1c-dcab8d5fc672 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:07.247349 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 333/655] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:07.253736 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce8531-e3a7-4ac3-89ea-ec6bdbd53748 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:07.271702 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce8531-e3a7-4ac3-89ea-ec6bdbd53748 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:07.283183 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657aa69-d9e0-42ac-abd4-c9a967be5213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:07.284485 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657aa69-d9e0-42ac-abd4-c9a967be5213 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:07.285065 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657aa69-d9e0-42ac-abd4-c9a967be5213 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:07.285547 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657aa69-d9e0-42ac-abd4-c9a967be5213 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:07.296435 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657aa69-d9e0-42ac-abd4-c9a967be5213 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:07.298956 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657aa69-d9e0-42ac-abd4-c9a967be5213 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:07.320249 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-f657aa69-d9e0-42ac-abd4-c9a967be5213 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 02:18:07.326180 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 323/656] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:18:07 2021] GET /identity/v3/users/swift => generated 83 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:07.333387 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e6b0b-9323-4746-8a1c-dcab8d5fc672 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:07.351561 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e6b0b-9323-4746-8a1c-dcab8d5fc672 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:07.365724 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3782ee7-7565-4ee1-b362-934b4c39b94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:07.366441 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3782ee7-7565-4ee1-b362-934b4c39b94c admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:07.366724 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3782ee7-7565-4ee1-b362-934b4c39b94c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:07.367007 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3782ee7-7565-4ee1-b362-934b4c39b94c admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:07.367882 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3782ee7-7565-4ee1-b362-934b4c39b94c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:07.368195 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3782ee7-7565-4ee1-b362-934b4c39b94c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:07.370135 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3782ee7-7565-4ee1-b362-934b4c39b94c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:07.393717 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 334/657] 10.222.0.32 () {56 vars in 1157 bytes} [Wed Sep 15 02:18:07 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:07.400054 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657aa69-d9e0-42ac-abd4-c9a967be5213 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:07.417938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657aa69-d9e0-42ac-abd4-c9a967be5213 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:07.425510 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402877d-cbcf-423d-be40-164f1d2b7284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:07.426159 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402877d-cbcf-423d-be40-164f1d2b7284 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:07.426444 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402877d-cbcf-423d-be40-164f1d2b7284 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:07.426722 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402877d-cbcf-423d-be40-164f1d2b7284 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:07.444488 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402877d-cbcf-423d-be40-164f1d2b7284 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:07.446282 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402877d-cbcf-423d-be40-164f1d2b7284 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:07.458609 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 324/658] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:18:07 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:18:07.464581 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3782ee7-7565-4ee1-b362-934b4c39b94c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:07.488310 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3782ee7-7565-4ee1-b362-934b4c39b94c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:07.503187 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e454a4-66ec-4978-b27a-4fe155f8f8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:07.503992 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e454a4-66ec-4978-b27a-4fe155f8f8da admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:07.504266 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e454a4-66ec-4978-b27a-4fe155f8f8da admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:07.504534 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e454a4-66ec-4978-b27a-4fe155f8f8da admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:07.520982 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e454a4-66ec-4978-b27a-4fe155f8f8da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:07.522828 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e454a4-66ec-4978-b27a-4fe155f8f8da admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:07.543857 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-70e454a4-66ec-4978-b27a-4fe155f8f8da admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:07.549207 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 335/659] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:07.554186 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402877d-cbcf-423d-be40-164f1d2b7284 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:07.568267 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402877d-cbcf-423d-be40-164f1d2b7284 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:07.578450 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85d671-476c-425a-bba9-d05137be9cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:07.579121 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85d671-476c-425a-bba9-d05137be9cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:07.579430 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85d671-476c-425a-bba9-d05137be9cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:07.579711 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85d671-476c-425a-bba9-d05137be9cc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:07.580437 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85d671-476c-425a-bba9-d05137be9cc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:07.581414 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85d671-476c-425a-bba9-d05137be9cc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:07.583266 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85d671-476c-425a-bba9-d05137be9cc0 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:07.610053 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 325/660] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:07.616064 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e454a4-66ec-4978-b27a-4fe155f8f8da admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:07.630384 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e454a4-66ec-4978-b27a-4fe155f8f8da admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:07.645613 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90ded1-8140-48c9-99be-19e6a432ebf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:07.646429 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90ded1-8140-48c9-99be-19e6a432ebf9 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:07.646709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90ded1-8140-48c9-99be-19e6a432ebf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:07.646982 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90ded1-8140-48c9-99be-19e6a432ebf9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:07.657978 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90ded1-8140-48c9-99be-19e6a432ebf9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:07.660524 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90ded1-8140-48c9-99be-19e6a432ebf9 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:07.680434 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-fd90ded1-8140-48c9-99be-19e6a432ebf9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:18:07.681974 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 336/661] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:07.688194 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85d671-476c-425a-bba9-d05137be9cc0 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:07.701954 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85d671-476c-425a-bba9-d05137be9cc0 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:07.714059 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688f164-3601-47f9-95d2-087297106271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:07.714793 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688f164-3601-47f9-95d2-087297106271 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:07.715047 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688f164-3601-47f9-95d2-087297106271 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:07.715317 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688f164-3601-47f9-95d2-087297106271 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:07.716112 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688f164-3601-47f9-95d2-087297106271 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:07.716422 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688f164-3601-47f9-95d2-087297106271 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:07.718301 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688f164-3601-47f9-95d2-087297106271 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:07.734269 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 326/662] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:18:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:07.741296 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90ded1-8140-48c9-99be-19e6a432ebf9 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:07.758198 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90ded1-8140-48c9-99be-19e6a432ebf9 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:07.769185 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e15bec-bbba-4ce5-aecc-0febcb81a030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:07.769831 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e15bec-bbba-4ce5-aecc-0febcb81a030 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:07.770117 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e15bec-bbba-4ce5-aecc-0febcb81a030 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:07.770393 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e15bec-bbba-4ce5-aecc-0febcb81a030 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:07.771222 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e15bec-bbba-4ce5-aecc-0febcb81a030 admin admin] RBAC: Adding query filter params (role.id=19308d3515f546e9a04e44ae278cd111, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=ea510f540b2d47dcb19c8715fd247786) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:07.771534 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e15bec-bbba-4ce5-aecc-0febcb81a030 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:07.773413 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e15bec-bbba-4ce5-aecc-0febcb81a030 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:07.785698 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 337/663] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:18:07 2021] GET /identity/v3/role_assignments?user.id=ea510f540b2d47dcb19c8715fd247786&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=19308d3515f546e9a04e44ae278cd111 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:08.522035 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd6c50-2372-4a21-8e4b-ffccca1bb85b None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:08.522397 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd6c50-2372-4a21-8e4b-ffccca1bb85b None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:08.522588 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd6c50-2372-4a21-8e4b-ffccca1bb85b None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:08.524606 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 327/664] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:08.531679 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9089d-914d-454b-9be8-06bf7b8dc1b5 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:08.532147 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9089d-914d-454b-9be8-06bf7b8dc1b5 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:08.532220 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9089d-914d-454b-9be8-06bf7b8dc1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:08.557813 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-9dd9089d-914d-454b-9be8-06bf7b8dc1b5 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:08.559003 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-9dd9089d-914d-454b-9be8-06bf7b8dc1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:08.567827 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 338/665] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:08 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:08.591270 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd6c50-2372-4a21-8e4b-ffccca1bb85b None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:08.612806 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd6c50-2372-4a21-8e4b-ffccca1bb85b None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:08.619827 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35853888-5c53-4ba1-86c9-e2c867f9b863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:08.620636 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35853888-5c53-4ba1-86c9-e2c867f9b863 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:08.620939 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35853888-5c53-4ba1-86c9-e2c867f9b863 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:08.621216 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35853888-5c53-4ba1-86c9-e2c867f9b863 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:08.621873 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35853888-5c53-4ba1-86c9-e2c867f9b863 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:08.623459 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35853888-5c53-4ba1-86c9-e2c867f9b863 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:08.640301 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-35853888-5c53-4ba1-86c9-e2c867f9b863 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 02:18:08.641804 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 328/666] 10.222.0.32 () {56 vars in 1151 bytes} [Wed Sep 15 02:18:08 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:08.648867 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9089d-914d-454b-9be8-06bf7b8dc1b5 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:08.662131 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9089d-914d-454b-9be8-06bf7b8dc1b5 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:08.673149 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7572f-0b2d-4e6a-b0a6-e4d304072c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:08.673826 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7572f-0b2d-4e6a-b0a6-e4d304072c40 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:08.674104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7572f-0b2d-4e6a-b0a6-e4d304072c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:08.674543 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7572f-0b2d-4e6a-b0a6-e4d304072c40 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:08.675222 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7572f-0b2d-4e6a-b0a6-e4d304072c40 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:08.675523 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7572f-0b2d-4e6a-b0a6-e4d304072c40 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:08.677156 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7572f-0b2d-4e6a-b0a6-e4d304072c40 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:08.685076 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 339/667] 10.222.0.32 () {56 vars in 1146 bytes} [Wed Sep 15 02:18:08 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:08.691657 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35853888-5c53-4ba1-86c9-e2c867f9b863 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:08.707066 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35853888-5c53-4ba1-86c9-e2c867f9b863 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:08.717554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238d4e2-f104-4563-a435-7516637866e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:08.718252 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238d4e2-f104-4563-a435-7516637866e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:08.718535 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238d4e2-f104-4563-a435-7516637866e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:08.718809 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238d4e2-f104-4563-a435-7516637866e1 admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:08.719543 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238d4e2-f104-4563-a435-7516637866e1 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:08.719855 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238d4e2-f104-4563-a435-7516637866e1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:08.721572 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238d4e2-f104-4563-a435-7516637866e1 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:08.733307 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 329/668] 10.222.0.32 () {56 vars in 1146 bytes} [Wed Sep 15 02:18:08 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:08.739790 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7572f-0b2d-4e6a-b0a6-e4d304072c40 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:08.754231 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7572f-0b2d-4e6a-b0a6-e4d304072c40 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:08.766530 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea23a7-b81e-4b92-9c20-34383167b19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:08.767199 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea23a7-b81e-4b92-9c20-34383167b19e admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:08.767485 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea23a7-b81e-4b92-9c20-34383167b19e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:08.767765 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea23a7-b81e-4b92-9c20-34383167b19e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:08.769201 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea23a7-b81e-4b92-9c20-34383167b19e admin admin] RBAC: Adding query filter params (interface=public, service_id=f561674909e14cdf82f52f06e61652c1, region_id=RegionOne) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:08.769519 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea23a7-b81e-4b92-9c20-34383167b19e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:08.770564 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING py.warnings [None req-b1ea23a7-b81e-4b92-9c20-34383167b19e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:18:08.770564 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: warnings.warn(msg) Sep 15 02:18:08.770564 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: Sep 15 02:18:08.771480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea23a7-b81e-4b92-9c20-34383167b19e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:08.788242 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 340/669] 10.222.0.32 () {56 vars in 1273 bytes} [Wed Sep 15 02:18:08 2021] GET /identity/v3/endpoints?service_id=f561674909e14cdf82f52f06e61652c1&interface=public®ion_id=RegionOne => generated 194 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:08.793895 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238d4e2-f104-4563-a435-7516637866e1 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:08.803191 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26d501-af7c-48ac-b8f8-143e04aeff63 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:08.803482 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26d501-af7c-48ac-b8f8-143e04aeff63 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:08.803764 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26d501-af7c-48ac-b8f8-143e04aeff63 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:08.805793 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 341/670] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:18:08.806387 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238d4e2-f104-4563-a435-7516637866e1 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:08.812460 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf5e54-d284-481a-ae3b-c83837d4632d None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:08.812829 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf5e54-d284-481a-ae3b-c83837d4632d None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:08.813205 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf5e54-d284-481a-ae3b-c83837d4632d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:08.817506 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6648e-17bc-4ad2-ade4-8a136a4d3698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:08.818182 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6648e-17bc-4ad2-ade4-8a136a4d3698 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:08.818477 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6648e-17bc-4ad2-ade4-8a136a4d3698 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:08.818741 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6648e-17bc-4ad2-ade4-8a136a4d3698 admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:08.819418 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6648e-17bc-4ad2-ade4-8a136a4d3698 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:08.821038 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6648e-17bc-4ad2-ade4-8a136a4d3698 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:08.832297 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 330/671] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Sep 15 02:18:08 2021] GET /identity/v3/services => generated 772 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:08.838965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-24bf5e54-d284-481a-ae3b-c83837d4632d None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:08.840408 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-24bf5e54-d284-481a-ae3b-c83837d4632d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:08.849212 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 342/672] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:08 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:08.874850 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6648e-17bc-4ad2-ade4-8a136a4d3698 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:08.886583 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6648e-17bc-4ad2-ade4-8a136a4d3698 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:08.891718 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7155fcf-f34d-4fe9-8e34-8f664aae3855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:08.892710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7155fcf-f34d-4fe9-8e34-8f664aae3855 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:08.893182 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7155fcf-f34d-4fe9-8e34-8f664aae3855 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:08.893592 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7155fcf-f34d-4fe9-8e34-8f664aae3855 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:08.894403 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7155fcf-f34d-4fe9-8e34-8f664aae3855 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:08.896226 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7155fcf-f34d-4fe9-8e34-8f664aae3855 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:08.908275 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-e7155fcf-f34d-4fe9-8e34-8f664aae3855 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 02:18:08.910243 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 331/673] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:08 2021] GET /identity/v3/services/network => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:08.916919 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf5e54-d284-481a-ae3b-c83837d4632d None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:08.926777 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf5e54-d284-481a-ae3b-c83837d4632d None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:08.931856 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b57269-276f-48ec-bfe8-0370195e9bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:08.932840 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b57269-276f-48ec-bfe8-0370195e9bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:08.933308 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b57269-276f-48ec-bfe8-0370195e9bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:08.933771 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b57269-276f-48ec-bfe8-0370195e9bf0 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:08.934653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b57269-276f-48ec-bfe8-0370195e9bf0 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:08.935185 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b57269-276f-48ec-bfe8-0370195e9bf0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:08.937163 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b57269-276f-48ec-bfe8-0370195e9bf0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:08.943821 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 343/674] 10.222.0.32 () {56 vars in 1134 bytes} [Wed Sep 15 02:18:08 2021] GET /identity/v3/services?name=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:08.950626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7155fcf-f34d-4fe9-8e34-8f664aae3855 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:08.962445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7155fcf-f34d-4fe9-8e34-8f664aae3855 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:08.968620 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2a6f4-b953-4c59-b1a3-2fdc8d063f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:08.969641 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2a6f4-b953-4c59-b1a3-2fdc8d063f0f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:08.970063 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2a6f4-b953-4c59-b1a3-2fdc8d063f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:08.970530 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2a6f4-b953-4c59-b1a3-2fdc8d063f0f admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:08.971500 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2a6f4-b953-4c59-b1a3-2fdc8d063f0f admin admin] RBAC: Adding query filter params (type=network) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:08.972007 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2a6f4-b953-4c59-b1a3-2fdc8d063f0f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:08.973912 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2a6f4-b953-4c59-b1a3-2fdc8d063f0f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:08.980147 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 332/675] 10.222.0.32 () {56 vars in 1134 bytes} [Wed Sep 15 02:18:08 2021] GET /identity/v3/services?type=network => generated 350 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:08.987692 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b57269-276f-48ec-bfe8-0370195e9bf0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:08.998309 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b57269-276f-48ec-bfe8-0370195e9bf0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:09.004139 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6026c-51ae-45c1-9c6b-950c177b200a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:09.005012 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6026c-51ae-45c1-9c6b-950c177b200a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:09.005497 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6026c-51ae-45c1-9c6b-950c177b200a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:09.005948 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6026c-51ae-45c1-9c6b-950c177b200a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:09.006908 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6026c-51ae-45c1-9c6b-950c177b200a admin admin] RBAC: Adding query filter params (interface=public, service_id=e629232115db40fca1cba8d2d48ead2d, region_id=RegionOne) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:09.007373 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6026c-51ae-45c1-9c6b-950c177b200a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:09.009323 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6026c-51ae-45c1-9c6b-950c177b200a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:09.015619 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 344/676] 10.222.0.32 () {56 vars in 1273 bytes} [Wed Sep 15 02:18:08 2021] GET /identity/v3/endpoints?service_id=e629232115db40fca1cba8d2d48ead2d&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:09.022072 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2a6f4-b953-4c59-b1a3-2fdc8d063f0f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:09.032670 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2a6f4-b953-4c59-b1a3-2fdc8d063f0f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:09.037840 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2930c-1c53-4de4-9554-725510262039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:09.038781 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2930c-1c53-4de4-9554-725510262039 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:09.039205 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2930c-1c53-4de4-9554-725510262039 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:09.039701 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2930c-1c53-4de4-9554-725510262039 admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:09.040551 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2930c-1c53-4de4-9554-725510262039 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:09.042419 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2930c-1c53-4de4-9554-725510262039 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:09.048534 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610851d-194b-4967-9c86-fd7fe95f8d57 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:09.049101 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610851d-194b-4967-9c86-fd7fe95f8d57 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:09.050036 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610851d-194b-4967-9c86-fd7fe95f8d57 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:09.052354 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 345/677] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:09.056943 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 333/678] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Sep 15 02:18:09 2021] GET /identity/v3/services => generated 772 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:09.073041 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4044f58-458f-4fbe-8957-8fcf7e78759e None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:09.073623 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4044f58-458f-4fbe-8957-8fcf7e78759e None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:09.074041 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4044f58-458f-4fbe-8957-8fcf7e78759e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:09.102203 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-e4044f58-458f-4fbe-8957-8fcf7e78759e None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:09.103436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-e4044f58-458f-4fbe-8957-8fcf7e78759e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:09.116844 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 346/679] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:09 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:09.155575 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2930c-1c53-4de4-9554-725510262039 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:09.166148 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2930c-1c53-4de4-9554-725510262039 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:09.171242 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6502b7-2524-44e4-b1f2-0219516dedc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:09.172411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6502b7-2524-44e4-b1f2-0219516dedc5 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:09.172947 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6502b7-2524-44e4-b1f2-0219516dedc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:09.173437 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6502b7-2524-44e4-b1f2-0219516dedc5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:09.185871 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6502b7-2524-44e4-b1f2-0219516dedc5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:18:09.193578 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-fb6502b7-2524-44e4-b1f2-0219516dedc5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:18:09.195522 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 334/680] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:18:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:09.202359 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4044f58-458f-4fbe-8957-8fcf7e78759e None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:09.213521 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4044f58-458f-4fbe-8957-8fcf7e78759e None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:09.218725 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaed8eb-428d-492e-9fb1-e448922e3bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:09.219778 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaed8eb-428d-492e-9fb1-e448922e3bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:09.220277 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaed8eb-428d-492e-9fb1-e448922e3bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:09.220763 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaed8eb-428d-492e-9fb1-e448922e3bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:09.221857 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaed8eb-428d-492e-9fb1-e448922e3bd8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:09.222382 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaed8eb-428d-492e-9fb1-e448922e3bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:09.224268 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaed8eb-428d-492e-9fb1-e448922e3bd8 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:09.234074 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 347/681] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:18:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:09.241415 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6502b7-2524-44e4-b1f2-0219516dedc5 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:09.251612 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6502b7-2524-44e4-b1f2-0219516dedc5 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:09.256662 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85487764-ea6a-49c3-a73b-065fe13e573a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:09.257750 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85487764-ea6a-49c3-a73b-065fe13e573a admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:09.258140 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85487764-ea6a-49c3-a73b-065fe13e573a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:09.258526 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85487764-ea6a-49c3-a73b-065fe13e573a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:09.270028 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85487764-ea6a-49c3-a73b-065fe13e573a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:09.272055 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85487764-ea6a-49c3-a73b-065fe13e573a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:09.289539 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-85487764-ea6a-49c3-a73b-065fe13e573a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:09.291236 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 335/682] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:09.297358 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaed8eb-428d-492e-9fb1-e448922e3bd8 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:09.308419 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaed8eb-428d-492e-9fb1-e448922e3bd8 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:09.313097 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ecaa4-b784-4d18-b82b-2275fa9456f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:09.313766 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ecaa4-b784-4d18-b82b-2275fa9456f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:09.314044 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ecaa4-b784-4d18-b82b-2275fa9456f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:09.314319 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ecaa4-b784-4d18-b82b-2275fa9456f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:09.315571 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ecaa4-b784-4d18-b82b-2275fa9456f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:09.315878 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ecaa4-b784-4d18-b82b-2275fa9456f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:09.317534 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ecaa4-b784-4d18-b82b-2275fa9456f8 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:09.334830 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 348/683] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:09.340626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85487764-ea6a-49c3-a73b-065fe13e573a admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:09.350995 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85487764-ea6a-49c3-a73b-065fe13e573a admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:09.360795 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6e1d5-7b51-47de-bc8d-54cd615666e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:09.362232 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6e1d5-7b51-47de-bc8d-54cd615666e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:09.362762 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6e1d5-7b51-47de-bc8d-54cd615666e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:09.363233 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6e1d5-7b51-47de-bc8d-54cd615666e2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:09.377947 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6e1d5-7b51-47de-bc8d-54cd615666e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:09.380449 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac6e1d5-7b51-47de-bc8d-54cd615666e2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:09.401871 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-cac6e1d5-7b51-47de-bc8d-54cd615666e2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 02:18:09.404447 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 336/684] 10.222.0.32 () {56 vars in 1115 bytes} [Wed Sep 15 02:18:09 2021] GET /identity/v3/users/nova => generated 82 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:09.410430 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ecaa4-b784-4d18-b82b-2275fa9456f8 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:09.426567 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ecaa4-b784-4d18-b82b-2275fa9456f8 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:09.441529 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6e487-f17f-480b-84c6-cc064fa2d04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:09.442216 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6e487-f17f-480b-84c6-cc064fa2d04a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:09.442501 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6e487-f17f-480b-84c6-cc064fa2d04a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:09.442775 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6e487-f17f-480b-84c6-cc064fa2d04a admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:09.443617 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6e487-f17f-480b-84c6-cc064fa2d04a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:09.443929 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6e487-f17f-480b-84c6-cc064fa2d04a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:09.445819 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6e487-f17f-480b-84c6-cc064fa2d04a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:09.464338 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 349/685] 10.222.0.32 () {56 vars in 1155 bytes} [Wed Sep 15 02:18:09 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:09.470474 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6e1d5-7b51-47de-bc8d-54cd615666e2 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:09.484638 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6e1d5-7b51-47de-bc8d-54cd615666e2 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:09.493107 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e0c3c-087a-48af-9e29-d5213ed50693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:09.493693 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e0c3c-087a-48af-9e29-d5213ed50693 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:09.493977 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e0c3c-087a-48af-9e29-d5213ed50693 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:09.494265 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e0c3c-087a-48af-9e29-d5213ed50693 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:09.509485 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e0c3c-087a-48af-9e29-d5213ed50693 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:09.511237 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e0c3c-087a-48af-9e29-d5213ed50693 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:09.526401 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 337/686] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:18:09 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:18:09.532523 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6e487-f17f-480b-84c6-cc064fa2d04a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:09.542527 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6e487-f17f-480b-84c6-cc064fa2d04a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:09.552939 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0125f2-002f-4834-abcd-3ea4a6d2627a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:09.553725 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0125f2-002f-4834-abcd-3ea4a6d2627a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:09.554006 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0125f2-002f-4834-abcd-3ea4a6d2627a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:09.554282 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0125f2-002f-4834-abcd-3ea4a6d2627a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:09.571397 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0125f2-002f-4834-abcd-3ea4a6d2627a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:09.573256 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0125f2-002f-4834-abcd-3ea4a6d2627a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:09.597695 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-3b0125f2-002f-4834-abcd-3ea4a6d2627a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:09.603900 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 350/687] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:09.605248 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e0c3c-087a-48af-9e29-d5213ed50693 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:09.614777 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e0c3c-087a-48af-9e29-d5213ed50693 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:09.619343 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6344ca1-afb0-4d20-a635-4a6ae5ab22bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:09.619993 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6344ca1-afb0-4d20-a635-4a6ae5ab22bd admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:09.620274 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6344ca1-afb0-4d20-a635-4a6ae5ab22bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:09.620549 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6344ca1-afb0-4d20-a635-4a6ae5ab22bd admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:09.621294 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6344ca1-afb0-4d20-a635-4a6ae5ab22bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:09.621601 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6344ca1-afb0-4d20-a635-4a6ae5ab22bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:09.623173 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6344ca1-afb0-4d20-a635-4a6ae5ab22bd admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:09.635664 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 338/688] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:09.641740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0125f2-002f-4834-abcd-3ea4a6d2627a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:09.651365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0125f2-002f-4834-abcd-3ea4a6d2627a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:09.655838 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de1a95-c537-4cd9-b757-49eaeeee06c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:09.656615 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de1a95-c537-4cd9-b757-49eaeeee06c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:09.656918 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de1a95-c537-4cd9-b757-49eaeeee06c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:09.657200 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de1a95-c537-4cd9-b757-49eaeeee06c4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:09.663993 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de1a95-c537-4cd9-b757-49eaeeee06c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:09.665943 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de1a95-c537-4cd9-b757-49eaeeee06c4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:09.679131 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-08de1a95-c537-4cd9-b757-49eaeeee06c4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:18:09.680265 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 351/689] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:09.686483 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6344ca1-afb0-4d20-a635-4a6ae5ab22bd admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:09.700211 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6344ca1-afb0-4d20-a635-4a6ae5ab22bd admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:09.704840 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deddb507-7221-48fb-9521-bcfb8ae577a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:09.705540 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddb507-7221-48fb-9521-bcfb8ae577a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:09.705826 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddb507-7221-48fb-9521-bcfb8ae577a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:09.706095 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deddb507-7221-48fb-9521-bcfb8ae577a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:09.706876 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deddb507-7221-48fb-9521-bcfb8ae577a3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:09.707186 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deddb507-7221-48fb-9521-bcfb8ae577a3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:09.709038 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deddb507-7221-48fb-9521-bcfb8ae577a3 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:09.721005 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 339/690] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:18:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:09.727453 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de1a95-c537-4cd9-b757-49eaeeee06c4 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:09.738920 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de1a95-c537-4cd9-b757-49eaeeee06c4 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:09.743638 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62186148-3dbc-43a7-9103-8e0b646fcc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:09.744307 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62186148-3dbc-43a7-9103-8e0b646fcc61 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:09.744593 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62186148-3dbc-43a7-9103-8e0b646fcc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:09.744868 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62186148-3dbc-43a7-9103-8e0b646fcc61 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:09.745770 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62186148-3dbc-43a7-9103-8e0b646fcc61 admin admin] RBAC: Adding query filter params (role.id=19308d3515f546e9a04e44ae278cd111, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=797b76e6f16d428198e7f7f05c9c0fd3) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:09.746083 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62186148-3dbc-43a7-9103-8e0b646fcc61 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:09.747968 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62186148-3dbc-43a7-9103-8e0b646fcc61 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:09.754701 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 352/691] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:18:09 2021] GET /identity/v3/role_assignments?user.id=797b76e6f16d428198e7f7f05c9c0fd3&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=19308d3515f546e9a04e44ae278cd111 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:10.042102 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08399-9510-4455-80bc-304c590cd46e None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:10.042452 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08399-9510-4455-80bc-304c590cd46e None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:10.042632 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08399-9510-4455-80bc-304c590cd46e None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:10.044351 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 340/692] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:10.052062 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0088924-5b3a-4379-9406-5c36422de187 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:10.052356 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0088924-5b3a-4379-9406-5c36422de187 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:10.052636 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0088924-5b3a-4379-9406-5c36422de187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:10.071959 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-c0088924-5b3a-4379-9406-5c36422de187 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:10.073161 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-c0088924-5b3a-4379-9406-5c36422de187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:10.085257 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 353/693] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:10 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:10.106543 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08399-9510-4455-80bc-304c590cd46e None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:10.120642 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08399-9510-4455-80bc-304c590cd46e None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:10.125165 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361589d-a43b-4ab7-bbaf-add300d7f7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:10.125999 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361589d-a43b-4ab7-bbaf-add300d7f7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:10.126333 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361589d-a43b-4ab7-bbaf-add300d7f7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:10.126672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361589d-a43b-4ab7-bbaf-add300d7f7b8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:10.138892 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361589d-a43b-4ab7-bbaf-add300d7f7b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:18:10.146011 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-4361589d-a43b-4ab7-bbaf-add300d7f7b8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 02:18:10.152610 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 341/694] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:18:10 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:10.154014 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0088924-5b3a-4379-9406-5c36422de187 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:10.163808 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0088924-5b3a-4379-9406-5c36422de187 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:10.168847 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042e500-d75f-4f5b-808e-76befacea223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:10.169539 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042e500-d75f-4f5b-808e-76befacea223 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:10.169819 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042e500-d75f-4f5b-808e-76befacea223 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:10.170095 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042e500-d75f-4f5b-808e-76befacea223 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:10.170846 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042e500-d75f-4f5b-808e-76befacea223 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:10.171155 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042e500-d75f-4f5b-808e-76befacea223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:10.172809 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042e500-d75f-4f5b-808e-76befacea223 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:10.185844 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 354/695] 10.222.0.32 () {56 vars in 1125 bytes} [Wed Sep 15 02:18:10 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:10.188784 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361589d-a43b-4ab7-bbaf-add300d7f7b8 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:10.198848 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361589d-a43b-4ab7-bbaf-add300d7f7b8 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:10.203737 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774684f7-151b-4205-9553-bbabd14f33b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:10.204568 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774684f7-151b-4205-9553-bbabd14f33b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:10.204856 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774684f7-151b-4205-9553-bbabd14f33b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:10.205249 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774684f7-151b-4205-9553-bbabd14f33b8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:10.216182 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774684f7-151b-4205-9553-bbabd14f33b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:10.218111 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774684f7-151b-4205-9553-bbabd14f33b8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:10.235843 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-774684f7-151b-4205-9553-bbabd14f33b8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:10.242149 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 342/696] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:18:10.244529 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042e500-d75f-4f5b-808e-76befacea223 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:10.254745 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042e500-d75f-4f5b-808e-76befacea223 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:10.260387 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b04ce-ffc0-4c52-a96e-4dfae0dfd485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:10.261176 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b04ce-ffc0-4c52-a96e-4dfae0dfd485 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:10.261461 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b04ce-ffc0-4c52-a96e-4dfae0dfd485 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:10.261733 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b04ce-ffc0-4c52-a96e-4dfae0dfd485 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:10.262505 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b04ce-ffc0-4c52-a96e-4dfae0dfd485 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:10.262811 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b04ce-ffc0-4c52-a96e-4dfae0dfd485 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:10.264399 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b04ce-ffc0-4c52-a96e-4dfae0dfd485 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:10.281014 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 355/697] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:10.284257 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774684f7-151b-4205-9553-bbabd14f33b8 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:10.295271 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774684f7-151b-4205-9553-bbabd14f33b8 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:10.300700 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166abc2b-ebcd-4729-abcd-d2a8b9c26db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:10.301592 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166abc2b-ebcd-4729-abcd-d2a8b9c26db5 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:10.301870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166abc2b-ebcd-4729-abcd-d2a8b9c26db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:10.302194 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166abc2b-ebcd-4729-abcd-d2a8b9c26db5 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:10.310211 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166abc2b-ebcd-4729-abcd-d2a8b9c26db5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:10.312359 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166abc2b-ebcd-4729-abcd-d2a8b9c26db5 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:10.327591 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-166abc2b-ebcd-4729-abcd-d2a8b9c26db5 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 02:18:10.333006 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 343/698] 10.222.0.32 () {56 vars in 1139 bytes} [Wed Sep 15 02:18:10 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:10.335492 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b04ce-ffc0-4c52-a96e-4dfae0dfd485 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:10.345794 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b04ce-ffc0-4c52-a96e-4dfae0dfd485 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:10.351903 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3501442-7029-4f8d-82c4-6f3761c00c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:10.352576 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3501442-7029-4f8d-82c4-6f3761c00c17 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:10.352937 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3501442-7029-4f8d-82c4-6f3761c00c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:10.353221 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3501442-7029-4f8d-82c4-6f3761c00c17 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:10.354118 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3501442-7029-4f8d-82c4-6f3761c00c17 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:10.354428 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3501442-7029-4f8d-82c4-6f3761c00c17 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:10.356352 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3501442-7029-4f8d-82c4-6f3761c00c17 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:10.380822 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 356/699] 10.222.0.32 () {56 vars in 1171 bytes} [Wed Sep 15 02:18:10 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:10.382174 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166abc2b-ebcd-4729-abcd-d2a8b9c26db5 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:10.392102 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166abc2b-ebcd-4729-abcd-d2a8b9c26db5 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:10.397834 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f3388-0484-4f5d-9dac-8d8fc61ea3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:10.398689 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f3388-0484-4f5d-9dac-8d8fc61ea3fd admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:10.398971 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f3388-0484-4f5d-9dac-8d8fc61ea3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:10.399249 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f3388-0484-4f5d-9dac-8d8fc61ea3fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:10.415807 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f3388-0484-4f5d-9dac-8d8fc61ea3fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:10.417754 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f3388-0484-4f5d-9dac-8d8fc61ea3fd admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:10.437754 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-5f6f3388-0484-4f5d-9dac-8d8fc61ea3fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:10.439076 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 344/700] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:10.445700 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3501442-7029-4f8d-82c4-6f3761c00c17 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:10.456903 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3501442-7029-4f8d-82c4-6f3761c00c17 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:10.461840 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f728b93-957f-4d7c-8ec5-ddfafcb766b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:10.462504 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f728b93-957f-4d7c-8ec5-ddfafcb766b7 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:10.462842 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f728b93-957f-4d7c-8ec5-ddfafcb766b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:10.463116 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f728b93-957f-4d7c-8ec5-ddfafcb766b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:10.463844 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f728b93-957f-4d7c-8ec5-ddfafcb766b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:10.464151 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f728b93-957f-4d7c-8ec5-ddfafcb766b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:10.465834 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f728b93-957f-4d7c-8ec5-ddfafcb766b7 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:10.483927 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 357/701] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:10.485297 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f3388-0484-4f5d-9dac-8d8fc61ea3fd admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:10.495731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f3388-0484-4f5d-9dac-8d8fc61ea3fd admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:10.500504 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f4aac-0fa7-4d11-8ccf-00e445969961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:10.501385 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f4aac-0fa7-4d11-8ccf-00e445969961 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:10.501667 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f4aac-0fa7-4d11-8ccf-00e445969961 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:10.501938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f4aac-0fa7-4d11-8ccf-00e445969961 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:10.509589 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f4aac-0fa7-4d11-8ccf-00e445969961 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:10.511595 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f4aac-0fa7-4d11-8ccf-00e445969961 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:10.525454 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-c99f4aac-0fa7-4d11-8ccf-00e445969961 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:18:10.530180 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 345/702] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:10.533463 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f728b93-957f-4d7c-8ec5-ddfafcb766b7 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:10.543701 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f728b93-957f-4d7c-8ec5-ddfafcb766b7 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:10.548511 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d388a2-92d3-4b57-940b-2b98c5e95d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:10.549143 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d388a2-92d3-4b57-940b-2b98c5e95d4e admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:10.549986 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d388a2-92d3-4b57-940b-2b98c5e95d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:10.550302 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d388a2-92d3-4b57-940b-2b98c5e95d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:10.551249 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d388a2-92d3-4b57-940b-2b98c5e95d4e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:10.551558 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d388a2-92d3-4b57-940b-2b98c5e95d4e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:10.553509 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d388a2-92d3-4b57-940b-2b98c5e95d4e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:10.571859 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 358/703] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:18:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:10.573191 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f4aac-0fa7-4d11-8ccf-00e445969961 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:10.585099 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f4aac-0fa7-4d11-8ccf-00e445969961 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:10.590207 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793ff2b-ebed-421a-8888-0f25861e8a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:10.591178 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793ff2b-ebed-421a-8888-0f25861e8a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:10.591458 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793ff2b-ebed-421a-8888-0f25861e8a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:10.591738 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793ff2b-ebed-421a-8888-0f25861e8a43 admin admin] PATH_INFO: `/v3/projects/083ff2535d794e79a145a076aedeedd4/users/a93401007dd64d88af5e41ff08679a28/roles/33ed3f5cd26a4ea9a99eb0e09856c1a8` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:10.608584 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793ff2b-ebed-421a-8888-0f25861e8a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=083ff2535d794e79a145a076aedeedd4, user_id=a93401007dd64d88af5e41ff08679a28, role_id=33ed3f5cd26a4ea9a99eb0e09856c1a8)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:10.611396 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793ff2b-ebed-421a-8888-0f25861e8a43 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:10.637231 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 346/704] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:18:10 2021] PUT /identity/v3/projects/083ff2535d794e79a145a076aedeedd4/users/a93401007dd64d88af5e41ff08679a28/roles/33ed3f5cd26a4ea9a99eb0e09856c1a8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:18:10.680715 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4d338-6933-4b90-9437-7608b550348b None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:10.681023 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4d338-6933-4b90-9437-7608b550348b None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:10.681305 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4d338-6933-4b90-9437-7608b550348b None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:10.683081 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 359/705] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:10.691625 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b935c8b-20dd-433b-9e5c-607f834d5c93 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:10.692019 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b935c8b-20dd-433b-9e5c-607f834d5c93 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:10.692397 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b935c8b-20dd-433b-9e5c-607f834d5c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:10.712520 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-0b935c8b-20dd-433b-9e5c-607f834d5c93 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:10.713788 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-0b935c8b-20dd-433b-9e5c-607f834d5c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:10.777155 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 347/706] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:10 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:10.802180 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4d338-6933-4b90-9437-7608b550348b None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:10.815640 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4d338-6933-4b90-9437-7608b550348b None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:10.820486 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585d838-fe6c-48be-a4d0-5e5a95107357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:10.821396 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585d838-fe6c-48be-a4d0-5e5a95107357 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:10.821724 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585d838-fe6c-48be-a4d0-5e5a95107357 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:10.822007 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585d838-fe6c-48be-a4d0-5e5a95107357 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:10.842287 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585d838-fe6c-48be-a4d0-5e5a95107357 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:18:10.850059 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-2585d838-fe6c-48be-a4d0-5e5a95107357 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:18:10.851653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 360/707] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:18:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:10.858437 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b935c8b-20dd-433b-9e5c-607f834d5c93 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:10.868234 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b935c8b-20dd-433b-9e5c-607f834d5c93 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:10.876674 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141611e-87fe-4187-88f7-708edce6f621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:10.878041 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141611e-87fe-4187-88f7-708edce6f621 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:10.878331 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141611e-87fe-4187-88f7-708edce6f621 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:10.878660 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141611e-87fe-4187-88f7-708edce6f621 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:10.879442 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141611e-87fe-4187-88f7-708edce6f621 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:10.879757 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141611e-87fe-4187-88f7-708edce6f621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:10.881606 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9141611e-87fe-4187-88f7-708edce6f621 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:10.895746 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 348/708] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:18:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:10.902503 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585d838-fe6c-48be-a4d0-5e5a95107357 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:10.913435 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585d838-fe6c-48be-a4d0-5e5a95107357 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:10.918152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f70e9-75d0-4a4a-9880-6d535c6497f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:10.918999 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f70e9-75d0-4a4a-9880-6d535c6497f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:10.919283 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f70e9-75d0-4a4a-9880-6d535c6497f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:10.919560 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f70e9-75d0-4a4a-9880-6d535c6497f2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:10.931860 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f70e9-75d0-4a4a-9880-6d535c6497f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:10.933859 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f70e9-75d0-4a4a-9880-6d535c6497f2 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:10.953080 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-9d6f70e9-75d0-4a4a-9880-6d535c6497f2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:10.956212 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 361/709] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:10.961527 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141611e-87fe-4187-88f7-708edce6f621 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:10.972188 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141611e-87fe-4187-88f7-708edce6f621 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:10.976964 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce692c-8890-49c7-9262-07caa99e412e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:10.977636 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce692c-8890-49c7-9262-07caa99e412e admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:10.977906 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce692c-8890-49c7-9262-07caa99e412e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:10.978236 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce692c-8890-49c7-9262-07caa99e412e admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:10.978961 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce692c-8890-49c7-9262-07caa99e412e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:10.979320 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce692c-8890-49c7-9262-07caa99e412e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:10.981004 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce692c-8890-49c7-9262-07caa99e412e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:10.998973 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 349/710] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:11.000306 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f70e9-75d0-4a4a-9880-6d535c6497f2 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:11.011134 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f70e9-75d0-4a4a-9880-6d535c6497f2 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:11.015979 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6b33f-c931-4b3d-9b6d-532bc6a75cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:11.016824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6b33f-c931-4b3d-9b6d-532bc6a75cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:11.017134 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6b33f-c931-4b3d-9b6d-532bc6a75cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:11.017411 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6b33f-c931-4b3d-9b6d-532bc6a75cf4 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:11.027630 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6b33f-c931-4b3d-9b6d-532bc6a75cf4 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:11.032902 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6b33f-c931-4b3d-9b6d-532bc6a75cf4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:11.044060 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-0bf6b33f-c931-4b3d-9b6d-532bc6a75cf4 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 02:18:11.045306 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 362/711] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:18:10 2021] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:11.051955 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce692c-8890-49c7-9262-07caa99e412e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:11.062123 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce692c-8890-49c7-9262-07caa99e412e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:11.067405 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8d023-45e9-4dc0-ac93-58a658dd3294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:11.068068 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8d023-45e9-4dc0-ac93-58a658dd3294 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:11.068398 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8d023-45e9-4dc0-ac93-58a658dd3294 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:11.068676 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8d023-45e9-4dc0-ac93-58a658dd3294 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:11.069601 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8d023-45e9-4dc0-ac93-58a658dd3294 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:11.069910 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8d023-45e9-4dc0-ac93-58a658dd3294 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:11.071812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8d023-45e9-4dc0-ac93-58a658dd3294 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:11.095065 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 350/712] 10.222.0.32 () {56 vars in 1157 bytes} [Wed Sep 15 02:18:11 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:11.096944 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6b33f-c931-4b3d-9b6d-532bc6a75cf4 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:11.107085 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6b33f-c931-4b3d-9b6d-532bc6a75cf4 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:11.112074 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4750b-b192-4d8b-822a-f1cd73b51a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:11.113027 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4750b-b192-4d8b-822a-f1cd73b51a0f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:11.113314 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4750b-b192-4d8b-822a-f1cd73b51a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:11.113588 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4750b-b192-4d8b-822a-f1cd73b51a0f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:11.124857 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4750b-b192-4d8b-822a-f1cd73b51a0f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:11.126781 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4750b-b192-4d8b-822a-f1cd73b51a0f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:11.144328 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-bcb4750b-b192-4d8b-822a-f1cd73b51a0f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:11.150851 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 363/713] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:11.152251 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8d023-45e9-4dc0-ac93-58a658dd3294 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:11.162361 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8d023-45e9-4dc0-ac93-58a658dd3294 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:11.167183 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12465995-25cf-4e6c-b3e2-6da4d2f242ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:11.167865 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12465995-25cf-4e6c-b3e2-6da4d2f242ef admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:11.168148 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12465995-25cf-4e6c-b3e2-6da4d2f242ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:11.168427 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12465995-25cf-4e6c-b3e2-6da4d2f242ef admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:11.169220 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12465995-25cf-4e6c-b3e2-6da4d2f242ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:11.169526 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12465995-25cf-4e6c-b3e2-6da4d2f242ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:11.171176 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12465995-25cf-4e6c-b3e2-6da4d2f242ef admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:11.188862 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 351/714] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:11.190399 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4750b-b192-4d8b-822a-f1cd73b51a0f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:11.202296 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4750b-b192-4d8b-822a-f1cd73b51a0f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:11.208924 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966de0f-b5f9-418d-b296-aa8ff93f71a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:11.209778 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966de0f-b5f9-418d-b296-aa8ff93f71a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:11.210060 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966de0f-b5f9-418d-b296-aa8ff93f71a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:11.210389 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966de0f-b5f9-418d-b296-aa8ff93f71a4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:11.220081 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966de0f-b5f9-418d-b296-aa8ff93f71a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:11.222267 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966de0f-b5f9-418d-b296-aa8ff93f71a4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:11.241405 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-a966de0f-b5f9-418d-b296-aa8ff93f71a4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:18:11.243958 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 364/715] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:18:11.249449 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12465995-25cf-4e6c-b3e2-6da4d2f242ef admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:11.259492 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12465995-25cf-4e6c-b3e2-6da4d2f242ef admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:11.264132 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d33e8e-0292-4b9e-b23b-8d38a43d380f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:11.264839 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d33e8e-0292-4b9e-b23b-8d38a43d380f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:11.265150 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d33e8e-0292-4b9e-b23b-8d38a43d380f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:11.265427 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d33e8e-0292-4b9e-b23b-8d38a43d380f admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:11.266273 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d33e8e-0292-4b9e-b23b-8d38a43d380f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:11.266585 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d33e8e-0292-4b9e-b23b-8d38a43d380f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:11.269109 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d33e8e-0292-4b9e-b23b-8d38a43d380f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:11.285115 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 352/716] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:18:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:11.288734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966de0f-b5f9-418d-b296-aa8ff93f71a4 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:11.298759 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966de0f-b5f9-418d-b296-aa8ff93f71a4 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:11.304079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b2014-f813-4790-82d4-556b975f4c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:11.305040 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b2014-f813-4790-82d4-556b975f4c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:11.305324 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b2014-f813-4790-82d4-556b975f4c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:11.305599 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b2014-f813-4790-82d4-556b975f4c36 admin admin] PATH_INFO: `/v3/projects/083ff2535d794e79a145a076aedeedd4/users/ea510f540b2d47dcb19c8715fd247786/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:11.307688 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b2014-f813-4790-82d4-556b975f4c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=083ff2535d794e79a145a076aedeedd4, user_id=ea510f540b2d47dcb19c8715fd247786, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:11.310499 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b2014-f813-4790-82d4-556b975f4c36 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:11.342498 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 365/717] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:18:11 2021] PUT /identity/v3/projects/083ff2535d794e79a145a076aedeedd4/users/ea510f540b2d47dcb19c8715fd247786/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:18:11.633979 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f0ebc-fab6-4072-842f-9c7f1b8eca51 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:11.634484 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f0ebc-fab6-4072-842f-9c7f1b8eca51 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:11.634484 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f0ebc-fab6-4072-842f-9c7f1b8eca51 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:11.636239 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 353/718] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:11.643962 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebca67-1d85-4ace-b453-d8324ba89b82 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:11.644410 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebca67-1d85-4ace-b453-d8324ba89b82 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:11.644727 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebca67-1d85-4ace-b453-d8324ba89b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:11.664808 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-c4ebca67-1d85-4ace-b453-d8324ba89b82 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:11.666159 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-c4ebca67-1d85-4ace-b453-d8324ba89b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:11.731818 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 366/719] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:11 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:11.756707 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f0ebc-fab6-4072-842f-9c7f1b8eca51 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:11.769515 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f0ebc-fab6-4072-842f-9c7f1b8eca51 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:11.775349 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9bd8f-bf62-4cd4-85de-200960cd0752 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:11.775640 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9bd8f-bf62-4cd4-85de-200960cd0752 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:11.775921 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9bd8f-bf62-4cd4-85de-200960cd0752 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:11.777123 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e30313-cafd-48a5-bf21-09023d6a54d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:11.778149 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e30313-cafd-48a5-bf21-09023d6a54d7 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:11.778254 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 367/720] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:11.778719 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e30313-cafd-48a5-bf21-09023d6a54d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:11.778995 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e30313-cafd-48a5-bf21-09023d6a54d7 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:11.779652 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e30313-cafd-48a5-bf21-09023d6a54d7 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:11.784988 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e30313-cafd-48a5-bf21-09023d6a54d7 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:11.797047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940c399-3eba-4d2c-90a7-de334e8d358a None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:11.797663 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940c399-3eba-4d2c-90a7-de334e8d358a None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:11.798151 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940c399-3eba-4d2c-90a7-de334e8d358a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:11.799811 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-e3e30313-cafd-48a5-bf21-09023d6a54d7 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 02:18:11.801430 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 354/721] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:11 2021] GET /identity/v3/services/network => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:11.808565 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e30313-cafd-48a5-bf21-09023d6a54d7 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:11.829880 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e30313-cafd-48a5-bf21-09023d6a54d7 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:11.833846 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-c940c399-3eba-4d2c-90a7-de334e8d358a None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:11.835494 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-c940c399-3eba-4d2c-90a7-de334e8d358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:11.839969 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d0ea0-867d-411c-9653-e3415b97bbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:11.840641 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d0ea0-867d-411c-9653-e3415b97bbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:11.840946 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d0ea0-867d-411c-9653-e3415b97bbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:11.841244 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d0ea0-867d-411c-9653-e3415b97bbf1 admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:11.841938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d0ea0-867d-411c-9653-e3415b97bbf1 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:11.842298 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d0ea0-867d-411c-9653-e3415b97bbf1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:11.843946 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d0ea0-867d-411c-9653-e3415b97bbf1 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:11.845993 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 368/722] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:11 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:11.851953 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 355/723] 10.222.0.32 () {56 vars in 1134 bytes} [Wed Sep 15 02:18:11 2021] GET /identity/v3/services?name=network => generated 124 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:11.858195 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940c399-3eba-4d2c-90a7-de334e8d358a None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:11.868534 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940c399-3eba-4d2c-90a7-de334e8d358a None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:11.873576 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0e1d7-455d-4800-89fd-48b203ceb8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:11.874523 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0e1d7-455d-4800-89fd-48b203ceb8bc admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:11.875069 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0e1d7-455d-4800-89fd-48b203ceb8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:11.875566 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0e1d7-455d-4800-89fd-48b203ceb8bc admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:11.876657 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0e1d7-455d-4800-89fd-48b203ceb8bc admin admin] RBAC: Adding query filter params (type=network) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:11.877208 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0e1d7-455d-4800-89fd-48b203ceb8bc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:11.879235 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0e1d7-455d-4800-89fd-48b203ceb8bc admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:11.884808 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d0ea0-867d-411c-9653-e3415b97bbf1 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:11.895806 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d0ea0-867d-411c-9653-e3415b97bbf1 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:11.897595 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 369/724] 10.222.0.32 () {56 vars in 1134 bytes} [Wed Sep 15 02:18:11 2021] GET /identity/v3/services?type=network => generated 350 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:11.906377 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cccac-551b-419c-8393-89d94ee59ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:11.907562 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cccac-551b-419c-8393-89d94ee59ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:11.908087 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cccac-551b-419c-8393-89d94ee59ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:11.908641 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cccac-551b-419c-8393-89d94ee59ac4 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:11.909587 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cccac-551b-419c-8393-89d94ee59ac4 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:11.911503 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cccac-551b-419c-8393-89d94ee59ac4 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:11.923554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0e1d7-455d-4800-89fd-48b203ceb8bc admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:11.936936 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0e1d7-455d-4800-89fd-48b203ceb8bc admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:11.938786 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-218cccac-551b-419c-8393-89d94ee59ac4 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 02:18:11.942222 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 356/725] 10.222.0.32 () {56 vars in 1151 bytes} [Wed Sep 15 02:18:11 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:18:11.944473 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f3d72-a98d-4ed7-a5d8-573984833a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:11.945499 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f3d72-a98d-4ed7-a5d8-573984833a81 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:11.946039 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f3d72-a98d-4ed7-a5d8-573984833a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:11.946571 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f3d72-a98d-4ed7-a5d8-573984833a81 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:11.947513 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f3d72-a98d-4ed7-a5d8-573984833a81 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:11.948638 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cccac-551b-419c-8393-89d94ee59ac4 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:11.950278 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING py.warnings [None req-574f3d72-a98d-4ed7-a5d8-573984833a81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:18:11.950278 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: warnings.warn(msg) Sep 15 02:18:11.950278 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: Sep 15 02:18:11.953494 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f3d72-a98d-4ed7-a5d8-573984833a81 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:11.961573 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cccac-551b-419c-8393-89d94ee59ac4 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:11.966863 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699bed0-4265-4cb5-8752-1460976afa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:11.967788 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699bed0-4265-4cb5-8752-1460976afa98 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:11.968328 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699bed0-4265-4cb5-8752-1460976afa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:11.968815 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699bed0-4265-4cb5-8752-1460976afa98 admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:11.970149 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699bed0-4265-4cb5-8752-1460976afa98 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:11.970844 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699bed0-4265-4cb5-8752-1460976afa98 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:11.972787 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699bed0-4265-4cb5-8752-1460976afa98 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:11.978808 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 357/726] 10.222.0.32 () {56 vars in 1146 bytes} [Wed Sep 15 02:18:11 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:11.984617 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699bed0-4265-4cb5-8752-1460976afa98 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:11.996539 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699bed0-4265-4cb5-8752-1460976afa98 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:12.002024 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67de3cc-bdc7-419d-80c3-45b185e7e455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:12.003142 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67de3cc-bdc7-419d-80c3-45b185e7e455 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:12.003651 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67de3cc-bdc7-419d-80c3-45b185e7e455 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:12.004169 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67de3cc-bdc7-419d-80c3-45b185e7e455 admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:12.005239 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67de3cc-bdc7-419d-80c3-45b185e7e455 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:12.005805 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67de3cc-bdc7-419d-80c3-45b185e7e455 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:12.007715 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67de3cc-bdc7-419d-80c3-45b185e7e455 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:12.013722 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 358/727] 10.222.0.32 () {56 vars in 1146 bytes} [Wed Sep 15 02:18:11 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:12.015460 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 370/728] 10.222.0.32 () {60 vars in 1166 bytes} [Wed Sep 15 02:18:11 2021] POST /identity/v3/endpoints => generated 327 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:18:12.020387 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67de3cc-bdc7-419d-80c3-45b185e7e455 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:12.031842 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67de3cc-bdc7-419d-80c3-45b185e7e455 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:12.055819 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7a0ec-fa72-43f4-b3fb-c110c7f42857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:12.056956 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7a0ec-fa72-43f4-b3fb-c110c7f42857 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:12.057562 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7a0ec-fa72-43f4-b3fb-c110c7f42857 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:12.058123 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7a0ec-fa72-43f4-b3fb-c110c7f42857 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:12.059192 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7a0ec-fa72-43f4-b3fb-c110c7f42857 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:12.060460 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING py.warnings [None req-e7b7a0ec-fa72-43f4-b3fb-c110c7f42857 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:18:12.060460 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: warnings.warn(msg) Sep 15 02:18:12.060460 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: Sep 15 02:18:12.061848 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7a0ec-fa72-43f4-b3fb-c110c7f42857 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:12.092171 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 359/729] 10.222.0.32 () {60 vars in 1166 bytes} [Wed Sep 15 02:18:12 2021] POST /identity/v3/endpoints => generated 346 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:18:12.749412 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f443822-b6b8-479c-b433-1dccf1b0c284 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:12.749915 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f443822-b6b8-479c-b433-1dccf1b0c284 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:12.749915 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f443822-b6b8-479c-b433-1dccf1b0c284 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:12.751929 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 371/730] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:12.759812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a3d7d-06ff-452d-b0e8-7830ed1936c9 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:12.760281 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a3d7d-06ff-452d-b0e8-7830ed1936c9 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:12.760357 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a3d7d-06ff-452d-b0e8-7830ed1936c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:12.778327 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-495a3d7d-06ff-452d-b0e8-7830ed1936c9 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:12.779512 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-495a3d7d-06ff-452d-b0e8-7830ed1936c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:12.796138 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 360/731] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:12 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:12.819971 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f443822-b6b8-479c-b433-1dccf1b0c284 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:12.832182 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f443822-b6b8-479c-b433-1dccf1b0c284 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:12.836579 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065fcaf-70fa-4795-98b5-6705b01a7d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:12.837424 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065fcaf-70fa-4795-98b5-6705b01a7d1a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:12.837707 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065fcaf-70fa-4795-98b5-6705b01a7d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:12.837983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065fcaf-70fa-4795-98b5-6705b01a7d1a admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:12.838637 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065fcaf-70fa-4795-98b5-6705b01a7d1a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:12.840219 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065fcaf-70fa-4795-98b5-6705b01a7d1a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:12.851410 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-2065fcaf-70fa-4795-98b5-6705b01a7d1a admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 02:18:12.852845 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 372/732] 10.222.0.32 () {56 vars in 1154 bytes} [Wed Sep 15 02:18:12 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:12.859341 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a3d7d-06ff-452d-b0e8-7830ed1936c9 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:12.869066 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a3d7d-06ff-452d-b0e8-7830ed1936c9 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:12.873634 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe1585-7c76-43cc-ba7a-c580e33d9757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:12.874291 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe1585-7c76-43cc-ba7a-c580e33d9757 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:12.874574 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe1585-7c76-43cc-ba7a-c580e33d9757 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:12.874849 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe1585-7c76-43cc-ba7a-c580e33d9757 admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:12.875555 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe1585-7c76-43cc-ba7a-c580e33d9757 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:12.875858 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe1585-7c76-43cc-ba7a-c580e33d9757 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:12.877559 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe1585-7c76-43cc-ba7a-c580e33d9757 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:12.882379 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 361/733] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Sep 15 02:18:12 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:12.888381 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065fcaf-70fa-4795-98b5-6705b01a7d1a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:12.898550 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065fcaf-70fa-4795-98b5-6705b01a7d1a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:12.903497 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168dd98-1f46-4aa2-802d-a7fb8dc0a1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:12.904232 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168dd98-1f46-4aa2-802d-a7fb8dc0a1eb admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:12.904516 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168dd98-1f46-4aa2-802d-a7fb8dc0a1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:12.904836 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168dd98-1f46-4aa2-802d-a7fb8dc0a1eb admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:12.905603 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168dd98-1f46-4aa2-802d-a7fb8dc0a1eb admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:12.905910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168dd98-1f46-4aa2-802d-a7fb8dc0a1eb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:12.907621 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168dd98-1f46-4aa2-802d-a7fb8dc0a1eb admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:12.913888 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 373/734] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Sep 15 02:18:12 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:13.223035 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c995cb3-6b07-4e23-8ecf-a918ffc09b1a None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:13.223435 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c995cb3-6b07-4e23-8ecf-a918ffc09b1a None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:13.223609 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c995cb3-6b07-4e23-8ecf-a918ffc09b1a None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:13.225623 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 362/735] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:13.233072 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f54ea-9c26-46c1-9f51-d4aa7b096af0 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:13.233365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f54ea-9c26-46c1-9f51-d4aa7b096af0 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:13.233646 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f54ea-9c26-46c1-9f51-d4aa7b096af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:13.251732 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-640f54ea-9c26-46c1-9f51-d4aa7b096af0 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:13.253476 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-640f54ea-9c26-46c1-9f51-d4aa7b096af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:13.264981 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 374/736] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:13 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:13.286180 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c995cb3-6b07-4e23-8ecf-a918ffc09b1a None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:13.298553 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c995cb3-6b07-4e23-8ecf-a918ffc09b1a None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:13.302987 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138812b1-c644-4a53-a4e7-ed48bf41ab19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:13.303776 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138812b1-c644-4a53-a4e7-ed48bf41ab19 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:13.304060 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138812b1-c644-4a53-a4e7-ed48bf41ab19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:13.304337 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138812b1-c644-4a53-a4e7-ed48bf41ab19 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:13.315281 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138812b1-c644-4a53-a4e7-ed48bf41ab19 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:18:13.322285 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-138812b1-c644-4a53-a4e7-ed48bf41ab19 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 02:18:13.328304 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 363/737] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:18:13 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:13.330312 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f54ea-9c26-46c1-9f51-d4aa7b096af0 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:13.339458 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f54ea-9c26-46c1-9f51-d4aa7b096af0 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:13.344253 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f7a07-ea97-4d7e-827e-5127efe24bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:13.344945 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f7a07-ea97-4d7e-827e-5127efe24bee admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:13.345278 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f7a07-ea97-4d7e-827e-5127efe24bee admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:13.345560 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f7a07-ea97-4d7e-827e-5127efe24bee admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:13.346841 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f7a07-ea97-4d7e-827e-5127efe24bee admin admin] RBAC: Adding query filter params (name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:13.347148 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f7a07-ea97-4d7e-827e-5127efe24bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:13.348739 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f7a07-ea97-4d7e-827e-5127efe24bee admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:13.360680 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 375/738] 10.222.0.32 () {56 vars in 1125 bytes} [Wed Sep 15 02:18:13 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:13.363957 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138812b1-c644-4a53-a4e7-ed48bf41ab19 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:13.375410 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138812b1-c644-4a53-a4e7-ed48bf41ab19 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:13.380183 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa299b8-6afd-4f51-9ced-c64da226c600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:13.381032 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa299b8-6afd-4f51-9ced-c64da226c600 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:13.381315 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa299b8-6afd-4f51-9ced-c64da226c600 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:13.381641 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa299b8-6afd-4f51-9ced-c64da226c600 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:13.392025 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa299b8-6afd-4f51-9ced-c64da226c600 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:13.394458 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa299b8-6afd-4f51-9ced-c64da226c600 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:13.411042 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-5fa299b8-6afd-4f51-9ced-c64da226c600 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:13.416996 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 364/739] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:13.418795 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f7a07-ea97-4d7e-827e-5127efe24bee admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:13.429295 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f7a07-ea97-4d7e-827e-5127efe24bee admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:13.434257 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007dd3c5-361f-4b9f-b589-82458b4f11e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:13.434945 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dd3c5-361f-4b9f-b589-82458b4f11e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:13.435235 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dd3c5-361f-4b9f-b589-82458b4f11e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:13.435560 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dd3c5-361f-4b9f-b589-82458b4f11e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:13.436312 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007dd3c5-361f-4b9f-b589-82458b4f11e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:13.436676 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007dd3c5-361f-4b9f-b589-82458b4f11e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:13.438443 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007dd3c5-361f-4b9f-b589-82458b4f11e7 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:13.457010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 376/740] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:13.458757 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa299b8-6afd-4f51-9ced-c64da226c600 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:13.474116 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa299b8-6afd-4f51-9ced-c64da226c600 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:13.482102 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22794a29-6b14-4139-a9ab-1d978f91fa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:13.482965 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22794a29-6b14-4139-a9ab-1d978f91fa7c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:13.483246 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22794a29-6b14-4139-a9ab-1d978f91fa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:13.483521 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22794a29-6b14-4139-a9ab-1d978f91fa7c admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:13.492671 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22794a29-6b14-4139-a9ab-1d978f91fa7c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:13.494756 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22794a29-6b14-4139-a9ab-1d978f91fa7c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:13.508743 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-22794a29-6b14-4139-a9ab-1d978f91fa7c admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 02:18:13.515187 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 365/741] 10.222.0.32 () {56 vars in 1139 bytes} [Wed Sep 15 02:18:13 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:13.516596 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007dd3c5-361f-4b9f-b589-82458b4f11e7 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:13.527147 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007dd3c5-361f-4b9f-b589-82458b4f11e7 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:13.531774 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad018b6-a0b7-44e6-8182-b41b8e517ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:13.532486 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad018b6-a0b7-44e6-8182-b41b8e517ece admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:13.532816 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad018b6-a0b7-44e6-8182-b41b8e517ece admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:13.533137 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad018b6-a0b7-44e6-8182-b41b8e517ece admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:13.534591 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad018b6-a0b7-44e6-8182-b41b8e517ece admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:13.534901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad018b6-a0b7-44e6-8182-b41b8e517ece admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:13.536808 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad018b6-a0b7-44e6-8182-b41b8e517ece admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:13.559692 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 377/742] 10.222.0.32 () {56 vars in 1171 bytes} [Wed Sep 15 02:18:13 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:13.561070 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22794a29-6b14-4139-a9ab-1d978f91fa7c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:13.570927 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22794a29-6b14-4139-a9ab-1d978f91fa7c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:13.575622 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b62e7-aa9c-4b62-8eed-b208187829b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:13.576259 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b62e7-aa9c-4b62-8eed-b208187829b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:13.576586 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b62e7-aa9c-4b62-8eed-b208187829b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:13.576867 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b62e7-aa9c-4b62-8eed-b208187829b6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:13.585389 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b62e7-aa9c-4b62-8eed-b208187829b6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:13.587189 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b62e7-aa9c-4b62-8eed-b208187829b6 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:13.600975 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 366/743] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:18:13 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:18:13.603160 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad018b6-a0b7-44e6-8182-b41b8e517ece admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:13.613361 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad018b6-a0b7-44e6-8182-b41b8e517ece admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:13.617977 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a92543-38a6-4b44-892a-3f863af2c612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:13.618770 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a92543-38a6-4b44-892a-3f863af2c612 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:13.619099 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a92543-38a6-4b44-892a-3f863af2c612 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:13.619381 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a92543-38a6-4b44-892a-3f863af2c612 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:13.629944 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a92543-38a6-4b44-892a-3f863af2c612 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:13.631822 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a92543-38a6-4b44-892a-3f863af2c612 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:13.650120 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-11a92543-38a6-4b44-892a-3f863af2c612 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:13.656532 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 378/744] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:13.657878 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b62e7-aa9c-4b62-8eed-b208187829b6 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:13.667427 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b62e7-aa9c-4b62-8eed-b208187829b6 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:13.672057 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fbcca-46a0-4fc8-b161-fbc945769217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:13.672700 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fbcca-46a0-4fc8-b161-fbc945769217 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:13.673013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fbcca-46a0-4fc8-b161-fbc945769217 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:13.673290 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fbcca-46a0-4fc8-b161-fbc945769217 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:13.673995 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fbcca-46a0-4fc8-b161-fbc945769217 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:13.674329 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fbcca-46a0-4fc8-b161-fbc945769217 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:13.675897 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fbcca-46a0-4fc8-b161-fbc945769217 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:13.688105 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 367/745] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:13.694087 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a92543-38a6-4b44-892a-3f863af2c612 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:13.704154 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a92543-38a6-4b44-892a-3f863af2c612 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:13.709690 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7be6cd-7fc3-4c8a-8030-59a5df262c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:13.710751 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7be6cd-7fc3-4c8a-8030-59a5df262c1a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:13.711271 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7be6cd-7fc3-4c8a-8030-59a5df262c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:13.711767 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7be6cd-7fc3-4c8a-8030-59a5df262c1a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:13.719175 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7be6cd-7fc3-4c8a-8030-59a5df262c1a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:13.722071 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7be6cd-7fc3-4c8a-8030-59a5df262c1a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:13.735496 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-1c7be6cd-7fc3-4c8a-8030-59a5df262c1a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:18:13.737329 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 379/746] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:13.744033 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fbcca-46a0-4fc8-b161-fbc945769217 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:13.754741 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fbcca-46a0-4fc8-b161-fbc945769217 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:13.759634 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa04141-9777-4125-8ae3-488af33aa37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:13.760563 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa04141-9777-4125-8ae3-488af33aa37c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:13.761561 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa04141-9777-4125-8ae3-488af33aa37c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:13.762060 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa04141-9777-4125-8ae3-488af33aa37c admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:13.763119 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa04141-9777-4125-8ae3-488af33aa37c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:13.763645 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa04141-9777-4125-8ae3-488af33aa37c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:13.765814 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa04141-9777-4125-8ae3-488af33aa37c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:13.780011 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 368/747] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:18:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:13.787417 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7be6cd-7fc3-4c8a-8030-59a5df262c1a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:13.798674 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7be6cd-7fc3-4c8a-8030-59a5df262c1a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:13.803663 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08962e07-34db-4693-b65b-bd1909978c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:13.804585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08962e07-34db-4693-b65b-bd1909978c0e admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:13.805152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08962e07-34db-4693-b65b-bd1909978c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:13.805668 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08962e07-34db-4693-b65b-bd1909978c0e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:13.806752 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08962e07-34db-4693-b65b-bd1909978c0e admin admin] RBAC: Adding query filter params (role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=a93401007dd64d88af5e41ff08679a28) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:13.807269 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08962e07-34db-4693-b65b-bd1909978c0e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:13.809500 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08962e07-34db-4693-b65b-bd1909978c0e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:13.821031 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 380/748] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:18:13 2021] GET /identity/v3/role_assignments?user.id=a93401007dd64d88af5e41ff08679a28&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:13.989919 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec9742-2632-4ab0-b666-3bcec3769178 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:13.990258 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec9742-2632-4ab0-b666-3bcec3769178 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:13.990440 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec9742-2632-4ab0-b666-3bcec3769178 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:13.992329 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 369/749] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:13.999660 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b42d43-b9d4-4f2c-887c-794cdd0a76e1 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:13.999942 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b42d43-b9d4-4f2c-887c-794cdd0a76e1 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:14.000219 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b42d43-b9d4-4f2c-887c-794cdd0a76e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:14.019760 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-49b42d43-b9d4-4f2c-887c-794cdd0a76e1 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:14.021104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-49b42d43-b9d4-4f2c-887c-794cdd0a76e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:14.029124 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 381/750] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:13 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:14.053166 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec9742-2632-4ab0-b666-3bcec3769178 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:14.066916 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec9742-2632-4ab0-b666-3bcec3769178 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:14.071170 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5388a50-864b-4296-9772-e4b5e54fe700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:14.071954 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5388a50-864b-4296-9772-e4b5e54fe700 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:14.072234 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5388a50-864b-4296-9772-e4b5e54fe700 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:14.072502 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5388a50-864b-4296-9772-e4b5e54fe700 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:14.084641 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5388a50-864b-4296-9772-e4b5e54fe700 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:18:14.091675 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-b5388a50-864b-4296-9772-e4b5e54fe700 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:18:14.093201 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 370/751] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:18:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:14.099919 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b42d43-b9d4-4f2c-887c-794cdd0a76e1 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:14.109052 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b42d43-b9d4-4f2c-887c-794cdd0a76e1 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:14.117106 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792def0-88c8-4bc7-b6d1-d1eaf55edea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:14.117783 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792def0-88c8-4bc7-b6d1-d1eaf55edea0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:14.118119 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792def0-88c8-4bc7-b6d1-d1eaf55edea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:14.118395 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792def0-88c8-4bc7-b6d1-d1eaf55edea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:14.119148 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792def0-88c8-4bc7-b6d1-d1eaf55edea0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:14.119452 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792def0-88c8-4bc7-b6d1-d1eaf55edea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:14.121206 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792def0-88c8-4bc7-b6d1-d1eaf55edea0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:14.131506 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 382/752] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:18:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:14.138320 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5388a50-864b-4296-9772-e4b5e54fe700 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:14.149570 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5388a50-864b-4296-9772-e4b5e54fe700 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:14.154869 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d812d11-5393-45c7-83c6-7ad2dfed2a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:14.155982 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d812d11-5393-45c7-83c6-7ad2dfed2a5c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:14.156466 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d812d11-5393-45c7-83c6-7ad2dfed2a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:14.157081 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d812d11-5393-45c7-83c6-7ad2dfed2a5c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:14.168753 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d812d11-5393-45c7-83c6-7ad2dfed2a5c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:14.170963 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d812d11-5393-45c7-83c6-7ad2dfed2a5c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:14.189099 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-0d812d11-5393-45c7-83c6-7ad2dfed2a5c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:14.196508 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 371/753] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:14.198116 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792def0-88c8-4bc7-b6d1-d1eaf55edea0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:14.208480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792def0-88c8-4bc7-b6d1-d1eaf55edea0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:14.213377 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e70bdd-6542-4689-87af-ab15bcbd1b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:14.214262 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e70bdd-6542-4689-87af-ab15bcbd1b8a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:14.214789 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e70bdd-6542-4689-87af-ab15bcbd1b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:14.215252 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e70bdd-6542-4689-87af-ab15bcbd1b8a admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:14.216245 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e70bdd-6542-4689-87af-ab15bcbd1b8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:14.216720 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e70bdd-6542-4689-87af-ab15bcbd1b8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:14.218592 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e70bdd-6542-4689-87af-ab15bcbd1b8a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:14.237289 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 383/754] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:14.238930 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d812d11-5393-45c7-83c6-7ad2dfed2a5c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:14.249496 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d812d11-5393-45c7-83c6-7ad2dfed2a5c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:14.255165 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf8fc6-a3e4-4eb2-9376-ad9fcb4801f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:14.256145 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf8fc6-a3e4-4eb2-9376-ad9fcb4801f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:14.256655 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf8fc6-a3e4-4eb2-9376-ad9fcb4801f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:14.257138 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf8fc6-a3e4-4eb2-9376-ad9fcb4801f8 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:14.265152 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf8fc6-a3e4-4eb2-9376-ad9fcb4801f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:14.267370 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf8fc6-a3e4-4eb2-9376-ad9fcb4801f8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:14.281771 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-4bdf8fc6-a3e4-4eb2-9376-ad9fcb4801f8 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 02:18:14.288507 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 372/755] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:18:14 2021] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:14.290064 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e70bdd-6542-4689-87af-ab15bcbd1b8a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:14.300988 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e70bdd-6542-4689-87af-ab15bcbd1b8a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:14.305915 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f47aa-72f3-4280-bda4-6326df0e005e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:14.306769 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f47aa-72f3-4280-bda4-6326df0e005e admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:14.307260 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f47aa-72f3-4280-bda4-6326df0e005e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:14.307824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f47aa-72f3-4280-bda4-6326df0e005e admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:14.308855 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f47aa-72f3-4280-bda4-6326df0e005e admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:14.309404 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f47aa-72f3-4280-bda4-6326df0e005e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:14.311479 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f47aa-72f3-4280-bda4-6326df0e005e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:14.330115 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 384/756] 10.222.0.32 () {56 vars in 1157 bytes} [Wed Sep 15 02:18:14 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:14.337025 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf8fc6-a3e4-4eb2-9376-ad9fcb4801f8 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:14.348111 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf8fc6-a3e4-4eb2-9376-ad9fcb4801f8 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:14.353492 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30c072-f35b-46d1-9022-6147846fae6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:14.354509 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30c072-f35b-46d1-9022-6147846fae6c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:14.354969 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30c072-f35b-46d1-9022-6147846fae6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:14.355420 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30c072-f35b-46d1-9022-6147846fae6c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:14.366760 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30c072-f35b-46d1-9022-6147846fae6c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:14.368976 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30c072-f35b-46d1-9022-6147846fae6c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:14.384846 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 373/757] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:18:14 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:18:14.386527 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f47aa-72f3-4280-bda4-6326df0e005e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:14.396619 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f47aa-72f3-4280-bda4-6326df0e005e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:14.401566 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98e720-8e43-4374-8ba6-1f91f74daf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:14.402628 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98e720-8e43-4374-8ba6-1f91f74daf0f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:14.403131 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98e720-8e43-4374-8ba6-1f91f74daf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:14.403571 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98e720-8e43-4374-8ba6-1f91f74daf0f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:14.414565 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98e720-8e43-4374-8ba6-1f91f74daf0f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:14.416748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98e720-8e43-4374-8ba6-1f91f74daf0f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:14.434638 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-bc98e720-8e43-4374-8ba6-1f91f74daf0f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:14.436735 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 385/758] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:14.444219 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83037ab5-9c58-4683-a9dd-820f1a8a7f1d None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:14.444706 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83037ab5-9c58-4683-a9dd-820f1a8a7f1d None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:14.445021 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83037ab5-9c58-4683-a9dd-820f1a8a7f1d None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:14.446911 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 374/759] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:14.447656 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98e720-8e43-4374-8ba6-1f91f74daf0f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:14.455461 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5864e-2a7b-45f8-9d0b-789a331e0acf None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:14.455748 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5864e-2a7b-45f8-9d0b-789a331e0acf None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:14.456026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5864e-2a7b-45f8-9d0b-789a331e0acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:14.459836 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98e720-8e43-4374-8ba6-1f91f74daf0f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:14.464577 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3368f6-a460-4f1a-af6b-bbf20a46e2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:14.465492 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3368f6-a460-4f1a-af6b-bbf20a46e2db admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:14.465974 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3368f6-a460-4f1a-af6b-bbf20a46e2db admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:14.466464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3368f6-a460-4f1a-af6b-bbf20a46e2db admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:14.467373 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3368f6-a460-4f1a-af6b-bbf20a46e2db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:14.467886 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3368f6-a460-4f1a-af6b-bbf20a46e2db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:14.469780 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3368f6-a460-4f1a-af6b-bbf20a46e2db admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:14.474013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-03a5864e-2a7b-45f8-9d0b-789a331e0acf None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:14.475266 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-03a5864e-2a7b-45f8-9d0b-789a331e0acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:14.489806 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 375/761] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:14 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:14.489924 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 386/761] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:14.491094 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5864e-2a7b-45f8-9d0b-789a331e0acf None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:14.500164 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5864e-2a7b-45f8-9d0b-789a331e0acf None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:14.504749 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a19cbe-cef1-4c46-8ce4-5eafb1bde418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:14.505748 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a19cbe-cef1-4c46-8ce4-5eafb1bde418 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:14.506140 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a19cbe-cef1-4c46-8ce4-5eafb1bde418 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:14.506496 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a19cbe-cef1-4c46-8ce4-5eafb1bde418 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:14.509716 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3368f6-a460-4f1a-af6b-bbf20a46e2db admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:14.519332 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3368f6-a460-4f1a-af6b-bbf20a46e2db admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:14.521036 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a19cbe-cef1-4c46-8ce4-5eafb1bde418 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:14.522973 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a19cbe-cef1-4c46-8ce4-5eafb1bde418 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:14.524577 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb28b7-7d11-4e9a-9fd7-6c80e3b51722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:14.525426 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb28b7-7d11-4e9a-9fd7-6c80e3b51722 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:14.525677 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb28b7-7d11-4e9a-9fd7-6c80e3b51722 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:14.525952 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb28b7-7d11-4e9a-9fd7-6c80e3b51722 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:14.526606 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb28b7-7d11-4e9a-9fd7-6c80e3b51722 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:14.528174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb28b7-7d11-4e9a-9fd7-6c80e3b51722 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:14.537413 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-10a19cbe-cef1-4c46-8ce4-5eafb1bde418 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:18:14.539122 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 376/762] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:18:14.545343 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-7deb28b7-7d11-4e9a-9fd7-6c80e3b51722 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 02:18:14.548922 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 387/763] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:18:14 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:14.550092 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a19cbe-cef1-4c46-8ce4-5eafb1bde418 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:14.552778 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb28b7-7d11-4e9a-9fd7-6c80e3b51722 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:14.562400 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a19cbe-cef1-4c46-8ce4-5eafb1bde418 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:14.562931 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb28b7-7d11-4e9a-9fd7-6c80e3b51722 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:14.568025 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d239a54-ceb4-47b8-b6f2-73a6a94c675f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:14.568585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52554272-dcaa-4933-86ef-9c5c3bb6cf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:14.568904 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d239a54-ceb4-47b8-b6f2-73a6a94c675f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:14.569314 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d239a54-ceb4-47b8-b6f2-73a6a94c675f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:14.569689 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d239a54-ceb4-47b8-b6f2-73a6a94c675f admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:14.569901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52554272-dcaa-4933-86ef-9c5c3bb6cf2e admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:14.570389 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52554272-dcaa-4933-86ef-9c5c3bb6cf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:14.570741 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d239a54-ceb4-47b8-b6f2-73a6a94c675f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:14.570942 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52554272-dcaa-4933-86ef-9c5c3bb6cf2e admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:14.571229 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d239a54-ceb4-47b8-b6f2-73a6a94c675f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:14.572023 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52554272-dcaa-4933-86ef-9c5c3bb6cf2e admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:14.572510 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52554272-dcaa-4933-86ef-9c5c3bb6cf2e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:14.573366 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d239a54-ceb4-47b8-b6f2-73a6a94c675f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:14.574492 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52554272-dcaa-4933-86ef-9c5c3bb6cf2e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:14.585624 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 388/764] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:18:14 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:14.586660 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52554272-dcaa-4933-86ef-9c5c3bb6cf2e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:14.592438 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 377/765] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:18:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:14.593914 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d239a54-ceb4-47b8-b6f2-73a6a94c675f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:14.601454 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52554272-dcaa-4933-86ef-9c5c3bb6cf2e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:14.603939 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d239a54-ceb4-47b8-b6f2-73a6a94c675f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:14.606238 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d462d2-67e7-4060-82a1-658447541ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:14.606887 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d462d2-67e7-4060-82a1-658447541ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:14.607170 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d462d2-67e7-4060-82a1-658447541ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:14.607444 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d462d2-67e7-4060-82a1-658447541ae8 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:14.608137 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d462d2-67e7-4060-82a1-658447541ae8 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:14.608445 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d462d2-67e7-4060-82a1-658447541ae8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:14.610238 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d462d2-67e7-4060-82a1-658447541ae8 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:14.610568 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f5e68-0833-4b8f-9ebe-7fe77643c7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:14.611773 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f5e68-0833-4b8f-9ebe-7fe77643c7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:14.612294 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f5e68-0833-4b8f-9ebe-7fe77643c7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:14.612771 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f5e68-0833-4b8f-9ebe-7fe77643c7d4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:14.613967 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f5e68-0833-4b8f-9ebe-7fe77643c7d4 admin admin] RBAC: Adding query filter params (role.id=19308d3515f546e9a04e44ae278cd111, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=ea510f540b2d47dcb19c8715fd247786) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:14.614544 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f5e68-0833-4b8f-9ebe-7fe77643c7d4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:14.616854 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f5e68-0833-4b8f-9ebe-7fe77643c7d4 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:14.621008 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 389/766] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:18:14 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:14.629057 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 378/767] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:18:14 2021] GET /identity/v3/role_assignments?user.id=ea510f540b2d47dcb19c8715fd247786&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=19308d3515f546e9a04e44ae278cd111 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:15.164106 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d387c8-ac8a-4baf-b44f-f8487bd70914 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:15.164633 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d387c8-ac8a-4baf-b44f-f8487bd70914 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:15.164706 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d387c8-ac8a-4baf-b44f-f8487bd70914 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:15.166797 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 390/768] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:15.174643 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc689e1a-89f7-40d7-a900-8ffb95c2a6d0 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:15.175053 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc689e1a-89f7-40d7-a900-8ffb95c2a6d0 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:15.175218 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc689e1a-89f7-40d7-a900-8ffb95c2a6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:15.193615 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-cc689e1a-89f7-40d7-a900-8ffb95c2a6d0 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:15.194798 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-cc689e1a-89f7-40d7-a900-8ffb95c2a6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:15.202928 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 379/769] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:15 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:15.226203 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d387c8-ac8a-4baf-b44f-f8487bd70914 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:15.239185 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d387c8-ac8a-4baf-b44f-f8487bd70914 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:15.243653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da964565-0c0b-49d1-a562-3593d6336562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:15.244314 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da964565-0c0b-49d1-a562-3593d6336562 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:15.244597 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da964565-0c0b-49d1-a562-3593d6336562 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:15.244954 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da964565-0c0b-49d1-a562-3593d6336562 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:15.245691 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da964565-0c0b-49d1-a562-3593d6336562 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:15.247284 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da964565-0c0b-49d1-a562-3593d6336562 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:15.267193 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 391/770] 10.222.0.32 () {60 vars in 1163 bytes} [Wed Sep 15 02:18:15 2021] POST /identity/v3/services => generated 269 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:18:16.175841 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f31ca-f73f-4575-ba11-a67a2282343f None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:16.176399 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f31ca-f73f-4575-ba11-a67a2282343f None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:16.176399 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f31ca-f73f-4575-ba11-a67a2282343f None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:16.178415 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 380/771] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:16.186005 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37939a5a-76ea-4f64-a937-4cf0ab128181 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:16.186447 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37939a5a-76ea-4f64-a937-4cf0ab128181 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:16.186637 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37939a5a-76ea-4f64-a937-4cf0ab128181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:16.204631 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-37939a5a-76ea-4f64-a937-4cf0ab128181 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:16.205937 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-37939a5a-76ea-4f64-a937-4cf0ab128181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:16.224171 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 392/772] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:16 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:16.249080 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f31ca-f73f-4575-ba11-a67a2282343f None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:16.262082 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f31ca-f73f-4575-ba11-a67a2282343f None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:16.266586 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a5f6a-5554-4e2b-974d-0e084d58132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:16.267393 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a5f6a-5554-4e2b-974d-0e084d58132e admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:16.267676 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a5f6a-5554-4e2b-974d-0e084d58132e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:16.268018 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a5f6a-5554-4e2b-974d-0e084d58132e admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:16.278672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a5f6a-5554-4e2b-974d-0e084d58132e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:18:16.286559 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-5a7a5f6a-5554-4e2b-974d-0e084d58132e admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 02:18:16.288094 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 381/773] 10.222.0.32 () {56 vars in 1142 bytes} [Wed Sep 15 02:18:16 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:16.294737 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37939a5a-76ea-4f64-a937-4cf0ab128181 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:16.304066 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37939a5a-76ea-4f64-a937-4cf0ab128181 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:16.308809 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0df16-dd11-4a8d-b24d-c36e56f09162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:16.309523 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0df16-dd11-4a8d-b24d-c36e56f09162 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:16.309808 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0df16-dd11-4a8d-b24d-c36e56f09162 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:16.310086 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0df16-dd11-4a8d-b24d-c36e56f09162 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:16.310840 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0df16-dd11-4a8d-b24d-c36e56f09162 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:16.311153 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0df16-dd11-4a8d-b24d-c36e56f09162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:16.312756 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0df16-dd11-4a8d-b24d-c36e56f09162 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:16.322199 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 393/774] 10.222.0.32 () {56 vars in 1137 bytes} [Wed Sep 15 02:18:16 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:16.328396 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a5f6a-5554-4e2b-974d-0e084d58132e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:16.339043 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a5f6a-5554-4e2b-974d-0e084d58132e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:16.343871 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b582b-4878-40d9-92dd-9160b8c5ae84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:16.344662 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b582b-4878-40d9-92dd-9160b8c5ae84 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:16.344970 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b582b-4878-40d9-92dd-9160b8c5ae84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:16.345253 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b582b-4878-40d9-92dd-9160b8c5ae84 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:16.356652 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b582b-4878-40d9-92dd-9160b8c5ae84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:16.358711 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b582b-4878-40d9-92dd-9160b8c5ae84 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:16.376674 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-d63b582b-4878-40d9-92dd-9160b8c5ae84 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:16.378849 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 382/775] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:16.385091 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0df16-dd11-4a8d-b24d-c36e56f09162 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:16.395157 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0df16-dd11-4a8d-b24d-c36e56f09162 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:16.399776 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd1fb6-b366-48d7-a804-600eb23f2307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:16.400433 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd1fb6-b366-48d7-a804-600eb23f2307 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:16.400717 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd1fb6-b366-48d7-a804-600eb23f2307 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:16.401036 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd1fb6-b366-48d7-a804-600eb23f2307 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:16.401767 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd1fb6-b366-48d7-a804-600eb23f2307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:16.402082 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd1fb6-b366-48d7-a804-600eb23f2307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:16.403750 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd1fb6-b366-48d7-a804-600eb23f2307 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:16.416820 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 394/776] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:16.422926 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b582b-4878-40d9-92dd-9160b8c5ae84 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:16.433986 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b582b-4878-40d9-92dd-9160b8c5ae84 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:16.441126 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1f731-2d85-437d-a70b-5d5b14905e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:16.444899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1f731-2d85-437d-a70b-5d5b14905e09 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:16.444899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1f731-2d85-437d-a70b-5d5b14905e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:16.444899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1f731-2d85-437d-a70b-5d5b14905e09 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:16.452298 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1f731-2d85-437d-a70b-5d5b14905e09 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:16.454499 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1f731-2d85-437d-a70b-5d5b14905e09 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:16.476850 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-8aa1f731-2d85-437d-a70b-5d5b14905e09 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 02:18:16.476850 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 383/777] 10.222.0.32 () {56 vars in 1139 bytes} [Wed Sep 15 02:18:16 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:16.477361 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd1fb6-b366-48d7-a804-600eb23f2307 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:16.489294 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd1fb6-b366-48d7-a804-600eb23f2307 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:16.501811 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59ff82-14f0-4414-8f87-e10f7f9f2806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:16.508901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59ff82-14f0-4414-8f87-e10f7f9f2806 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:16.508901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59ff82-14f0-4414-8f87-e10f7f9f2806 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:16.508901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59ff82-14f0-4414-8f87-e10f7f9f2806 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:16.508901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59ff82-14f0-4414-8f87-e10f7f9f2806 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:16.508901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59ff82-14f0-4414-8f87-e10f7f9f2806 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:16.508901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59ff82-14f0-4414-8f87-e10f7f9f2806 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:16.532249 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 395/778] 10.222.0.32 () {56 vars in 1171 bytes} [Wed Sep 15 02:18:16 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:16.551542 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1f731-2d85-437d-a70b-5d5b14905e09 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:16.562119 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1f731-2d85-437d-a70b-5d5b14905e09 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:16.569437 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896044d7-0502-425f-9601-68687c11ce19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:16.570142 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896044d7-0502-425f-9601-68687c11ce19 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:16.570428 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896044d7-0502-425f-9601-68687c11ce19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:16.570749 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896044d7-0502-425f-9601-68687c11ce19 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:16.581531 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896044d7-0502-425f-9601-68687c11ce19 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:16.585742 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896044d7-0502-425f-9601-68687c11ce19 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:16.596233 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 384/779] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:18:16 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:18:16.606250 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59ff82-14f0-4414-8f87-e10f7f9f2806 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:16.617149 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59ff82-14f0-4414-8f87-e10f7f9f2806 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:16.621798 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c5668-8004-43b4-9c31-93f5fcc78b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:16.622588 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c5668-8004-43b4-9c31-93f5fcc78b2f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:16.622871 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c5668-8004-43b4-9c31-93f5fcc78b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:16.623155 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c5668-8004-43b4-9c31-93f5fcc78b2f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:16.634254 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c5668-8004-43b4-9c31-93f5fcc78b2f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:16.636129 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c5668-8004-43b4-9c31-93f5fcc78b2f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:16.653531 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-5e3c5668-8004-43b4-9c31-93f5fcc78b2f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:16.655007 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 396/780] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:16.661252 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896044d7-0502-425f-9601-68687c11ce19 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:16.670416 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896044d7-0502-425f-9601-68687c11ce19 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:16.675780 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c48ff3-a501-4275-9264-2cd69012fd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:16.676513 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c48ff3-a501-4275-9264-2cd69012fd4c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:16.676801 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c48ff3-a501-4275-9264-2cd69012fd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:16.677106 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c48ff3-a501-4275-9264-2cd69012fd4c admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:16.677834 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c48ff3-a501-4275-9264-2cd69012fd4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:16.678144 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c48ff3-a501-4275-9264-2cd69012fd4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:16.679778 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c48ff3-a501-4275-9264-2cd69012fd4c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:16.697278 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 385/781] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:16.699272 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c5668-8004-43b4-9c31-93f5fcc78b2f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:16.711740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c5668-8004-43b4-9c31-93f5fcc78b2f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:16.714736 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243a3ac-42ad-44c9-99a8-108c7a1d648b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:16.715578 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243a3ac-42ad-44c9-99a8-108c7a1d648b admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:16.715864 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243a3ac-42ad-44c9-99a8-108c7a1d648b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:16.716145 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243a3ac-42ad-44c9-99a8-108c7a1d648b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:16.728898 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243a3ac-42ad-44c9-99a8-108c7a1d648b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:16.728898 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243a3ac-42ad-44c9-99a8-108c7a1d648b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:16.740898 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-a243a3ac-42ad-44c9-99a8-108c7a1d648b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:18:16.741500 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 397/782] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:16.756899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c48ff3-a501-4275-9264-2cd69012fd4c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:16.770280 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c48ff3-a501-4275-9264-2cd69012fd4c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:16.776393 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f06097-fd30-490f-ac7f-5a552e0ba208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:16.778457 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f06097-fd30-490f-ac7f-5a552e0ba208 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:16.778756 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f06097-fd30-490f-ac7f-5a552e0ba208 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:16.779041 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f06097-fd30-490f-ac7f-5a552e0ba208 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:16.779980 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f06097-fd30-490f-ac7f-5a552e0ba208 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:16.780302 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f06097-fd30-490f-ac7f-5a552e0ba208 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:16.784795 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f06097-fd30-490f-ac7f-5a552e0ba208 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:16.803979 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 386/783] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:18:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:16.816027 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243a3ac-42ad-44c9-99a8-108c7a1d648b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:16.827065 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243a3ac-42ad-44c9-99a8-108c7a1d648b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:16.833611 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a3126-c886-4f5f-8724-6d7147ae188a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:16.834327 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a3126-c886-4f5f-8724-6d7147ae188a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:16.834615 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a3126-c886-4f5f-8724-6d7147ae188a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:16.834890 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a3126-c886-4f5f-8724-6d7147ae188a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:16.835788 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a3126-c886-4f5f-8724-6d7147ae188a admin admin] RBAC: Adding query filter params (role.id=9cc55fd0231448e2be372853425c8d01, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=a93401007dd64d88af5e41ff08679a28) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:16.836101 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a3126-c886-4f5f-8724-6d7147ae188a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:16.838115 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a3126-c886-4f5f-8724-6d7147ae188a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:16.844909 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 398/784] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:18:16 2021] GET /identity/v3/role_assignments?user.id=a93401007dd64d88af5e41ff08679a28&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=9cc55fd0231448e2be372853425c8d01 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:16.865920 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12004bd-3b59-4939-a54b-3b014d3dff16 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:16.866250 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12004bd-3b59-4939-a54b-3b014d3dff16 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:16.866487 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12004bd-3b59-4939-a54b-3b014d3dff16 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:16.868505 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 387/785] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:16.876366 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d356d6-ff39-4588-947f-371a9fab51ed None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:16.876665 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d356d6-ff39-4588-947f-371a9fab51ed None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:16.876990 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d356d6-ff39-4588-947f-371a9fab51ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:16.884408 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a294965-eb51-485b-8631-40bb0d32be6d None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:16.884691 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a294965-eb51-485b-8631-40bb0d32be6d None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:16.885079 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a294965-eb51-485b-8631-40bb0d32be6d None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:16.888976 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 388/786] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:18:16.895448 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a1e12-9deb-45e9-a71c-b1b607f7be6d None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:16.895734 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a1e12-9deb-45e9-a71c-b1b607f7be6d None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:16.896015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a1e12-9deb-45e9-a71c-b1b607f7be6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:16.900243 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-77d356d6-ff39-4588-947f-371a9fab51ed None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:16.901809 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-77d356d6-ff39-4588-947f-371a9fab51ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:16.915574 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 399/787] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:16 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:16.922481 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-d37a1e12-9deb-45e9-a71c-b1b607f7be6d None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:16.924147 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-d37a1e12-9deb-45e9-a71c-b1b607f7be6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:16.936971 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 389/788] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:16 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:16.953315 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d356d6-ff39-4588-947f-371a9fab51ed None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:16.965948 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a1e12-9deb-45e9-a71c-b1b607f7be6d None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:16.968853 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d356d6-ff39-4588-947f-371a9fab51ed None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:16.974544 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c9828-802d-4c59-bfb0-4a055596957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:16.975326 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c9828-802d-4c59-bfb0-4a055596957b admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:16.975677 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c9828-802d-4c59-bfb0-4a055596957b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:16.976045 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c9828-802d-4c59-bfb0-4a055596957b admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:16.976849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c9828-802d-4c59-bfb0-4a055596957b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:16.978603 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c9828-802d-4c59-bfb0-4a055596957b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:16.981910 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a1e12-9deb-45e9-a71c-b1b607f7be6d None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:16.988123 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefd059-86ff-4593-aefd-83852c5e893f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:16.988997 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefd059-86ff-4593-aefd-83852c5e893f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:16.989276 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefd059-86ff-4593-aefd-83852c5e893f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:16.990810 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefd059-86ff-4593-aefd-83852c5e893f admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:16.990810 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefd059-86ff-4593-aefd-83852c5e893f admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:16.991789 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beefd059-86ff-4593-aefd-83852c5e893f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:16.997408 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 400/789] 10.222.0.32 () {60 vars in 1163 bytes} [Wed Sep 15 02:18:16 2021] POST /identity/v3/services => generated 251 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:18:17.013567 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-beefd059-86ff-4593-aefd-83852c5e893f admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 02:18:17.014962 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 390/790] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Sep 15 02:18:16 2021] GET /identity/v3/services/object-store => generated 93 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:17.031979 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c9828-802d-4c59-bfb0-4a055596957b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:17.072777 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c9828-802d-4c59-bfb0-4a055596957b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:17.081771 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896839a-6eb4-4bad-a133-924423133efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:17.082826 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896839a-6eb4-4bad-a133-924423133efd admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:17.083333 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896839a-6eb4-4bad-a133-924423133efd admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:17.083807 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896839a-6eb4-4bad-a133-924423133efd admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:17.084733 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896839a-6eb4-4bad-a133-924423133efd admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:17.085296 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896839a-6eb4-4bad-a133-924423133efd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:17.088277 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896839a-6eb4-4bad-a133-924423133efd admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:17.094523 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 401/791] 10.222.0.32 () {56 vars in 1144 bytes} [Wed Sep 15 02:18:17 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:17.101443 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefd059-86ff-4593-aefd-83852c5e893f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:17.116293 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefd059-86ff-4593-aefd-83852c5e893f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:17.121575 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1d3bf-ebd5-410e-823e-3f4487606d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:17.124932 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1d3bf-ebd5-410e-823e-3f4487606d7a admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:17.124932 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1d3bf-ebd5-410e-823e-3f4487606d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:17.124932 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1d3bf-ebd5-410e-823e-3f4487606d7a admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:17.124932 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1d3bf-ebd5-410e-823e-3f4487606d7a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:17.124932 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1d3bf-ebd5-410e-823e-3f4487606d7a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:17.126194 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1d3bf-ebd5-410e-823e-3f4487606d7a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:17.132515 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 391/792] 10.222.0.32 () {56 vars in 1144 bytes} [Wed Sep 15 02:18:17 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:17.626883 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e18e84-4d53-4d30-aa20-da0d6edeaa28 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:17.627969 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e18e84-4d53-4d30-aa20-da0d6edeaa28 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:17.627969 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e18e84-4d53-4d30-aa20-da0d6edeaa28 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:17.630013 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 402/793] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:17.637475 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293cac0-a25a-46f7-b748-4537168c84dc None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:17.637903 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293cac0-a25a-46f7-b748-4537168c84dc None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:17.638093 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293cac0-a25a-46f7-b748-4537168c84dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:17.656182 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-b293cac0-a25a-46f7-b748-4537168c84dc None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:17.657407 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b293cac0-a25a-46f7-b748-4537168c84dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:17.665617 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 392/794] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:17 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:17.688772 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e18e84-4d53-4d30-aa20-da0d6edeaa28 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:17.701569 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e18e84-4d53-4d30-aa20-da0d6edeaa28 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:17.706734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23b548-c338-468a-ae74-ccb60cef2202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:17.707532 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23b548-c338-468a-ae74-ccb60cef2202 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:17.707814 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23b548-c338-468a-ae74-ccb60cef2202 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:17.708086 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e23b548-c338-468a-ae74-ccb60cef2202 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:17.708738 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23b548-c338-468a-ae74-ccb60cef2202 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:17.710358 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e23b548-c338-468a-ae74-ccb60cef2202 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:17.721780 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-9e23b548-c338-468a-ae74-ccb60cef2202 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 02:18:17.723244 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 403/795] 10.222.0.32 () {56 vars in 1154 bytes} [Wed Sep 15 02:18:17 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:17.729787 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293cac0-a25a-46f7-b748-4537168c84dc None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:17.739010 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293cac0-a25a-46f7-b748-4537168c84dc None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:17.743637 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d88b9-0e8a-4ec0-92fa-46374beebcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:17.744310 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d88b9-0e8a-4ec0-92fa-46374beebcad admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:17.744593 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d88b9-0e8a-4ec0-92fa-46374beebcad admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:17.744867 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d88b9-0e8a-4ec0-92fa-46374beebcad admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:17.745607 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d88b9-0e8a-4ec0-92fa-46374beebcad admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:17.745915 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d88b9-0e8a-4ec0-92fa-46374beebcad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:17.747504 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d88b9-0e8a-4ec0-92fa-46374beebcad admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:17.753248 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 393/796] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Sep 15 02:18:17 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:17.759476 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23b548-c338-468a-ae74-ccb60cef2202 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:17.769784 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e23b548-c338-468a-ae74-ccb60cef2202 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:17.774522 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c3db7-2d41-4f2e-9e26-ac52eda055ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:17.775243 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c3db7-2d41-4f2e-9e26-ac52eda055ae admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:17.775530 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c3db7-2d41-4f2e-9e26-ac52eda055ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:17.775859 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c3db7-2d41-4f2e-9e26-ac52eda055ae admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:17.776584 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c3db7-2d41-4f2e-9e26-ac52eda055ae admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:17.776887 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c3db7-2d41-4f2e-9e26-ac52eda055ae admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:17.778544 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c3db7-2d41-4f2e-9e26-ac52eda055ae admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:17.783920 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 404/797] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Sep 15 02:18:17 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:17.790348 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d88b9-0e8a-4ec0-92fa-46374beebcad admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:17.800415 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d88b9-0e8a-4ec0-92fa-46374beebcad admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:17.805327 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc88f1-7dd0-4d9b-9573-3919745dd3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:17.806026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc88f1-7dd0-4d9b-9573-3919745dd3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:17.806367 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc88f1-7dd0-4d9b-9573-3919745dd3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:17.806648 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc88f1-7dd0-4d9b-9573-3919745dd3b0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:17.807436 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc88f1-7dd0-4d9b-9573-3919745dd3b0 admin admin] RBAC: Adding query filter params (interface=public, service_id=1a090a1587fb43b2baba2b5f4d0f84a6, region_id=RegionOne) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:17.807797 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc88f1-7dd0-4d9b-9573-3919745dd3b0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:17.808801 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING py.warnings [None req-20dc88f1-7dd0-4d9b-9573-3919745dd3b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:18:17.808801 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: warnings.warn(msg) Sep 15 02:18:17.808801 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: Sep 15 02:18:17.809755 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc88f1-7dd0-4d9b-9573-3919745dd3b0 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:17.818369 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 394/798] 10.222.0.32 () {56 vars in 1273 bytes} [Wed Sep 15 02:18:17 2021] GET /identity/v3/endpoints?service_id=1a090a1587fb43b2baba2b5f4d0f84a6&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:17.824070 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c3db7-2d41-4f2e-9e26-ac52eda055ae admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:17.834480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c3db7-2d41-4f2e-9e26-ac52eda055ae admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:17.839417 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56820c6-9d40-44ed-bd16-420c97cb9ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:17.840086 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56820c6-9d40-44ed-bd16-420c97cb9ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:17.840424 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56820c6-9d40-44ed-bd16-420c97cb9ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:17.840709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56820c6-9d40-44ed-bd16-420c97cb9ba6 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:17.841442 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56820c6-9d40-44ed-bd16-420c97cb9ba6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:17.843149 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56820c6-9d40-44ed-bd16-420c97cb9ba6 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:17.849664 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 405/799] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Sep 15 02:18:17 2021] GET /identity/v3/services => generated 1268 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:18:19.141453 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4dce8-a3fa-4262-acbd-612f844be12e None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.142202 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4dce8-a3fa-4262-acbd-612f844be12e None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.142202 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4dce8-a3fa-4262-acbd-612f844be12e None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.144242 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 395/800] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:19.152505 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a9426-a15d-4313-a67e-bd2463e77845 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.153196 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a9426-a15d-4313-a67e-bd2463e77845 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.153196 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a9426-a15d-4313-a67e-bd2463e77845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.172916 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-cc3a9426-a15d-4313-a67e-bd2463e77845 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:19.174214 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-cc3a9426-a15d-4313-a67e-bd2463e77845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:19.188981 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 406/801] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:19 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:19.207017 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4dce8-a3fa-4262-acbd-612f844be12e None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:19.219807 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4dce8-a3fa-4262-acbd-612f844be12e None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:19.224378 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfcb56-b661-4706-8c87-6401a9b7f4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:19.225240 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfcb56-b661-4706-8c87-6401a9b7f4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.225708 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfcb56-b661-4706-8c87-6401a9b7f4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.226231 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfcb56-b661-4706-8c87-6401a9b7f4d2 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.238091 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfcb56-b661-4706-8c87-6401a9b7f4d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:18:19.245440 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-29dfcb56-b661-4706-8c87-6401a9b7f4d2 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 02:18:19.245630 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4ec9c-ee2c-4c52-ab2b-48edcd77d7e9 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.245897 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4ec9c-ee2c-4c52-ab2b-48edcd77d7e9 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.246240 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4ec9c-ee2c-4c52-ab2b-48edcd77d7e9 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.248270 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 407/803] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:18:19.250754 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 396/803] 10.222.0.32 () {56 vars in 1142 bytes} [Wed Sep 15 02:18:19 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:19.253877 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4ec9c-ee2c-4c52-ab2b-48edcd77d7e9 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:19.256627 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356772b-d01e-4cb4-aaac-4160249e0032 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.257051 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356772b-d01e-4cb4-aaac-4160249e0032 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.257336 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356772b-d01e-4cb4-aaac-4160249e0032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.267455 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4ec9c-ee2c-4c52-ab2b-48edcd77d7e9 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:19.272902 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fcf25-aa19-4087-8e77-29ae451407b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:19.273687 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fcf25-aa19-4087-8e77-29ae451407b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.274078 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fcf25-aa19-4087-8e77-29ae451407b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.274468 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fcf25-aa19-4087-8e77-29ae451407b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.275411 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fcf25-aa19-4087-8e77-29ae451407b5 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:19.275609 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-5356772b-d01e-4cb4-aaac-4160249e0032 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:19.275947 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fcf25-aa19-4087-8e77-29ae451407b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:19.276764 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-5356772b-d01e-4cb4-aaac-4160249e0032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:19.277911 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fcf25-aa19-4087-8e77-29ae451407b5 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:19.285599 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 397/804] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:19 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:19.293023 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 408/805] 10.222.0.32 () {56 vars in 1137 bytes} [Wed Sep 15 02:18:19 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:19.295515 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356772b-d01e-4cb4-aaac-4160249e0032 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:19.306089 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356772b-d01e-4cb4-aaac-4160249e0032 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:19.310911 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d891b-11d6-4616-85a3-84d954f72d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:19.311723 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d891b-11d6-4616-85a3-84d954f72d4e admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.312002 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d891b-11d6-4616-85a3-84d954f72d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.312274 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d891b-11d6-4616-85a3-84d954f72d4e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.317033 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fcf25-aa19-4087-8e77-29ae451407b5 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:19.323468 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d891b-11d6-4616-85a3-84d954f72d4e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:19.325302 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d891b-11d6-4616-85a3-84d954f72d4e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:19.329359 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fcf25-aa19-4087-8e77-29ae451407b5 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:19.335316 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7a9d8-804f-4e96-8d6b-2f08310de139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:19.336351 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7a9d8-804f-4e96-8d6b-2f08310de139 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.336829 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7a9d8-804f-4e96-8d6b-2f08310de139 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.337323 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7a9d8-804f-4e96-8d6b-2f08310de139 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.338183 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7a9d8-804f-4e96-8d6b-2f08310de139 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:19.339987 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7a9d8-804f-4e96-8d6b-2f08310de139 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:19.342621 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-d93d891b-11d6-4616-85a3-84d954f72d4e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:19.349419 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 398/806] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:19.350755 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d891b-11d6-4616-85a3-84d954f72d4e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:19.356416 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-17c7a9d8-804f-4e96-8d6b-2f08310de139 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 02:18:19.362872 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d891b-11d6-4616-85a3-84d954f72d4e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:19.363149 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 409/807] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:18:19 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:18:19.366274 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c5246-b60a-4cb8-8f9a-47146a4d82da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:19.366978 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c5246-b60a-4cb8-8f9a-47146a4d82da admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.367242 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7a9d8-804f-4e96-8d6b-2f08310de139 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:19.367355 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c5246-b60a-4cb8-8f9a-47146a4d82da admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.367656 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c5246-b60a-4cb8-8f9a-47146a4d82da admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.368457 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c5246-b60a-4cb8-8f9a-47146a4d82da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:19.368831 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c5246-b60a-4cb8-8f9a-47146a4d82da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:19.370484 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c5246-b60a-4cb8-8f9a-47146a4d82da admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:19.379382 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7a9d8-804f-4e96-8d6b-2f08310de139 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:19.386596 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 399/808] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:19.386596 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea9aa8-407d-4450-b533-871e1b4d6cda None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.386596 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea9aa8-407d-4450-b533-871e1b4d6cda None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.386596 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea9aa8-407d-4450-b533-871e1b4d6cda None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.386596 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 400/809] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:18:19.389111 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea9aa8-407d-4450-b533-871e1b4d6cda None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:19.389480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48fbb0-e086-47cb-b394-7965d9389b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:19.390404 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48fbb0-e086-47cb-b394-7965d9389b11 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.390884 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48fbb0-e086-47cb-b394-7965d9389b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.391332 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48fbb0-e086-47cb-b394-7965d9389b11 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.392268 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48fbb0-e086-47cb-b394-7965d9389b11 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:19.393308 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48fbb0-e086-47cb-b394-7965d9389b11 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:19.395195 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48fbb0-e086-47cb-b394-7965d9389b11 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:19.400314 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 410/810] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:18:19 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:19.401808 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c546f-b45f-4d82-beaa-7d222c887195 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.401918 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea9aa8-407d-4450-b533-871e1b4d6cda None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:19.402419 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c546f-b45f-4d82-beaa-7d222c887195 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.402893 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c546f-b45f-4d82-beaa-7d222c887195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.406918 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1f963-3561-4bee-b198-18e83167a21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:19.407794 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1f963-3561-4bee-b198-18e83167a21e admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.408076 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1f963-3561-4bee-b198-18e83167a21e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.408449 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1f963-3561-4bee-b198-18e83167a21e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.417180 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1f963-3561-4bee-b198-18e83167a21e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:19.419148 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f1f963-3561-4bee-b198-18e83167a21e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:19.421903 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-979c546f-b45f-4d82-beaa-7d222c887195 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:19.423079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-979c546f-b45f-4d82-beaa-7d222c887195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:19.430971 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 411/811] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:19 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:19.431532 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c546f-b45f-4d82-beaa-7d222c887195 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:19.432612 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-49f1f963-3561-4bee-b198-18e83167a21e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 02:18:19.438846 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 401/812] 10.222.0.32 () {56 vars in 1139 bytes} [Wed Sep 15 02:18:19 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:18:19.441240 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1f963-3561-4bee-b198-18e83167a21e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:19.442808 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c546f-b45f-4d82-beaa-7d222c887195 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:19.447494 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797685bd-3445-4d35-a261-ad09879efb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:19.448273 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797685bd-3445-4d35-a261-ad09879efb0c admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.448872 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797685bd-3445-4d35-a261-ad09879efb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.449004 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797685bd-3445-4d35-a261-ad09879efb0c admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.450007 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797685bd-3445-4d35-a261-ad09879efb0c admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:19.450406 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797685bd-3445-4d35-a261-ad09879efb0c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:19.452090 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797685bd-3445-4d35-a261-ad09879efb0c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:19.452976 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1f963-3561-4bee-b198-18e83167a21e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:19.463079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 412/813] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:18:19 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:19.463079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797685bd-3445-4d35-a261-ad09879efb0c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:19.463932 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511e269-4720-49fe-b7bd-c36f0da85844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:19.464661 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511e269-4720-49fe-b7bd-c36f0da85844 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.464950 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511e269-4720-49fe-b7bd-c36f0da85844 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.465201 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511e269-4720-49fe-b7bd-c36f0da85844 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.466039 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511e269-4720-49fe-b7bd-c36f0da85844 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:19.466355 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511e269-4720-49fe-b7bd-c36f0da85844 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:19.469439 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797685bd-3445-4d35-a261-ad09879efb0c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:19.469555 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511e269-4720-49fe-b7bd-c36f0da85844 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:19.478403 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fcde8-1c61-4657-a241-061ff732ecf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:19.479072 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fcde8-1c61-4657-a241-061ff732ecf5 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.479353 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fcde8-1c61-4657-a241-061ff732ecf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.479627 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fcde8-1c61-4657-a241-061ff732ecf5 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.480341 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fcde8-1c61-4657-a241-061ff732ecf5 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:19.481933 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fcde8-1c61-4657-a241-061ff732ecf5 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:19.486158 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 402/814] 10.222.0.32 () {56 vars in 1171 bytes} [Wed Sep 15 02:18:19 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:19.490514 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511e269-4720-49fe-b7bd-c36f0da85844 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:19.496339 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 413/815] 10.222.0.32 () {60 vars in 1163 bytes} [Wed Sep 15 02:18:19 2021] POST /identity/v3/services => generated 241 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:18:19.497193 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fcde8-1c61-4657-a241-061ff732ecf5 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:19.501670 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511e269-4720-49fe-b7bd-c36f0da85844 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:19.518442 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fcde8-1c61-4657-a241-061ff732ecf5 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:19.519578 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864332d-7146-4610-bb41-c8f093d406c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:19.520584 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864332d-7146-4610-bb41-c8f093d406c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.521110 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864332d-7146-4610-bb41-c8f093d406c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.521589 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864332d-7146-4610-bb41-c8f093d406c0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.522781 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864332d-7146-4610-bb41-c8f093d406c0 admin admin] RBAC: Adding query filter params (interface=public, service_id=29d8bfb7cb3f4fdb95309b5ea722ca8e, region_id=RegionOne) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:19.523357 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864332d-7146-4610-bb41-c8f093d406c0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:19.523464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfad6e3-224b-42be-a894-1022c0e08100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:19.524272 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfad6e3-224b-42be-a894-1022c0e08100 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.524634 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfad6e3-224b-42be-a894-1022c0e08100 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.524941 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfad6e3-224b-42be-a894-1022c0e08100 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.526005 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864332d-7146-4610-bb41-c8f093d406c0 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:19.532435 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 403/816] 10.222.0.32 () {56 vars in 1273 bytes} [Wed Sep 15 02:18:19 2021] GET /identity/v3/endpoints?service_id=29d8bfb7cb3f4fdb95309b5ea722ca8e&interface=public®ion_id=RegionOne => generated 194 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:19.542169 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864332d-7146-4610-bb41-c8f093d406c0 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:19.543266 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfad6e3-224b-42be-a894-1022c0e08100 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:19.545339 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfad6e3-224b-42be-a894-1022c0e08100 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:19.557735 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864332d-7146-4610-bb41-c8f093d406c0 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:19.563183 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77433214-39c2-42ba-b58f-b8e007da1009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:19.564251 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77433214-39c2-42ba-b58f-b8e007da1009 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.565457 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77433214-39c2-42ba-b58f-b8e007da1009 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.565731 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-ccfad6e3-224b-42be-a894-1022c0e08100 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:19.566181 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77433214-39c2-42ba-b58f-b8e007da1009 admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.567088 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77433214-39c2-42ba-b58f-b8e007da1009 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:19.567367 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 414/817] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:19.569170 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77433214-39c2-42ba-b58f-b8e007da1009 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:19.574217 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfad6e3-224b-42be-a894-1022c0e08100 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:19.577630 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 404/818] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Sep 15 02:18:19 2021] GET /identity/v3/services => generated 1497 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:18:19.590705 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfad6e3-224b-42be-a894-1022c0e08100 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:19.597816 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d1de2-25a6-4a32-89e1-3f61a2541c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:19.598567 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d1de2-25a6-4a32-89e1-3f61a2541c4b admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.598852 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d1de2-25a6-4a32-89e1-3f61a2541c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.599131 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d1de2-25a6-4a32-89e1-3f61a2541c4b admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.600197 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d1de2-25a6-4a32-89e1-3f61a2541c4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:19.600524 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d1de2-25a6-4a32-89e1-3f61a2541c4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:19.602594 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d1de2-25a6-4a32-89e1-3f61a2541c4b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:19.617746 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 415/819] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:19.626079 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77433214-39c2-42ba-b58f-b8e007da1009 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:19.637956 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77433214-39c2-42ba-b58f-b8e007da1009 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:19.643711 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f4f0e-cc69-428a-8995-0f86847569f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:19.645003 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f4f0e-cc69-428a-8995-0f86847569f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.645581 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f4f0e-cc69-428a-8995-0f86847569f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.646061 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f4f0e-cc69-428a-8995-0f86847569f4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.654755 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f4f0e-cc69-428a-8995-0f86847569f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:19.657352 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f4f0e-cc69-428a-8995-0f86847569f4 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:19.672794 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-781f4f0e-cc69-428a-8995-0f86847569f4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:18:19.680871 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 405/820] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:19.682721 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d1de2-25a6-4a32-89e1-3f61a2541c4b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:19.694410 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d1de2-25a6-4a32-89e1-3f61a2541c4b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:19.699882 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8bcb8-eabb-4540-9a2e-bfad7795b307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:19.701090 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8bcb8-eabb-4540-9a2e-bfad7795b307 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.701600 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8bcb8-eabb-4540-9a2e-bfad7795b307 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.702119 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8bcb8-eabb-4540-9a2e-bfad7795b307 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.703134 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8bcb8-eabb-4540-9a2e-bfad7795b307 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:19.703720 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8bcb8-eabb-4540-9a2e-bfad7795b307 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:19.706025 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8bcb8-eabb-4540-9a2e-bfad7795b307 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:19.721480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 416/821] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:18:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:19.727262 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f4f0e-cc69-428a-8995-0f86847569f4 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:19.739427 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f4f0e-cc69-428a-8995-0f86847569f4 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:19.744557 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5970c48-ffbf-459a-947e-069535e6ecbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:19.745577 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5970c48-ffbf-459a-947e-069535e6ecbe admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:19.745863 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5970c48-ffbf-459a-947e-069535e6ecbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:19.746139 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5970c48-ffbf-459a-947e-069535e6ecbe admin admin] PATH_INFO: `/v3/projects/083ff2535d794e79a145a076aedeedd4/users/a93401007dd64d88af5e41ff08679a28/roles/9cc55fd0231448e2be372853425c8d01` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:19.748521 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5970c48-ffbf-459a-947e-069535e6ecbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=083ff2535d794e79a145a076aedeedd4, user_id=a93401007dd64d88af5e41ff08679a28, role_id=9cc55fd0231448e2be372853425c8d01)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:19.751338 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5970c48-ffbf-459a-947e-069535e6ecbe admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:19.769031 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 406/822] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:18:19 2021] PUT /identity/v3/projects/083ff2535d794e79a145a076aedeedd4/users/a93401007dd64d88af5e41ff08679a28/roles/9cc55fd0231448e2be372853425c8d01 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:18:20.047521 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff55075-5346-45bb-888c-52345b3cbfa0 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:20.047861 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff55075-5346-45bb-888c-52345b3cbfa0 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:20.048069 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff55075-5346-45bb-888c-52345b3cbfa0 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:20.050139 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 417/823] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:20.057325 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e0736-524f-44d8-b8bc-1c6df4a94f61 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:20.057619 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e0736-524f-44d8-b8bc-1c6df4a94f61 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:20.057897 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e0736-524f-44d8-b8bc-1c6df4a94f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:20.075818 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-4b0e0736-524f-44d8-b8bc-1c6df4a94f61 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:20.077016 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-4b0e0736-524f-44d8-b8bc-1c6df4a94f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:20.132929 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 407/824] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:20 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:20.158100 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff55075-5346-45bb-888c-52345b3cbfa0 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:20.171379 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff55075-5346-45bb-888c-52345b3cbfa0 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:20.176290 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0ae2c-122c-480c-8189-e87fc6697d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:20.177129 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0ae2c-122c-480c-8189-e87fc6697d1e admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:20.177411 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0ae2c-122c-480c-8189-e87fc6697d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:20.177682 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0ae2c-122c-480c-8189-e87fc6697d1e admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:20.178328 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0ae2c-122c-480c-8189-e87fc6697d1e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:20.179908 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0ae2c-122c-480c-8189-e87fc6697d1e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:20.191022 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-dac0ae2c-122c-480c-8189-e87fc6697d1e admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 02:18:20.192435 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 418/825] 10.222.0.32 () {56 vars in 1154 bytes} [Wed Sep 15 02:18:20 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:20.198841 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e0736-524f-44d8-b8bc-1c6df4a94f61 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:20.208350 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e0736-524f-44d8-b8bc-1c6df4a94f61 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:20.212957 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634aa4a-62aa-491f-b77d-c4e9c98558fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:20.213614 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634aa4a-62aa-491f-b77d-c4e9c98558fa admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:20.213897 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634aa4a-62aa-491f-b77d-c4e9c98558fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:20.214169 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634aa4a-62aa-491f-b77d-c4e9c98558fa admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:20.214872 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634aa4a-62aa-491f-b77d-c4e9c98558fa admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:20.215176 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634aa4a-62aa-491f-b77d-c4e9c98558fa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:20.216758 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4634aa4a-62aa-491f-b77d-c4e9c98558fa admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:20.221829 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 408/826] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Sep 15 02:18:20 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:20.227718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0ae2c-122c-480c-8189-e87fc6697d1e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:20.238525 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0ae2c-122c-480c-8189-e87fc6697d1e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:20.245125 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a17acf-ed36-4d1b-9ead-7aa33fe9588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:20.246043 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a17acf-ed36-4d1b-9ead-7aa33fe9588f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:20.246536 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a17acf-ed36-4d1b-9ead-7aa33fe9588f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:20.247017 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a17acf-ed36-4d1b-9ead-7aa33fe9588f admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:20.248044 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a17acf-ed36-4d1b-9ead-7aa33fe9588f admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:20.248583 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a17acf-ed36-4d1b-9ead-7aa33fe9588f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:20.250444 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a17acf-ed36-4d1b-9ead-7aa33fe9588f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:20.256037 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 419/827] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Sep 15 02:18:20 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:20.262516 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634aa4a-62aa-491f-b77d-c4e9c98558fa admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:20.273127 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634aa4a-62aa-491f-b77d-c4e9c98558fa admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:20.278166 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addc6e7-3a1d-4866-9687-8fd08e8e34ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:20.279085 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addc6e7-3a1d-4866-9687-8fd08e8e34ae admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:20.279567 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addc6e7-3a1d-4866-9687-8fd08e8e34ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:20.280166 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addc6e7-3a1d-4866-9687-8fd08e8e34ae admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:20.281204 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6addc6e7-3a1d-4866-9687-8fd08e8e34ae admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:20.283187 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6addc6e7-3a1d-4866-9687-8fd08e8e34ae admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:20.309116 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 409/828] 10.222.0.32 () {60 vars in 1166 bytes} [Wed Sep 15 02:18:20 2021] POST /identity/v3/endpoints => generated 347 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:18:21.772796 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48377a00-83b3-43b2-94f7-b86644e97bed None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:21.773339 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48377a00-83b3-43b2-94f7-b86644e97bed None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:21.773560 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48377a00-83b3-43b2-94f7-b86644e97bed None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:21.775452 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 420/829] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:18:21.780460 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1f046-5839-41d9-ab1f-f7dc4a37c7d2 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:21.780930 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1f046-5839-41d9-ab1f-f7dc4a37c7d2 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:21.781228 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1f046-5839-41d9-ab1f-f7dc4a37c7d2 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:21.782972 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccac9a-a92c-4749-974b-529ec10b5760 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:21.783358 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccac9a-a92c-4749-974b-529ec10b5760 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:21.784136 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccac9a-a92c-4749-974b-529ec10b5760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:21.786070 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 410/830] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:21 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:21.792865 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cf00f-18ff-45e7-af52-8d1d617b3028 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:21.793179 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cf00f-18ff-45e7-af52-8d1d617b3028 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:21.793456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cf00f-18ff-45e7-af52-8d1d617b3028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:21.805371 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-f8ccac9a-a92c-4749-974b-529ec10b5760 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:21.806560 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f8ccac9a-a92c-4749-974b-529ec10b5760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:21.811390 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-2a9cf00f-18ff-45e7-af52-8d1d617b3028 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:21.812849 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-2a9cf00f-18ff-45e7-af52-8d1d617b3028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:21.824492 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 421/831] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:21 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:21.830883 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 411/832] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:21 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:21.849625 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccac9a-a92c-4749-974b-529ec10b5760 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:21.854445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cf00f-18ff-45e7-af52-8d1d617b3028 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:21.858960 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccac9a-a92c-4749-974b-529ec10b5760 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:21.864008 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cf00f-18ff-45e7-af52-8d1d617b3028 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:21.864273 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01de47f-a35b-4939-b30f-22d3a054f222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:21.865596 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01de47f-a35b-4939-b30f-22d3a054f222 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:21.866028 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01de47f-a35b-4939-b30f-22d3a054f222 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:21.866448 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01de47f-a35b-4939-b30f-22d3a054f222 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:21.867352 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01de47f-a35b-4939-b30f-22d3a054f222 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:21.868627 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64b421-a321-4c13-8328-6f3f8f6c9eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:21.869395 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01de47f-a35b-4939-b30f-22d3a054f222 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:21.869608 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64b421-a321-4c13-8328-6f3f8f6c9eda admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:21.869956 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64b421-a321-4c13-8328-6f3f8f6c9eda admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:21.870290 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64b421-a321-4c13-8328-6f3f8f6c9eda admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:21.871021 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64b421-a321-4c13-8328-6f3f8f6c9eda admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:21.872723 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64b421-a321-4c13-8328-6f3f8f6c9eda admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:21.882438 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-a01de47f-a35b-4939-b30f-22d3a054f222 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 02:18:21.884303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 422/833] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Sep 15 02:18:21 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:21.888930 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-5d64b421-a321-4c13-8328-6f3f8f6c9eda admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 02:18:21.888930 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 412/834] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:18:21 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:21.891893 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01de47f-a35b-4939-b30f-22d3a054f222 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:21.893329 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64b421-a321-4c13-8328-6f3f8f6c9eda admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:21.903100 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01de47f-a35b-4939-b30f-22d3a054f222 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:21.903297 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64b421-a321-4c13-8328-6f3f8f6c9eda admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:21.908066 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e111b4a-5a1d-4f2e-8cee-f357f2c1cd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:21.909443 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e111b4a-5a1d-4f2e-8cee-f357f2c1cd31 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:21.909687 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e111b4a-5a1d-4f2e-8cee-f357f2c1cd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:21.909958 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e111b4a-5a1d-4f2e-8cee-f357f2c1cd31 admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:21.910602 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f670a60-a0f3-4f75-bd07-d3888ecf846f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:21.910738 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e111b4a-5a1d-4f2e-8cee-f357f2c1cd31 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:21.910962 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e111b4a-5a1d-4f2e-8cee-f357f2c1cd31 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:21.911749 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f670a60-a0f3-4f75-bd07-d3888ecf846f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:21.912204 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f670a60-a0f3-4f75-bd07-d3888ecf846f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:21.912550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e111b4a-5a1d-4f2e-8cee-f357f2c1cd31 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:21.912859 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f670a60-a0f3-4f75-bd07-d3888ecf846f admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:21.913779 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f670a60-a0f3-4f75-bd07-d3888ecf846f admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:21.914269 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f670a60-a0f3-4f75-bd07-d3888ecf846f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:21.916033 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f670a60-a0f3-4f75-bd07-d3888ecf846f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:21.918089 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 413/835] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:18:21 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:21.921678 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 423/836] 10.222.0.32 () {56 vars in 1144 bytes} [Wed Sep 15 02:18:21 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:21.926943 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e111b4a-5a1d-4f2e-8cee-f357f2c1cd31 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:21.928173 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f670a60-a0f3-4f75-bd07-d3888ecf846f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:21.937645 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e111b4a-5a1d-4f2e-8cee-f357f2c1cd31 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:21.941341 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f670a60-a0f3-4f75-bd07-d3888ecf846f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:21.942746 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b111a60-abeb-441d-9375-3190a4cd36be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:21.943815 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b111a60-abeb-441d-9375-3190a4cd36be admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:21.944245 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b111a60-abeb-441d-9375-3190a4cd36be admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:21.944730 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b111a60-abeb-441d-9375-3190a4cd36be admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:21.945753 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b111a60-abeb-441d-9375-3190a4cd36be admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:21.946286 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b111a60-abeb-441d-9375-3190a4cd36be admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:21.946576 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5fcad-c965-4abe-8970-54b60cb80c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:21.947319 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5fcad-c965-4abe-8970-54b60cb80c5f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:21.947694 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5fcad-c965-4abe-8970-54b60cb80c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:21.948057 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5fcad-c965-4abe-8970-54b60cb80c5f admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:21.948707 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b111a60-abeb-441d-9375-3190a4cd36be admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:21.948961 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5fcad-c965-4abe-8970-54b60cb80c5f admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:21.949357 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5fcad-c965-4abe-8970-54b60cb80c5f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:21.951017 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5fcad-c965-4abe-8970-54b60cb80c5f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:21.954872 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 414/837] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Sep 15 02:18:21 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:21.960931 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 424/838] 10.222.0.32 () {56 vars in 1144 bytes} [Wed Sep 15 02:18:21 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:21.961845 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b111a60-abeb-441d-9375-3190a4cd36be admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:21.963335 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5fcad-c965-4abe-8970-54b60cb80c5f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:21.972660 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b111a60-abeb-441d-9375-3190a4cd36be admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:21.973841 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5fcad-c965-4abe-8970-54b60cb80c5f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:21.978629 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccdff88-fcd6-471d-9640-304e07c70986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:21.979161 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc46a62-704c-44d8-8f50-ccab27c024c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:21.979412 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdff88-fcd6-471d-9640-304e07c70986 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:21.979770 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdff88-fcd6-471d-9640-304e07c70986 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:21.980040 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc46a62-704c-44d8-8f50-ccab27c024c9 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:21.980155 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccdff88-fcd6-471d-9640-304e07c70986 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:21.980431 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc46a62-704c-44d8-8f50-ccab27c024c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:21.980704 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc46a62-704c-44d8-8f50-ccab27c024c9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:21.981152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdff88-fcd6-471d-9640-304e07c70986 admin admin] RBAC: Adding query filter params (interface=public, service_id=8cc138563fd24349b77e6560e0f068b6, region_id=RegionOne) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:21.981465 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdff88-fcd6-471d-9640-304e07c70986 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:21.981822 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc46a62-704c-44d8-8f50-ccab27c024c9 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:21.983041 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccdff88-fcd6-471d-9640-304e07c70986 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:21.984071 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc46a62-704c-44d8-8f50-ccab27c024c9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:21.990359 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 425/839] 10.222.0.32 () {56 vars in 1273 bytes} [Wed Sep 15 02:18:21 2021] GET /identity/v3/endpoints?service_id=8cc138563fd24349b77e6560e0f068b6&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:21.992074 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63845c-858d-465b-9db0-2fe0bf1a325b None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:21.992696 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63845c-858d-465b-9db0-2fe0bf1a325b None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:21.993625 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63845c-858d-465b-9db0-2fe0bf1a325b None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:21.995826 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 426/840] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:21.996622 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63845c-858d-465b-9db0-2fe0bf1a325b None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:22.013043 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 415/841] 10.222.0.32 () {60 vars in 1166 bytes} [Wed Sep 15 02:18:21 2021] POST /identity/v3/endpoints => generated 346 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:18:22.015441 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c90ae-e02e-44d6-af50-4041a46a1072 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:22.016051 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c90ae-e02e-44d6-af50-4041a46a1072 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:22.016505 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c90ae-e02e-44d6-af50-4041a46a1072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:22.020396 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c63845c-858d-465b-9db0-2fe0bf1a325b None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:22.025573 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb40cc-3a91-4b28-8c2f-e6880845bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:22.026097 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb40cc-3a91-4b28-8c2f-e6880845bcfc admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:22.026456 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb40cc-3a91-4b28-8c2f-e6880845bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:22.026807 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb40cc-3a91-4b28-8c2f-e6880845bcfc admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:22.028187 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb40cc-3a91-4b28-8c2f-e6880845bcfc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:22.029371 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb40cc-3a91-4b28-8c2f-e6880845bcfc admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:22.044929 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 427/842] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Sep 15 02:18:21 2021] GET /identity/v3/services => generated 1497 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:18:22.050074 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-4c8c90ae-e02e-44d6-af50-4041a46a1072 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:22.051436 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-4c8c90ae-e02e-44d6-af50-4041a46a1072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:22.059955 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 416/843] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:22 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:22.086084 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb40cc-3a91-4b28-8c2f-e6880845bcfc admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:22.099071 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb40cc-3a91-4b28-8c2f-e6880845bcfc admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:22.104119 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3ea2b-103b-4d7a-ae67-63e829869a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:22.105004 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3ea2b-103b-4d7a-ae67-63e829869a40 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:22.105293 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3ea2b-103b-4d7a-ae67-63e829869a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:22.105565 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3ea2b-103b-4d7a-ae67-63e829869a40 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:22.119032 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3ea2b-103b-4d7a-ae67-63e829869a40 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:18:22.126835 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-05a3ea2b-103b-4d7a-ae67-63e829869a40 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 02:18:22.132992 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 428/844] 10.222.0.32 () {56 vars in 1142 bytes} [Wed Sep 15 02:18:22 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:22.136074 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c90ae-e02e-44d6-af50-4041a46a1072 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:22.146489 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c90ae-e02e-44d6-af50-4041a46a1072 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:22.151526 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f90553-8207-4498-8dde-3be1188eebbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:22.152410 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f90553-8207-4498-8dde-3be1188eebbb admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:22.152746 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f90553-8207-4498-8dde-3be1188eebbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:22.153065 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f90553-8207-4498-8dde-3be1188eebbb admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:22.154114 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f90553-8207-4498-8dde-3be1188eebbb admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:22.154552 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f90553-8207-4498-8dde-3be1188eebbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:22.156379 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f90553-8207-4498-8dde-3be1188eebbb admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:22.172549 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 417/845] 10.222.0.32 () {56 vars in 1137 bytes} [Wed Sep 15 02:18:22 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:22.176067 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3ea2b-103b-4d7a-ae67-63e829869a40 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:22.186571 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3ea2b-103b-4d7a-ae67-63e829869a40 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:22.191705 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd748a-7546-452f-b63d-1cfd0202b294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:22.192562 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd748a-7546-452f-b63d-1cfd0202b294 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:22.192919 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd748a-7546-452f-b63d-1cfd0202b294 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:22.193197 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd748a-7546-452f-b63d-1cfd0202b294 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:22.206466 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd748a-7546-452f-b63d-1cfd0202b294 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:22.208345 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd748a-7546-452f-b63d-1cfd0202b294 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:22.227247 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-1bdd748a-7546-452f-b63d-1cfd0202b294 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:22.229710 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 429/846] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:22.235279 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f90553-8207-4498-8dde-3be1188eebbb admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:22.247905 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f90553-8207-4498-8dde-3be1188eebbb admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:22.254154 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a4276-0118-40f6-854e-f2278d98cead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:22.254838 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a4276-0118-40f6-854e-f2278d98cead admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:22.255124 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a4276-0118-40f6-854e-f2278d98cead admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:22.255398 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a4276-0118-40f6-854e-f2278d98cead admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:22.256128 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a4276-0118-40f6-854e-f2278d98cead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:22.256432 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a4276-0118-40f6-854e-f2278d98cead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:22.258057 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a4276-0118-40f6-854e-f2278d98cead admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:22.272079 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 418/847] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:22.280436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd748a-7546-452f-b63d-1cfd0202b294 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:22.290917 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd748a-7546-452f-b63d-1cfd0202b294 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:22.295576 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bced1-91b2-4ac0-88a8-582e0f74e44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:22.296389 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bced1-91b2-4ac0-88a8-582e0f74e44d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:22.296670 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bced1-91b2-4ac0-88a8-582e0f74e44d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:22.296974 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bced1-91b2-4ac0-88a8-582e0f74e44d admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:22.305397 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87bced1-91b2-4ac0-88a8-582e0f74e44d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:22.307466 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87bced1-91b2-4ac0-88a8-582e0f74e44d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:22.321741 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-d87bced1-91b2-4ac0-88a8-582e0f74e44d admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 02:18:22.323283 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 430/848] 10.222.0.32 () {56 vars in 1139 bytes} [Wed Sep 15 02:18:22 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:18:22.329550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a4276-0118-40f6-854e-f2278d98cead admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:22.339434 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a4276-0118-40f6-854e-f2278d98cead admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:22.344217 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555ee98-c767-4823-8e55-4002dd24cbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:22.345069 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555ee98-c767-4823-8e55-4002dd24cbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:22.345487 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555ee98-c767-4823-8e55-4002dd24cbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:22.346399 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555ee98-c767-4823-8e55-4002dd24cbc7 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:22.347362 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555ee98-c767-4823-8e55-4002dd24cbc7 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:22.347824 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555ee98-c767-4823-8e55-4002dd24cbc7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:22.349828 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d555ee98-c767-4823-8e55-4002dd24cbc7 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:22.373015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 419/849] 10.222.0.32 () {56 vars in 1171 bytes} [Wed Sep 15 02:18:22 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:22.379209 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bced1-91b2-4ac0-88a8-582e0f74e44d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:22.389971 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bced1-91b2-4ac0-88a8-582e0f74e44d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:22.395535 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0c2a8-0828-4f86-891c-7659d2519ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:22.396367 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0c2a8-0828-4f86-891c-7659d2519ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:22.396787 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0c2a8-0828-4f86-891c-7659d2519ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:22.397216 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0c2a8-0828-4f86-891c-7659d2519ce2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:22.405826 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0c2a8-0828-4f86-891c-7659d2519ce2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:22.407840 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0c2a8-0828-4f86-891c-7659d2519ce2 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:22.418113 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 431/850] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:18:22 2021] GET /identity/v3/auth/tokens => generated 2291 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:18:22.424603 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555ee98-c767-4823-8e55-4002dd24cbc7 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:22.435160 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555ee98-c767-4823-8e55-4002dd24cbc7 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:22.440560 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f24a2-adf5-4301-8c81-0a4dd4bdbc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:22.441736 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f24a2-adf5-4301-8c81-0a4dd4bdbc49 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:22.442201 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f24a2-adf5-4301-8c81-0a4dd4bdbc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:22.442617 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f24a2-adf5-4301-8c81-0a4dd4bdbc49 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:22.454561 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f24a2-adf5-4301-8c81-0a4dd4bdbc49 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:22.457437 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f24a2-adf5-4301-8c81-0a4dd4bdbc49 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:22.476647 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-f48f24a2-adf5-4301-8c81-0a4dd4bdbc49 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:22.478440 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 420/851] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:22.484849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0c2a8-0828-4f86-891c-7659d2519ce2 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:22.494187 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0c2a8-0828-4f86-891c-7659d2519ce2 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:22.498980 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc47902-b262-4d63-9b1b-cd6a1e44b016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:22.499626 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc47902-b262-4d63-9b1b-cd6a1e44b016 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:22.499904 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc47902-b262-4d63-9b1b-cd6a1e44b016 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:22.500173 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc47902-b262-4d63-9b1b-cd6a1e44b016 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:22.500913 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc47902-b262-4d63-9b1b-cd6a1e44b016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:22.501217 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc47902-b262-4d63-9b1b-cd6a1e44b016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:22.502818 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc47902-b262-4d63-9b1b-cd6a1e44b016 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:22.514836 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 432/852] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:22.521217 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f24a2-adf5-4301-8c81-0a4dd4bdbc49 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:22.530951 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f24a2-adf5-4301-8c81-0a4dd4bdbc49 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:22.536183 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef23806-5167-4c31-9193-1c409119a3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:22.537039 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef23806-5167-4c31-9193-1c409119a3dd admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:22.537369 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef23806-5167-4c31-9193-1c409119a3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:22.537640 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef23806-5167-4c31-9193-1c409119a3dd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:22.544572 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef23806-5167-4c31-9193-1c409119a3dd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:22.546560 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef23806-5167-4c31-9193-1c409119a3dd admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:22.549485 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc691b0-c36f-494e-9a93-d5ed985e4af4 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:22.549982 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc691b0-c36f-494e-9a93-d5ed985e4af4 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:22.550466 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc691b0-c36f-494e-9a93-d5ed985e4af4 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:22.552445 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 433/853] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:18:22.559608 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a838ee-fb07-42dc-96a2-5367bddcbc92 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:22.559873 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-2ef23806-5167-4c31-9193-1c409119a3dd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:18:22.560321 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a838ee-fb07-42dc-96a2-5367bddcbc92 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:22.560804 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a838ee-fb07-42dc-96a2-5367bddcbc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:22.561303 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 421/854] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:22.567196 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef23806-5167-4c31-9193-1c409119a3dd admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:22.577383 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef23806-5167-4c31-9193-1c409119a3dd admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:22.582556 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d29b5e-89ca-40f6-ba6c-83b338a5e30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:22.582865 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-90a838ee-fb07-42dc-96a2-5367bddcbc92 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:22.583180 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d29b5e-89ca-40f6-ba6c-83b338a5e30e admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:22.583458 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d29b5e-89ca-40f6-ba6c-83b338a5e30e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:22.583727 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d29b5e-89ca-40f6-ba6c-83b338a5e30e admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:22.584484 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-90a838ee-fb07-42dc-96a2-5367bddcbc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:22.584592 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d29b5e-89ca-40f6-ba6c-83b338a5e30e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:22.584786 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d29b5e-89ca-40f6-ba6c-83b338a5e30e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:22.586639 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d29b5e-89ca-40f6-ba6c-83b338a5e30e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:22.593264 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 434/855] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:22 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:22.603186 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 422/856] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:18:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:22.609532 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a838ee-fb07-42dc-96a2-5367bddcbc92 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:22.617351 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d29b5e-89ca-40f6-ba6c-83b338a5e30e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:22.621652 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a838ee-fb07-42dc-96a2-5367bddcbc92 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:22.626518 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d29b5e-89ca-40f6-ba6c-83b338a5e30e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:22.626807 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c1075-8232-4d8f-aabc-5b885d609af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:22.627724 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c1075-8232-4d8f-aabc-5b885d609af0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:22.628270 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c1075-8232-4d8f-aabc-5b885d609af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:22.628751 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c1075-8232-4d8f-aabc-5b885d609af0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:22.629954 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c1075-8232-4d8f-aabc-5b885d609af0 admin admin] RBAC: Adding query filter params (role.id=9cc55fd0231448e2be372853425c8d01, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=a93401007dd64d88af5e41ff08679a28) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:22.630511 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c1075-8232-4d8f-aabc-5b885d609af0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:22.631196 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b52f2-978b-415c-bb4b-c1bf1c21de99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:22.632121 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b52f2-978b-415c-bb4b-c1bf1c21de99 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:22.632541 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b52f2-978b-415c-bb4b-c1bf1c21de99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:22.632916 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c1075-8232-4d8f-aabc-5b885d609af0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:22.633128 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b52f2-978b-415c-bb4b-c1bf1c21de99 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:22.633916 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b52f2-978b-415c-bb4b-c1bf1c21de99 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:22.635649 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b52f2-978b-415c-bb4b-c1bf1c21de99 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:22.639572 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 435/857] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:18:22 2021] GET /identity/v3/role_assignments?user.id=a93401007dd64d88af5e41ff08679a28&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=9cc55fd0231448e2be372853425c8d01 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:22.647312 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-b65b52f2-978b-415c-bb4b-c1bf1c21de99 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 02:18:22.649180 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 423/858] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:22 2021] GET /identity/v3/services/compute => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:18:22.656932 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c1075-8232-4d8f-aabc-5b885d609af0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:22.666133 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c1075-8232-4d8f-aabc-5b885d609af0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:22.671218 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec63f8b-9b4a-409b-94a5-0134ee3c60f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:22.671897 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec63f8b-9b4a-409b-94a5-0134ee3c60f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:22.672230 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec63f8b-9b4a-409b-94a5-0134ee3c60f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:22.672507 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec63f8b-9b4a-409b-94a5-0134ee3c60f1 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:22.673307 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec63f8b-9b4a-409b-94a5-0134ee3c60f1 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:22.673617 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec63f8b-9b4a-409b-94a5-0134ee3c60f1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:22.675856 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec63f8b-9b4a-409b-94a5-0134ee3c60f1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:22.683086 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 436/859] 10.222.0.32 () {56 vars in 1134 bytes} [Wed Sep 15 02:18:22 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:22.690161 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b52f2-978b-415c-bb4b-c1bf1c21de99 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:22.700628 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b52f2-978b-415c-bb4b-c1bf1c21de99 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:22.706944 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36e937-6637-474b-9eb0-1a511843ae1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:22.707691 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36e937-6637-474b-9eb0-1a511843ae1c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:22.707976 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36e937-6637-474b-9eb0-1a511843ae1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:22.708301 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36e937-6637-474b-9eb0-1a511843ae1c admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:22.709073 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36e937-6637-474b-9eb0-1a511843ae1c admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:22.709386 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36e937-6637-474b-9eb0-1a511843ae1c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:22.711121 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36e937-6637-474b-9eb0-1a511843ae1c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:22.716863 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 424/860] 10.222.0.32 () {56 vars in 1134 bytes} [Wed Sep 15 02:18:22 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:24.274880 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d5643-c6b4-43ac-be5f-cdf4e5f8980a None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:24.275437 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d5643-c6b4-43ac-be5f-cdf4e5f8980a None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:24.275437 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d5643-c6b4-43ac-be5f-cdf4e5f8980a None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:24.277540 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 437/861] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:24.283729 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af193473-780c-44c9-b306-be2f5f533d3a None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:24.284185 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af193473-780c-44c9-b306-be2f5f533d3a None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:24.284631 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af193473-780c-44c9-b306-be2f5f533d3a None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:24.285673 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0918b-9544-4fea-825c-313257c5ce6f None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:24.285957 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0918b-9544-4fea-825c-313257c5ce6f None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:24.286234 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0918b-9544-4fea-825c-313257c5ce6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:24.286699 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 425/862] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:24.294506 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bc9e4-4dd5-426c-af46-19e1451c9156 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:24.294790 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bc9e4-4dd5-426c-af46-19e1451c9156 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:24.295068 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bc9e4-4dd5-426c-af46-19e1451c9156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:24.304603 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-45a0918b-9544-4fea-825c-313257c5ce6f None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:24.305815 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-45a0918b-9544-4fea-825c-313257c5ce6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:24.313825 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 438/863] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:24 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:24.314053 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-7e8bc9e4-4dd5-426c-af46-19e1451c9156 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:24.315201 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7e8bc9e4-4dd5-426c-af46-19e1451c9156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:24.332989 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 426/864] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:24 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:24.337661 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0918b-9544-4fea-825c-313257c5ce6f None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:24.347327 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0918b-9544-4fea-825c-313257c5ce6f None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:24.351885 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bc9e4-4dd5-426c-af46-19e1451c9156 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:24.352094 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84259fe6-c0ae-463e-b5d2-b5d66c1b0580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:24.352688 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84259fe6-c0ae-463e-b5d2-b5d66c1b0580 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:24.352997 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84259fe6-c0ae-463e-b5d2-b5d66c1b0580 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:24.353276 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84259fe6-c0ae-463e-b5d2-b5d66c1b0580 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:24.353983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84259fe6-c0ae-463e-b5d2-b5d66c1b0580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:24.355845 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84259fe6-c0ae-463e-b5d2-b5d66c1b0580 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:24.357745 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.common [None req-84259fe6-c0ae-463e-b5d2-b5d66c1b0580 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 15 02:18:24.361432 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bc9e4-4dd5-426c-af46-19e1451c9156 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:24.366607 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdad8a7-798f-4ce6-8c51-cecb64db6697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:24.367404 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdad8a7-798f-4ce6-8c51-cecb64db6697 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:24.367686 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdad8a7-798f-4ce6-8c51-cecb64db6697 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:24.367960 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdad8a7-798f-4ce6-8c51-cecb64db6697 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:24.368613 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdad8a7-798f-4ce6-8c51-cecb64db6697 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:24.370229 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdad8a7-798f-4ce6-8c51-cecb64db6697 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:24.377554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.sql.core [None req-84259fe6-c0ae-463e-b5d2-b5d66c1b0580 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 02:18:24.377554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 15 02:18:24.377554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [parameters: {'id': 'c438a5498f484f87b75d3a05b453f29d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 15 02:18:24.377554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73404) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 02:18:24.382680 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-0bdad8a7-798f-4ce6-8c51-cecb64db6697 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 02:18:24.388993 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 427/865] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Sep 15 02:18:24 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:18:24.390860 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdad8a7-798f-4ce6-8c51-cecb64db6697 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:24.393001 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-84259fe6-c0ae-463e-b5d2-b5d66c1b0580 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c438a5498f484f87b75d3a05b453f29d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c438a5498f484f87b75d3a05b453f29d. Sep 15 02:18:24.394682 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 439/866] 10.222.0.32 () {60 vars in 1162 bytes} [Wed Sep 15 02:18:24 2021] POST /identity/v3/projects => generated 262 bytes in 57 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:24.401184 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84259fe6-c0ae-463e-b5d2-b5d66c1b0580 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:24.402299 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdad8a7-798f-4ce6-8c51-cecb64db6697 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:24.406968 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33da0a-de31-47af-aa5e-64a5fd5136af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:24.407628 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33da0a-de31-47af-aa5e-64a5fd5136af admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:24.407912 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33da0a-de31-47af-aa5e-64a5fd5136af admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:24.408757 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33da0a-de31-47af-aa5e-64a5fd5136af admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:24.409506 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33da0a-de31-47af-aa5e-64a5fd5136af admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:24.409813 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33da0a-de31-47af-aa5e-64a5fd5136af admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:24.411401 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33da0a-de31-47af-aa5e-64a5fd5136af admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:24.413128 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84259fe6-c0ae-463e-b5d2-b5d66c1b0580 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:24.420957 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 428/867] 10.222.0.32 () {56 vars in 1144 bytes} [Wed Sep 15 02:18:24 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:24.422676 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d993c-849f-443a-934c-c59621e1b210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:24.423457 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d993c-849f-443a-934c-c59621e1b210 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:24.423892 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d993c-849f-443a-934c-c59621e1b210 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:24.424675 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d993c-849f-443a-934c-c59621e1b210 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:24.425949 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33da0a-de31-47af-aa5e-64a5fd5136af admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:24.432295 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d993c-849f-443a-934c-c59621e1b210 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:24.434354 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d993c-849f-443a-934c-c59621e1b210 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:24.436361 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33da0a-de31-47af-aa5e-64a5fd5136af admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:24.441246 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a32142-217a-4776-a834-175ca7ae06e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:24.442164 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a32142-217a-4776-a834-175ca7ae06e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:24.442645 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a32142-217a-4776-a834-175ca7ae06e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:24.443117 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a32142-217a-4776-a834-175ca7ae06e0 admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:24.444013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a32142-217a-4776-a834-175ca7ae06e0 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:24.444515 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a32142-217a-4776-a834-175ca7ae06e0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:24.446303 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a32142-217a-4776-a834-175ca7ae06e0 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:24.447583 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-649d993c-849f-443a-934c-c59621e1b210 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:18:24.456650 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 440/869] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:24.456650 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d993c-849f-443a-934c-c59621e1b210 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:24.457076 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 429/869] 10.222.0.32 () {56 vars in 1144 bytes} [Wed Sep 15 02:18:24 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:24.459643 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a32142-217a-4776-a834-175ca7ae06e0 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:24.467178 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d993c-849f-443a-934c-c59621e1b210 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:24.469934 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a32142-217a-4776-a834-175ca7ae06e0 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:24.478073 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e9b68-eaf4-4937-b8e5-3da3eaf3292f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:24.478518 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e9b68-eaf4-4937-b8e5-3da3eaf3292f admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:24.478854 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e9b68-eaf4-4937-b8e5-3da3eaf3292f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:24.479136 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e9b68-eaf4-4937-b8e5-3da3eaf3292f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:24.479873 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e9b68-eaf4-4937-b8e5-3da3eaf3292f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:24.481759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e9b68-eaf4-4937-b8e5-3da3eaf3292f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:24.483885 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac408c-2ae2-466b-8898-e9e1ce333d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:24.485007 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac408c-2ae2-466b-8898-e9e1ce333d6d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:24.485469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac408c-2ae2-466b-8898-e9e1ce333d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:24.485914 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac408c-2ae2-466b-8898-e9e1ce333d6d admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:24.487761 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac408c-2ae2-466b-8898-e9e1ce333d6d admin admin] RBAC: Adding query filter params (name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:24.488266 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac408c-2ae2-466b-8898-e9e1ce333d6d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:24.490492 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac408c-2ae2-466b-8898-e9e1ce333d6d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:24.513115 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 430/870] 10.222.0.32 () {60 vars in 1166 bytes} [Wed Sep 15 02:18:24 2021] POST /identity/v3/endpoints => generated 349 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:18:24.515969 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 441/871] 10.222.0.32 () {56 vars in 1134 bytes} [Wed Sep 15 02:18:24 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:24.915190 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57115f2c-0f26-4ebc-8221-935778b51c9e None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:24.915596 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57115f2c-0f26-4ebc-8221-935778b51c9e None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:24.915773 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57115f2c-0f26-4ebc-8221-935778b51c9e None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:24.917849 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 431/872] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:24.925451 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282c9ff-fb0b-49b2-addc-543b986ededf None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:24.925743 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282c9ff-fb0b-49b2-addc-543b986ededf None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:24.926021 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282c9ff-fb0b-49b2-addc-543b986ededf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:24.929848 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0440375-36cb-464b-b5cc-8702afd3eb69 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:24.930354 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0440375-36cb-464b-b5cc-8702afd3eb69 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:24.930828 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0440375-36cb-464b-b5cc-8702afd3eb69 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:24.933310 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 432/873] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:18:24.942180 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d3a4e-4d4d-44c5-a17f-c1e5f99013da None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:24.943066 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d3a4e-4d4d-44c5-a17f-c1e5f99013da None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:24.943548 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d3a4e-4d4d-44c5-a17f-c1e5f99013da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:24.946786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-6282c9ff-fb0b-49b2-addc-543b986ededf None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:24.948318 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-6282c9ff-fb0b-49b2-addc-543b986ededf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:24.963280 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-090d3a4e-4d4d-44c5-a17f-c1e5f99013da None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:24.965264 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-090d3a4e-4d4d-44c5-a17f-c1e5f99013da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:24.967525 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 442/874] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:24 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:24.974321 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 433/875] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:24 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:24.991451 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282c9ff-fb0b-49b2-addc-543b986ededf None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:24.999384 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d3a4e-4d4d-44c5-a17f-c1e5f99013da None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:25.002438 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282c9ff-fb0b-49b2-addc-543b986ededf None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:25.008154 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef6630-5f90-4a02-9653-fca0ba7974bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:25.009062 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef6630-5f90-4a02-9653-fca0ba7974bb admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:25.009417 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef6630-5f90-4a02-9653-fca0ba7974bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:25.009768 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef6630-5f90-4a02-9653-fca0ba7974bb admin admin] PATH_INFO: `/v3/services/image` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:25.010536 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef6630-5f90-4a02-9653-fca0ba7974bb admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:25.010715 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d3a4e-4d4d-44c5-a17f-c1e5f99013da None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:25.012377 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef6630-5f90-4a02-9653-fca0ba7974bb admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:25.016477 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb56c89-9695-4169-acf3-c2851bad60c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:25.017393 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb56c89-9695-4169-acf3-c2851bad60c6 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:25.017944 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb56c89-9695-4169-acf3-c2851bad60c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:25.018393 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb56c89-9695-4169-acf3-c2851bad60c6 admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:25.019301 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb56c89-9695-4169-acf3-c2851bad60c6 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:25.020465 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING py.warnings [None req-0eb56c89-9695-4169-acf3-c2851bad60c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:18:25.020465 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: warnings.warn(msg) Sep 15 02:18:25.020465 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: Sep 15 02:18:25.021679 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb56c89-9695-4169-acf3-c2851bad60c6 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:25.023768 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-2fef6630-5f90-4a02-9653-fca0ba7974bb admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 02:18:25.025480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 443/876] 10.222.0.32 () {56 vars in 1127 bytes} [Wed Sep 15 02:18:24 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:18:25.031972 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef6630-5f90-4a02-9653-fca0ba7974bb admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:25.043302 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef6630-5f90-4a02-9653-fca0ba7974bb admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:25.044331 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 434/877] 10.222.0.32 () {60 vars in 1163 bytes} [Wed Sep 15 02:18:24 2021] POST /identity/v3/services => generated 242 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:18:25.059377 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9055856-7461-4313-b0e3-c612561a00bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:25.060443 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9055856-7461-4313-b0e3-c612561a00bc admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:25.061006 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9055856-7461-4313-b0e3-c612561a00bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:25.061534 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9055856-7461-4313-b0e3-c612561a00bc admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:25.062535 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9055856-7461-4313-b0e3-c612561a00bc admin admin] RBAC: Adding query filter params (name=image) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:25.063095 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9055856-7461-4313-b0e3-c612561a00bc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:25.065576 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9055856-7461-4313-b0e3-c612561a00bc admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:25.071938 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 444/878] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:25 2021] GET /identity/v3/services?name=image => generated 122 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:25.079066 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb56c89-9695-4169-acf3-c2851bad60c6 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:25.090382 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb56c89-9695-4169-acf3-c2851bad60c6 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:25.095438 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6476ed-bb6a-4ff9-bcdd-b1a82fd8ba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:25.097007 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6476ed-bb6a-4ff9-bcdd-b1a82fd8ba20 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:25.097550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6476ed-bb6a-4ff9-bcdd-b1a82fd8ba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:25.098053 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6476ed-bb6a-4ff9-bcdd-b1a82fd8ba20 admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:25.098991 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6476ed-bb6a-4ff9-bcdd-b1a82fd8ba20 admin admin] RBAC: Adding query filter params (type=image) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:25.099510 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6476ed-bb6a-4ff9-bcdd-b1a82fd8ba20 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:25.101471 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6476ed-bb6a-4ff9-bcdd-b1a82fd8ba20 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:25.107324 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 435/879] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:25 2021] GET /identity/v3/services?type=image => generated 122 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:26.721452 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fe6e2-2d24-485b-986a-c5aa26bc05a2 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:26.722034 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fe6e2-2d24-485b-986a-c5aa26bc05a2 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:26.722034 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fe6e2-2d24-485b-986a-c5aa26bc05a2 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:26.724020 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 445/880] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:26.731753 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc54430-e7f2-49c8-a93c-14478995ec38 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:26.732651 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc54430-e7f2-49c8-a93c-14478995ec38 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:26.733175 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc54430-e7f2-49c8-a93c-14478995ec38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:26.751147 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-1bc54430-e7f2-49c8-a93c-14478995ec38 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:26.753275 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-1bc54430-e7f2-49c8-a93c-14478995ec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:26.764972 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 436/881] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:26 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:26.767202 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee807d1-bbe3-4f25-a164-7fbcff6bc648 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:26.768336 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee807d1-bbe3-4f25-a164-7fbcff6bc648 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:26.768814 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee807d1-bbe3-4f25-a164-7fbcff6bc648 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:26.771045 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 446/882] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:26.778358 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde5088-98c3-4d2b-81be-91fced0fe60d None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:26.778901 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde5088-98c3-4d2b-81be-91fced0fe60d None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:26.779387 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde5088-98c3-4d2b-81be-91fced0fe60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:26.786670 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee807d1-bbe3-4f25-a164-7fbcff6bc648 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:26.798840 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee807d1-bbe3-4f25-a164-7fbcff6bc648 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:26.800427 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-5bde5088-98c3-4d2b-81be-91fced0fe60d None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:26.801640 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-5bde5088-98c3-4d2b-81be-91fced0fe60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:26.804257 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1220ff3-a28f-495e-ac58-45e09c91cb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:26.805344 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1220ff3-a28f-495e-ac58-45e09c91cb48 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:26.805909 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1220ff3-a28f-495e-ac58-45e09c91cb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:26.806398 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1220ff3-a28f-495e-ac58-45e09c91cb48 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:26.807248 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1220ff3-a28f-495e-ac58-45e09c91cb48 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:26.809248 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1220ff3-a28f-495e-ac58-45e09c91cb48 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:26.809946 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 437/883] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:26 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:26.829015 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-e1220ff3-a28f-495e-ac58-45e09c91cb48 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 02:18:26.831080 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 447/884] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Sep 15 02:18:26 2021] GET /identity/v3/services/object-store => generated 93 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:18:26.837633 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1220ff3-a28f-495e-ac58-45e09c91cb48 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:26.837776 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde5088-98c3-4d2b-81be-91fced0fe60d None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:26.847905 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde5088-98c3-4d2b-81be-91fced0fe60d None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:26.850596 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1220ff3-a28f-495e-ac58-45e09c91cb48 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:26.852631 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f844c-bd4e-4718-97c1-3f93a6e336dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:26.853554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f844c-bd4e-4718-97c1-3f93a6e336dc admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:26.854056 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f844c-bd4e-4718-97c1-3f93a6e336dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:26.854425 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f844c-bd4e-4718-97c1-3f93a6e336dc admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:26.855217 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f844c-bd4e-4718-97c1-3f93a6e336dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:26.855975 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ef30c-8046-442d-9a88-a495b4abcd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:26.856787 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ef30c-8046-442d-9a88-a495b4abcd04 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:26.857251 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ef30c-8046-442d-9a88-a495b4abcd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:26.857450 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f844c-bd4e-4718-97c1-3f93a6e336dc admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:26.857822 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ef30c-8046-442d-9a88-a495b4abcd04 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:26.858682 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ef30c-8046-442d-9a88-a495b4abcd04 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:26.859026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.common [None req-ed7f844c-bd4e-4718-97c1-3f93a6e336dc admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 15 02:18:26.859294 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ef30c-8046-442d-9a88-a495b4abcd04 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:26.861047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ef30c-8046-442d-9a88-a495b4abcd04 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:26.872898 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.sql.core [None req-ed7f844c-bd4e-4718-97c1-3f93a6e336dc admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 02:18:26.872898 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 15 02:18:26.872898 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [parameters: {'user_id': 'd5da9d84e064460e8ff15021e28a0ead', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 15 02:18:26.872898 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73403) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 02:18:26.873832 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 448/885] 10.222.0.32 () {56 vars in 1144 bytes} [Wed Sep 15 02:18:26 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:26.875164 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ef30c-8046-442d-9a88-a495b4abcd04 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:26.880719 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-ed7f844c-bd4e-4718-97c1-3f93a6e336dc admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 15 02:18:26.882595 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 438/886] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:18:26 2021] POST /identity/v3/users => generated 160 bytes in 45 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:26.888194 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ef30c-8046-442d-9a88-a495b4abcd04 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:26.889562 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f844c-bd4e-4718-97c1-3f93a6e336dc admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:26.890625 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc76c66-61f8-478b-941f-98fb97f8f2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:26.891288 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc76c66-61f8-478b-941f-98fb97f8f2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:26.891571 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc76c66-61f8-478b-941f-98fb97f8f2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:26.891848 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc76c66-61f8-478b-941f-98fb97f8f2d4 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:26.892599 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc76c66-61f8-478b-941f-98fb97f8f2d4 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:26.892940 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc76c66-61f8-478b-941f-98fb97f8f2d4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:26.894543 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc76c66-61f8-478b-941f-98fb97f8f2d4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:26.901499 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f844c-bd4e-4718-97c1-3f93a6e336dc admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:26.904955 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 449/887] 10.222.0.32 () {56 vars in 1144 bytes} [Wed Sep 15 02:18:26 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:26.906784 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc76c66-61f8-478b-941f-98fb97f8f2d4 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:26.909537 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571631d-4e78-47dd-807f-fa65279f2c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:26.910567 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571631d-4e78-47dd-807f-fa65279f2c84 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:26.911048 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571631d-4e78-47dd-807f-fa65279f2c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:26.911509 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571631d-4e78-47dd-807f-fa65279f2c84 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:26.916590 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc76c66-61f8-478b-941f-98fb97f8f2d4 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:26.920507 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571631d-4e78-47dd-807f-fa65279f2c84 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:26.921187 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccb66a-67fc-492e-abcf-c970dd6567eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:26.921828 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccb66a-67fc-492e-abcf-c970dd6567eb admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:26.922108 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccb66a-67fc-492e-abcf-c970dd6567eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:26.922382 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccb66a-67fc-492e-abcf-c970dd6567eb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:26.923163 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dccb66a-67fc-492e-abcf-c970dd6567eb admin admin] RBAC: Adding query filter params (interface=admin, service_id=8cc138563fd24349b77e6560e0f068b6, region_id=RegionOne) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:26.923474 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dccb66a-67fc-492e-abcf-c970dd6567eb admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:26.925006 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571631d-4e78-47dd-807f-fa65279f2c84 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:26.925615 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dccb66a-67fc-492e-abcf-c970dd6567eb admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:26.936324 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 450/888] 10.222.0.32 () {56 vars in 1271 bytes} [Wed Sep 15 02:18:26 2021] GET /identity/v3/endpoints?service_id=8cc138563fd24349b77e6560e0f068b6&interface=admin®ion_id=RegionOne => generated 193 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:26.937578 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccb66a-67fc-492e-abcf-c970dd6567eb admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:26.940772 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-f571631d-4e78-47dd-807f-fa65279f2c84 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 02:18:26.942456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 439/889] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:18:26 2021] GET /identity/v3/users/cinder => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:26.948368 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccb66a-67fc-492e-abcf-c970dd6567eb admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:26.949213 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571631d-4e78-47dd-807f-fa65279f2c84 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:26.953684 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57881603-22c9-4d0f-92f8-6fc8707ef7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:26.954345 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57881603-22c9-4d0f-92f8-6fc8707ef7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:26.954676 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57881603-22c9-4d0f-92f8-6fc8707ef7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:26.954985 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57881603-22c9-4d0f-92f8-6fc8707ef7c2 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:26.955762 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57881603-22c9-4d0f-92f8-6fc8707ef7c2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:26.957555 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57881603-22c9-4d0f-92f8-6fc8707ef7c2 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:26.961338 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571631d-4e78-47dd-807f-fa65279f2c84 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:26.966429 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49edae3-d75e-42cd-9414-a0886c986161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:26.967315 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49edae3-d75e-42cd-9414-a0886c986161 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:26.967811 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49edae3-d75e-42cd-9414-a0886c986161 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:26.968305 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49edae3-d75e-42cd-9414-a0886c986161 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:26.969445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49edae3-d75e-42cd-9414-a0886c986161 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:26.969975 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49edae3-d75e-42cd-9414-a0886c986161 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:26.972285 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49edae3-d75e-42cd-9414-a0886c986161 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:26.973068 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 451/890] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Sep 15 02:18:26 2021] GET /identity/v3/services => generated 1727 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:18:27.020996 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 440/891] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Sep 15 02:18:26 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:27.300554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97219683-79f5-4f71-a63d-d9c8371001d6 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:27.300998 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97219683-79f5-4f71-a63d-d9c8371001d6 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:27.301100 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97219683-79f5-4f71-a63d-d9c8371001d6 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:27.303078 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 452/892] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:27.310438 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8955a2-3c82-4c9e-83b8-6d5d3e6f4149 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:27.310796 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8955a2-3c82-4c9e-83b8-6d5d3e6f4149 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:27.311138 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8955a2-3c82-4c9e-83b8-6d5d3e6f4149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:27.328726 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-8c8955a2-3c82-4c9e-83b8-6d5d3e6f4149 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:27.330314 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8c8955a2-3c82-4c9e-83b8-6d5d3e6f4149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:27.338144 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 441/893] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:27 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:27.346479 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab32fc9-4ef6-4be7-acd4-c19256615882 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:27.346834 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab32fc9-4ef6-4be7-acd4-c19256615882 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:27.347210 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab32fc9-4ef6-4be7-acd4-c19256615882 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:27.349106 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 453/894] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:27.356319 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958841c-631b-4869-9684-eeed5d4e5232 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:27.356612 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958841c-631b-4869-9684-eeed5d4e5232 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:27.356914 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958841c-631b-4869-9684-eeed5d4e5232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:27.362368 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab32fc9-4ef6-4be7-acd4-c19256615882 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:27.376122 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-1958841c-631b-4869-9684-eeed5d4e5232 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:27.376284 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab32fc9-4ef6-4be7-acd4-c19256615882 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:27.377369 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-1958841c-631b-4869-9684-eeed5d4e5232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:27.380542 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52125781-2252-4bdc-a673-f07dc0f9e602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:27.381362 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52125781-2252-4bdc-a673-f07dc0f9e602 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:27.381635 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52125781-2252-4bdc-a673-f07dc0f9e602 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:27.381908 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52125781-2252-4bdc-a673-f07dc0f9e602 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:27.382547 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52125781-2252-4bdc-a673-f07dc0f9e602 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:27.384107 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52125781-2252-4bdc-a673-f07dc0f9e602 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:27.385308 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 442/895] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:27 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:27.394914 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-52125781-2252-4bdc-a673-f07dc0f9e602 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 02:18:27.396130 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 454/896] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:27 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:18:27.402543 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958841c-631b-4869-9684-eeed5d4e5232 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:27.409237 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52125781-2252-4bdc-a673-f07dc0f9e602 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:27.413371 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958841c-631b-4869-9684-eeed5d4e5232 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:27.417847 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e6590-88c0-479a-bf4c-33cbb365fcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:27.418494 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e6590-88c0-479a-bf4c-33cbb365fcb2 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:27.418775 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e6590-88c0-479a-bf4c-33cbb365fcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:27.419048 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e6590-88c0-479a-bf4c-33cbb365fcb2 admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:27.419454 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52125781-2252-4bdc-a673-f07dc0f9e602 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:27.419749 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e6590-88c0-479a-bf4c-33cbb365fcb2 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:27.420054 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e6590-88c0-479a-bf4c-33cbb365fcb2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:27.421746 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e6590-88c0-479a-bf4c-33cbb365fcb2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:27.425233 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d555939-8406-43da-9f11-447e05562372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:27.426010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d555939-8406-43da-9f11-447e05562372 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:27.426444 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d555939-8406-43da-9f11-447e05562372 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:27.426856 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d555939-8406-43da-9f11-447e05562372 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:27.427092 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 443/897] 10.222.0.32 () {56 vars in 1134 bytes} [Wed Sep 15 02:18:27 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:27.427946 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d555939-8406-43da-9f11-447e05562372 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:27.429532 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d555939-8406-43da-9f11-447e05562372 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:27.433005 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e6590-88c0-479a-bf4c-33cbb365fcb2 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:27.442670 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e6590-88c0-479a-bf4c-33cbb365fcb2 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:27.444030 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 455/898] 10.222.0.32 () {60 vars in 1163 bytes} [Wed Sep 15 02:18:27 2021] POST /identity/v3/services => generated 242 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:18:27.458721 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c6654-d014-4863-a6ee-c1e55dc25318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:27.459704 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c6654-d014-4863-a6ee-c1e55dc25318 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:27.460188 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c6654-d014-4863-a6ee-c1e55dc25318 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:27.460655 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c6654-d014-4863-a6ee-c1e55dc25318 admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:27.461609 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c6654-d014-4863-a6ee-c1e55dc25318 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:27.462117 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c6654-d014-4863-a6ee-c1e55dc25318 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:27.463950 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c6654-d014-4863-a6ee-c1e55dc25318 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:27.475959 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 444/899] 10.222.0.32 () {56 vars in 1134 bytes} [Wed Sep 15 02:18:27 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:27.482069 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d555939-8406-43da-9f11-447e05562372 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:27.493490 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d555939-8406-43da-9f11-447e05562372 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:27.498419 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4e085-b39e-475f-b3d0-f712835d0500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:27.499109 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4e085-b39e-475f-b3d0-f712835d0500 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:27.499392 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4e085-b39e-475f-b3d0-f712835d0500 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:27.499670 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4e085-b39e-475f-b3d0-f712835d0500 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:27.500482 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4e085-b39e-475f-b3d0-f712835d0500 admin admin] RBAC: Adding query filter params (interface=public, service_id=5cd18c2b44d54d5a89644c4c60524010, region_id=RegionOne) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:27.500798 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4e085-b39e-475f-b3d0-f712835d0500 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:27.502576 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4e085-b39e-475f-b3d0-f712835d0500 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:27.508579 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 456/900] 10.222.0.32 () {56 vars in 1273 bytes} [Wed Sep 15 02:18:27 2021] GET /identity/v3/endpoints?service_id=5cd18c2b44d54d5a89644c4c60524010&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:27.515229 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c6654-d014-4863-a6ee-c1e55dc25318 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:27.525335 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c6654-d014-4863-a6ee-c1e55dc25318 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:27.530024 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac870f6-9fc3-458c-96c8-120b1f017c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:27.530777 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac870f6-9fc3-458c-96c8-120b1f017c84 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:27.531127 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac870f6-9fc3-458c-96c8-120b1f017c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:27.531472 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac870f6-9fc3-458c-96c8-120b1f017c84 admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:27.532232 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac870f6-9fc3-458c-96c8-120b1f017c84 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:27.534481 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac870f6-9fc3-458c-96c8-120b1f017c84 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:27.541837 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 445/901] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Sep 15 02:18:27 2021] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:18:29.143056 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12712104-3533-4fea-af91-c4f23850f3ce None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:29.143616 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12712104-3533-4fea-af91-c4f23850f3ce None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:29.143616 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12712104-3533-4fea-af91-c4f23850f3ce None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:29.145440 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 457/902] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:29.152818 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fcf0c-1542-49d9-8004-6f35ebbb5e16 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:29.153258 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fcf0c-1542-49d9-8004-6f35ebbb5e16 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:29.153446 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fcf0c-1542-49d9-8004-6f35ebbb5e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:29.171120 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-866fcf0c-1542-49d9-8004-6f35ebbb5e16 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:29.172294 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-866fcf0c-1542-49d9-8004-6f35ebbb5e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:29.179909 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 446/903] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:29 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:29.203610 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12712104-3533-4fea-af91-c4f23850f3ce None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:29.216045 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12712104-3533-4fea-af91-c4f23850f3ce None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:29.220350 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b24f5f-5005-4fbc-82f9-4bef0eba95b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:29.221725 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b24f5f-5005-4fbc-82f9-4bef0eba95b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:29.222007 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b24f5f-5005-4fbc-82f9-4bef0eba95b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:29.222280 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b24f5f-5005-4fbc-82f9-4bef0eba95b0 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:29.222925 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b24f5f-5005-4fbc-82f9-4bef0eba95b0 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:29.224507 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b24f5f-5005-4fbc-82f9-4bef0eba95b0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:29.235492 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-73b24f5f-5005-4fbc-82f9-4bef0eba95b0 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 02:18:29.237107 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 458/904] 10.222.0.32 () {56 vars in 1148 bytes} [Wed Sep 15 02:18:29 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:29.243860 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fcf0c-1542-49d9-8004-6f35ebbb5e16 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:29.252992 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fcf0c-1542-49d9-8004-6f35ebbb5e16 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:29.257570 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76959a2c-3bd9-44d2-9409-7b1df87d14b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:29.258302 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76959a2c-3bd9-44d2-9409-7b1df87d14b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:29.258658 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76959a2c-3bd9-44d2-9409-7b1df87d14b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:29.259005 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76959a2c-3bd9-44d2-9409-7b1df87d14b0 admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:29.259784 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76959a2c-3bd9-44d2-9409-7b1df87d14b0 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:29.260185 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76959a2c-3bd9-44d2-9409-7b1df87d14b0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:29.261871 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76959a2c-3bd9-44d2-9409-7b1df87d14b0 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:29.267136 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 447/905] 10.222.0.32 () {56 vars in 1144 bytes} [Wed Sep 15 02:18:29 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:29.274194 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b24f5f-5005-4fbc-82f9-4bef0eba95b0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:29.285008 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b24f5f-5005-4fbc-82f9-4bef0eba95b0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:29.289465 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8727d-ec56-4d81-a886-4d3dc382f637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:29.290116 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8727d-ec56-4d81-a886-4d3dc382f637 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:29.290396 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8727d-ec56-4d81-a886-4d3dc382f637 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:29.290668 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8727d-ec56-4d81-a886-4d3dc382f637 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:29.291367 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8727d-ec56-4d81-a886-4d3dc382f637 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:29.291672 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8727d-ec56-4d81-a886-4d3dc382f637 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:29.293290 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8727d-ec56-4d81-a886-4d3dc382f637 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:29.298386 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 459/906] 10.222.0.32 () {56 vars in 1144 bytes} [Wed Sep 15 02:18:29 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:29.304667 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76959a2c-3bd9-44d2-9409-7b1df87d14b0 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:29.314314 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76959a2c-3bd9-44d2-9409-7b1df87d14b0 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:29.318862 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc38ed-e9f5-49dd-bfe2-30f2c06561b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:29.319578 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc38ed-e9f5-49dd-bfe2-30f2c06561b9 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:29.319951 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc38ed-e9f5-49dd-bfe2-30f2c06561b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:29.320300 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc38ed-e9f5-49dd-bfe2-30f2c06561b9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:29.321153 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc38ed-e9f5-49dd-bfe2-30f2c06561b9 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:29.322801 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc38ed-e9f5-49dd-bfe2-30f2c06561b9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:29.344910 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 448/907] 10.222.0.32 () {60 vars in 1166 bytes} [Wed Sep 15 02:18:29 2021] POST /identity/v3/endpoints => generated 325 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:18:29.621539 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7768c9e-6bf3-48af-8ae2-e5a23dacc906 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:29.621942 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7768c9e-6bf3-48af-8ae2-e5a23dacc906 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:29.622133 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7768c9e-6bf3-48af-8ae2-e5a23dacc906 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:29.624134 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 460/908] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:29.632099 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb51db4-5b5f-4613-8582-4127a9903747 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:29.632476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb51db4-5b5f-4613-8582-4127a9903747 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:29.632849 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb51db4-5b5f-4613-8582-4127a9903747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:29.650922 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-bfb51db4-5b5f-4613-8582-4127a9903747 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:29.652119 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-bfb51db4-5b5f-4613-8582-4127a9903747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:29.670866 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 449/909] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:29 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:29.693494 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7768c9e-6bf3-48af-8ae2-e5a23dacc906 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:29.705644 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7768c9e-6bf3-48af-8ae2-e5a23dacc906 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:29.709759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3c864-b454-4864-8b95-72010db575b6 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:29.710051 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3c864-b454-4864-8b95-72010db575b6 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:29.710152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0b0f3-76c5-44ef-82c2-579e89be3186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:29.710345 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3c864-b454-4864-8b95-72010db575b6 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:29.710902 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0b0f3-76c5-44ef-82c2-579e89be3186 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:29.711184 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0b0f3-76c5-44ef-82c2-579e89be3186 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:29.711458 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0b0f3-76c5-44ef-82c2-579e89be3186 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:29.712201 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 450/910] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:18:29.712301 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0b0f3-76c5-44ef-82c2-579e89be3186 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:29.713724 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0b0f3-76c5-44ef-82c2-579e89be3186 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:29.719153 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849210b1-bb9f-44b8-ae3c-ed7cfc133ffb None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:29.719440 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849210b1-bb9f-44b8-ae3c-ed7cfc133ffb None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:29.719738 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849210b1-bb9f-44b8-ae3c-ed7cfc133ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:29.725171 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-16f0b0f3-76c5-44ef-82c2-579e89be3186 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 02:18:29.726663 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 461/911] 10.222.0.32 () {56 vars in 1127 bytes} [Wed Sep 15 02:18:29 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:29.732819 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0b0f3-76c5-44ef-82c2-579e89be3186 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:29.739013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-849210b1-bb9f-44b8-ae3c-ed7cfc133ffb None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:29.740184 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-849210b1-bb9f-44b8-ae3c-ed7cfc133ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:29.743043 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0b0f3-76c5-44ef-82c2-579e89be3186 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:29.747453 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bbbcf-1986-496b-a8f0-bcb9d61f14e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:29.748106 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 451/912] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:29 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:29.748210 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bbbcf-1986-496b-a8f0-bcb9d61f14e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:29.748365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bbbcf-1986-496b-a8f0-bcb9d61f14e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:29.748610 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bbbcf-1986-496b-a8f0-bcb9d61f14e1 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:29.749342 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bbbcf-1986-496b-a8f0-bcb9d61f14e1 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:29.749649 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bbbcf-1986-496b-a8f0-bcb9d61f14e1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:29.751208 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bbbcf-1986-496b-a8f0-bcb9d61f14e1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:29.756058 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 462/913] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:29 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:29.762185 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849210b1-bb9f-44b8-ae3c-ed7cfc133ffb None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:29.771336 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849210b1-bb9f-44b8-ae3c-ed7cfc133ffb None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:29.771805 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bbbcf-1986-496b-a8f0-bcb9d61f14e1 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:29.775783 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db591a0e-3d10-43cb-9f6d-0e96e6bbc71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:29.776461 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db591a0e-3d10-43cb-9f6d-0e96e6bbc71c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:29.776731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db591a0e-3d10-43cb-9f6d-0e96e6bbc71c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:29.777031 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db591a0e-3d10-43cb-9f6d-0e96e6bbc71c admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:29.777832 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db591a0e-3d10-43cb-9f6d-0e96e6bbc71c admin admin] RBAC: Adding query filter params (type=image) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:29.778010 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db591a0e-3d10-43cb-9f6d-0e96e6bbc71c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:29.779683 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db591a0e-3d10-43cb-9f6d-0e96e6bbc71c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:29.780989 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bbbcf-1986-496b-a8f0-bcb9d61f14e1 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:29.785356 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 452/914] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:29 2021] GET /identity/v3/services?type=image => generated 350 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:29.786127 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a902c63-fe25-4945-aaa6-78a46b578210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:29.786895 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a902c63-fe25-4945-aaa6-78a46b578210 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:29.787178 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a902c63-fe25-4945-aaa6-78a46b578210 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:29.787452 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a902c63-fe25-4945-aaa6-78a46b578210 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:29.788093 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a902c63-fe25-4945-aaa6-78a46b578210 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:29.789691 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a902c63-fe25-4945-aaa6-78a46b578210 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:29.791213 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db591a0e-3d10-43cb-9f6d-0e96e6bbc71c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:29.800863 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db591a0e-3d10-43cb-9f6d-0e96e6bbc71c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:29.801376 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-4a902c63-fe25-4945-aaa6-78a46b578210 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 02:18:29.804905 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 463/915] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:29 2021] GET /identity/v3/services/compute => generated 88 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:18:29.808740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a902c63-fe25-4945-aaa6-78a46b578210 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:29.809583 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c536c8-1129-474e-9f03-7f5c79aced18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:29.810153 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c536c8-1129-474e-9f03-7f5c79aced18 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:29.810435 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c536c8-1129-474e-9f03-7f5c79aced18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:29.810709 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c536c8-1129-474e-9f03-7f5c79aced18 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:29.811483 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c536c8-1129-474e-9f03-7f5c79aced18 admin admin] RBAC: Adding query filter params (interface=public, service_id=1a90b56638c8439a9b525bc37e70bef6, region_id=RegionOne) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:29.811796 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c536c8-1129-474e-9f03-7f5c79aced18 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:29.813486 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c536c8-1129-474e-9f03-7f5c79aced18 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:29.818703 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a902c63-fe25-4945-aaa6-78a46b578210 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:29.818837 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 453/916] 10.222.0.32 () {56 vars in 1273 bytes} [Wed Sep 15 02:18:29 2021] GET /identity/v3/endpoints?service_id=1a90b56638c8439a9b525bc37e70bef6&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:29.822929 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6ab11-2f7d-4279-aa5b-81b9606ff8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:29.823544 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6ab11-2f7d-4279-aa5b-81b9606ff8ff admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:29.823824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6ab11-2f7d-4279-aa5b-81b9606ff8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:29.824096 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6ab11-2f7d-4279-aa5b-81b9606ff8ff admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:29.824294 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c536c8-1129-474e-9f03-7f5c79aced18 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:29.824784 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6ab11-2f7d-4279-aa5b-81b9606ff8ff admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:29.825123 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6ab11-2f7d-4279-aa5b-81b9606ff8ff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:29.826669 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6ab11-2f7d-4279-aa5b-81b9606ff8ff admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:29.837220 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 464/917] 10.222.0.32 () {56 vars in 1134 bytes} [Wed Sep 15 02:18:29 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:29.837357 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c536c8-1129-474e-9f03-7f5c79aced18 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:29.837894 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6ab11-2f7d-4279-aa5b-81b9606ff8ff admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:29.841209 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55a73e-21b3-4602-98d9-1749dd59f53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:29.841834 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55a73e-21b3-4602-98d9-1749dd59f53b admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:29.842146 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55a73e-21b3-4602-98d9-1749dd59f53b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:29.842456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55a73e-21b3-4602-98d9-1749dd59f53b admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:29.843045 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55a73e-21b3-4602-98d9-1749dd59f53b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:29.844578 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55a73e-21b3-4602-98d9-1749dd59f53b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:29.847525 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6ab11-2f7d-4279-aa5b-81b9606ff8ff admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:29.851798 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 454/918] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Sep 15 02:18:29 2021] GET /identity/v3/services => generated 1957 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:18:29.853498 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03368288-df5f-4e32-8556-08b4a84fa15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:29.854130 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03368288-df5f-4e32-8556-08b4a84fa15e admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:29.854410 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03368288-df5f-4e32-8556-08b4a84fa15e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:29.854717 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03368288-df5f-4e32-8556-08b4a84fa15e admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:29.855388 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03368288-df5f-4e32-8556-08b4a84fa15e admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:29.855692 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03368288-df5f-4e32-8556-08b4a84fa15e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:29.857333 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03368288-df5f-4e32-8556-08b4a84fa15e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:29.869355 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 465/919] 10.222.0.32 () {56 vars in 1134 bytes} [Wed Sep 15 02:18:29 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:29.870367 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55a73e-21b3-4602-98d9-1749dd59f53b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:29.881018 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55a73e-21b3-4602-98d9-1749dd59f53b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:29.885791 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64815c-4dc2-44bc-9f94-f538cc12de52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:29.886466 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64815c-4dc2-44bc-9f94-f538cc12de52 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:29.886750 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64815c-4dc2-44bc-9f94-f538cc12de52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:29.887027 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64815c-4dc2-44bc-9f94-f538cc12de52 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:29.887792 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64815c-4dc2-44bc-9f94-f538cc12de52 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:29.889445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64815c-4dc2-44bc-9f94-f538cc12de52 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:29.917159 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 455/920] 10.222.0.32 () {60 vars in 1166 bytes} [Wed Sep 15 02:18:29 2021] POST /identity/v3/endpoints => generated 334 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:18:31.513963 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f3c6b-5be8-4fc2-9197-0a0065cc8c6c None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:31.514453 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f3c6b-5be8-4fc2-9197-0a0065cc8c6c None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:31.514539 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f3c6b-5be8-4fc2-9197-0a0065cc8c6c None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:31.516434 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 466/921] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:31.524074 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31404de-776b-4f00-bfb8-20ef5430b2d9 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:31.524513 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31404de-776b-4f00-bfb8-20ef5430b2d9 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:31.524701 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31404de-776b-4f00-bfb8-20ef5430b2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:31.542215 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-c31404de-776b-4f00-bfb8-20ef5430b2d9 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:31.543377 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c31404de-776b-4f00-bfb8-20ef5430b2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:31.561773 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 456/922] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:31 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:31.585293 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f3c6b-5be8-4fc2-9197-0a0065cc8c6c None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:31.597911 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f3c6b-5be8-4fc2-9197-0a0065cc8c6c None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:31.602205 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b411305-c784-4c1b-b041-fe174cd82d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:31.602982 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b411305-c784-4c1b-b041-fe174cd82d10 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:31.603262 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b411305-c784-4c1b-b041-fe174cd82d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:31.603534 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b411305-c784-4c1b-b041-fe174cd82d10 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:31.604679 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b411305-c784-4c1b-b041-fe174cd82d10 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:31.606377 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b411305-c784-4c1b-b041-fe174cd82d10 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:31.608124 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 467/923] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:31 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:31.614557 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31404de-776b-4f00-bfb8-20ef5430b2d9 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:31.623320 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31404de-776b-4f00-bfb8-20ef5430b2d9 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:31.627752 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15430d-0bb8-493d-8322-b4c06e86ffcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:31.628401 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15430d-0bb8-493d-8322-b4c06e86ffcf admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:31.628678 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15430d-0bb8-493d-8322-b4c06e86ffcf admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:31.628976 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15430d-0bb8-493d-8322-b4c06e86ffcf admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:31.629680 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15430d-0bb8-493d-8322-b4c06e86ffcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:31.631548 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15430d-0bb8-493d-8322-b4c06e86ffcf admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:31.657451 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 457/924] 10.222.0.32 () {60 vars in 1163 bytes} [Wed Sep 15 02:18:31 2021] POST /identity/v3/projects => generated 311 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:18:32.022735 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d0f7b-d2cf-44ac-97f4-734c0994b070 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:32.023073 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d0f7b-d2cf-44ac-97f4-734c0994b070 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:32.023300 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d0f7b-d2cf-44ac-97f4-734c0994b070 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:32.025136 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 468/925] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:32.032370 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b7fd9-7f08-4548-aa66-1222c64f06be None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:32.032660 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b7fd9-7f08-4548-aa66-1222c64f06be None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:32.032963 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b7fd9-7f08-4548-aa66-1222c64f06be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:32.050172 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-a81b7fd9-7f08-4548-aa66-1222c64f06be None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:32.051349 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a81b7fd9-7f08-4548-aa66-1222c64f06be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:32.112085 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 458/926] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:32 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:32.136148 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d0f7b-d2cf-44ac-97f4-734c0994b070 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:32.148499 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d0f7b-d2cf-44ac-97f4-734c0994b070 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:32.153144 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8741d4-8afb-4494-aea4-78d1c9db48f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:32.153910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8741d4-8afb-4494-aea4-78d1c9db48f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:32.154191 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8741d4-8afb-4494-aea4-78d1c9db48f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:32.154469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8741d4-8afb-4494-aea4-78d1c9db48f7 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:32.155162 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8741d4-8afb-4494-aea4-78d1c9db48f7 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:32.156801 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8741d4-8afb-4494-aea4-78d1c9db48f7 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:32.167556 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-fb8741d4-8afb-4494-aea4-78d1c9db48f7 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 02:18:32.168927 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 469/927] 10.222.0.32 () {56 vars in 1127 bytes} [Wed Sep 15 02:18:32 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:18:32.171575 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e387b0-9f5b-49c7-8b83-14340137f34e None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:32.171872 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e387b0-9f5b-49c7-8b83-14340137f34e None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:32.172151 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e387b0-9f5b-49c7-8b83-14340137f34e None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:32.174648 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 459/928] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:32.175930 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8741d4-8afb-4494-aea4-78d1c9db48f7 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:32.181389 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b582a-cff3-4b71-adfe-badb0835632a None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:32.181679 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b582a-cff3-4b71-adfe-badb0835632a None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:32.181959 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b582a-cff3-4b71-adfe-badb0835632a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:32.185696 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8741d4-8afb-4494-aea4-78d1c9db48f7 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:32.191463 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2b268-d60c-4ecc-a01d-39e9d2033707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:32.192128 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2b268-d60c-4ecc-a01d-39e9d2033707 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:32.192411 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2b268-d60c-4ecc-a01d-39e9d2033707 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:32.192686 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2b268-d60c-4ecc-a01d-39e9d2033707 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:32.193417 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2b268-d60c-4ecc-a01d-39e9d2033707 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:32.193726 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2b268-d60c-4ecc-a01d-39e9d2033707 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:32.195303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2b268-d60c-4ecc-a01d-39e9d2033707 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:32.199584 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-8c2b582a-cff3-4b71-adfe-badb0835632a None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:32.205011 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 470/929] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:32 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:32.205133 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8c2b582a-cff3-4b71-adfe-badb0835632a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:32.206836 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2b268-d60c-4ecc-a01d-39e9d2033707 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:32.213009 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 460/930] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:32 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:32.216054 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2b268-d60c-4ecc-a01d-39e9d2033707 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:32.220635 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13605d0e-62a1-4381-8c38-9f2c80421d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:32.221351 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13605d0e-62a1-4381-8c38-9f2c80421d5b admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:32.221704 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13605d0e-62a1-4381-8c38-9f2c80421d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:32.222052 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13605d0e-62a1-4381-8c38-9f2c80421d5b admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:32.222839 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13605d0e-62a1-4381-8c38-9f2c80421d5b admin admin] RBAC: Adding query filter params (type=image) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:32.223211 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13605d0e-62a1-4381-8c38-9f2c80421d5b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:32.224832 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13605d0e-62a1-4381-8c38-9f2c80421d5b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:32.229533 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 471/931] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:32 2021] GET /identity/v3/services?type=image => generated 350 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:32.235400 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b582a-cff3-4b71-adfe-badb0835632a None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:32.236669 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13605d0e-62a1-4381-8c38-9f2c80421d5b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:32.245899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b582a-cff3-4b71-adfe-badb0835632a None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:32.246049 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13605d0e-62a1-4381-8c38-9f2c80421d5b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:32.249765 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb2031-ecb8-4bd6-886b-a9ff392c9d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:32.250393 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb2031-ecb8-4bd6-886b-a9ff392c9d89 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:32.250680 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb2031-ecb8-4bd6-886b-a9ff392c9d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:32.250959 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb2031-ecb8-4bd6-886b-a9ff392c9d89 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:32.251521 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb68d6-3d5c-4bc4-9e7a-07fdfc0cdbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:32.252261 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb2031-ecb8-4bd6-886b-a9ff392c9d89 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:32.253156 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb68d6-3d5c-4bc4-9e7a-07fdfc0cdbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:32.253593 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb68d6-3d5c-4bc4-9e7a-07fdfc0cdbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:32.253924 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb2031-ecb8-4bd6-886b-a9ff392c9d89 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:32.254155 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb68d6-3d5c-4bc4-9e7a-07fdfc0cdbc9 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:32.264986 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb68d6-3d5c-4bc4-9e7a-07fdfc0cdbc9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:18:32.277348 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 461/932] 10.222.0.32 () {60 vars in 1166 bytes} [Wed Sep 15 02:18:32 2021] POST /identity/v3/endpoints => generated 327 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:18:32.277515 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-44cb68d6-3d5c-4bc4-9e7a-07fdfc0cdbc9 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 02:18:32.277515 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 472/933] 10.222.0.32 () {56 vars in 1142 bytes} [Wed Sep 15 02:18:32 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:32.280193 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb2031-ecb8-4bd6-886b-a9ff392c9d89 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:32.301950 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb2031-ecb8-4bd6-886b-a9ff392c9d89 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:32.306805 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a0b7b-ce30-4011-b518-5a0b24f23d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:32.307489 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a0b7b-ce30-4011-b518-5a0b24f23d1b admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:32.307772 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a0b7b-ce30-4011-b518-5a0b24f23d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:32.308048 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a0b7b-ce30-4011-b518-5a0b24f23d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:32.308812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a0b7b-ce30-4011-b518-5a0b24f23d1b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:32.309156 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a0b7b-ce30-4011-b518-5a0b24f23d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:32.310788 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a0b7b-ce30-4011-b518-5a0b24f23d1b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:32.320458 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 462/934] 10.222.0.32 () {56 vars in 1137 bytes} [Wed Sep 15 02:18:32 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:32.327086 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb68d6-3d5c-4bc4-9e7a-07fdfc0cdbc9 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:32.337413 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb68d6-3d5c-4bc4-9e7a-07fdfc0cdbc9 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:32.342275 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3217bc-4325-4b9c-857b-1250a0388aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:32.343087 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3217bc-4325-4b9c-857b-1250a0388aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:32.343368 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3217bc-4325-4b9c-857b-1250a0388aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:32.343640 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3217bc-4325-4b9c-857b-1250a0388aa4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:32.355063 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3217bc-4325-4b9c-857b-1250a0388aa4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:32.356948 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3217bc-4325-4b9c-857b-1250a0388aa4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:32.375487 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-de3217bc-4325-4b9c-857b-1250a0388aa4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:32.377525 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 473/935] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:18:32.383792 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a0b7b-ce30-4011-b518-5a0b24f23d1b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:32.393804 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a0b7b-ce30-4011-b518-5a0b24f23d1b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:32.398485 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a470bf-f06e-495e-a31f-912fc2c2d44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:32.399173 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a470bf-f06e-495e-a31f-912fc2c2d44f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:32.399470 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a470bf-f06e-495e-a31f-912fc2c2d44f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:32.399731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a470bf-f06e-495e-a31f-912fc2c2d44f admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:32.400468 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a470bf-f06e-495e-a31f-912fc2c2d44f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:32.400778 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a470bf-f06e-495e-a31f-912fc2c2d44f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:32.402570 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a470bf-f06e-495e-a31f-912fc2c2d44f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:32.415676 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 463/936] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:32.421859 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3217bc-4325-4b9c-857b-1250a0388aa4 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:32.432505 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3217bc-4325-4b9c-857b-1250a0388aa4 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:32.437243 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d329d5-c489-4450-a39c-7e1ff7c40dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:32.438049 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d329d5-c489-4450-a39c-7e1ff7c40dbf admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:32.438329 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d329d5-c489-4450-a39c-7e1ff7c40dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:32.438609 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d329d5-c489-4450-a39c-7e1ff7c40dbf admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:32.447000 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d329d5-c489-4450-a39c-7e1ff7c40dbf admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:32.449038 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d329d5-c489-4450-a39c-7e1ff7c40dbf admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:32.465158 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-f0d329d5-c489-4450-a39c-7e1ff7c40dbf admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 02:18:32.466524 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 474/937] 10.222.0.32 () {56 vars in 1115 bytes} [Wed Sep 15 02:18:32 2021] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:32.472978 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a470bf-f06e-495e-a31f-912fc2c2d44f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:32.485398 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a470bf-f06e-495e-a31f-912fc2c2d44f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:32.490674 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12224c-4412-4483-9818-a8a869846841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:32.491337 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12224c-4412-4483-9818-a8a869846841 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:32.491625 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12224c-4412-4483-9818-a8a869846841 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:32.491902 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12224c-4412-4483-9818-a8a869846841 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:32.492734 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12224c-4412-4483-9818-a8a869846841 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:32.493089 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12224c-4412-4483-9818-a8a869846841 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:32.494927 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12224c-4412-4483-9818-a8a869846841 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:32.513414 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 464/938] 10.222.0.32 () {56 vars in 1155 bytes} [Wed Sep 15 02:18:32 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:32.519865 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d329d5-c489-4450-a39c-7e1ff7c40dbf admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:32.529645 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d329d5-c489-4450-a39c-7e1ff7c40dbf admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:32.534615 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c42a5-b27d-4003-9964-196f771248da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:32.535248 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c42a5-b27d-4003-9964-196f771248da admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:32.535532 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c42a5-b27d-4003-9964-196f771248da admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:32.535809 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c42a5-b27d-4003-9964-196f771248da admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:32.543563 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c42a5-b27d-4003-9964-196f771248da admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:32.545352 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c42a5-b27d-4003-9964-196f771248da admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:32.554867 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 475/939] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:18:32 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:18:32.561104 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12224c-4412-4483-9818-a8a869846841 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:32.570692 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12224c-4412-4483-9818-a8a869846841 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:32.575177 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd1efd-9c8c-41fb-a12e-f66f1a41b7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:32.575951 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd1efd-9c8c-41fb-a12e-f66f1a41b7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:32.576228 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd1efd-9c8c-41fb-a12e-f66f1a41b7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:32.576497 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd1efd-9c8c-41fb-a12e-f66f1a41b7e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:32.586424 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd1efd-9c8c-41fb-a12e-f66f1a41b7e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:32.588227 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd1efd-9c8c-41fb-a12e-f66f1a41b7e6 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:32.607857 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-e9fd1efd-9c8c-41fb-a12e-f66f1a41b7e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:32.609082 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 465/940] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:32.620043 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c42a5-b27d-4003-9964-196f771248da admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:32.628850 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c42a5-b27d-4003-9964-196f771248da admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:32.633411 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d0f2d-dfd0-4c5f-9f8c-24f35528b41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:32.634060 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d0f2d-dfd0-4c5f-9f8c-24f35528b41b admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:32.634338 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d0f2d-dfd0-4c5f-9f8c-24f35528b41b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:32.634605 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d0f2d-dfd0-4c5f-9f8c-24f35528b41b admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:32.635311 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d0f2d-dfd0-4c5f-9f8c-24f35528b41b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:32.635613 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d0f2d-dfd0-4c5f-9f8c-24f35528b41b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:32.637212 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d0f2d-dfd0-4c5f-9f8c-24f35528b41b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:32.648469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 476/941] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:32.654388 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd1efd-9c8c-41fb-a12e-f66f1a41b7e6 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:32.664711 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd1efd-9c8c-41fb-a12e-f66f1a41b7e6 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:32.669455 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4c06a-cafa-4e4d-a08c-731ada6bf1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:32.670345 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4c06a-cafa-4e4d-a08c-731ada6bf1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:32.670728 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4c06a-cafa-4e4d-a08c-731ada6bf1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:32.671128 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4c06a-cafa-4e4d-a08c-731ada6bf1d0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:32.678552 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4c06a-cafa-4e4d-a08c-731ada6bf1d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:32.680584 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4c06a-cafa-4e4d-a08c-731ada6bf1d0 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:32.693532 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-bce4c06a-cafa-4e4d-a08c-731ada6bf1d0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:18:32.694948 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 466/942] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:32.701366 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d0f2d-dfd0-4c5f-9f8c-24f35528b41b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:32.711014 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d0f2d-dfd0-4c5f-9f8c-24f35528b41b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:32.715465 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccc313-ac8a-4135-ad64-50b8be3e6d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:32.716106 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccc313-ac8a-4135-ad64-50b8be3e6d72 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:32.716378 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccc313-ac8a-4135-ad64-50b8be3e6d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:32.716658 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccc313-ac8a-4135-ad64-50b8be3e6d72 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:32.717465 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccc313-ac8a-4135-ad64-50b8be3e6d72 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:32.717774 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccc313-ac8a-4135-ad64-50b8be3e6d72 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:32.719582 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccc313-ac8a-4135-ad64-50b8be3e6d72 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:32.732149 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 477/943] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:18:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:32.739332 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4c06a-cafa-4e4d-a08c-731ada6bf1d0 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:32.749686 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4c06a-cafa-4e4d-a08c-731ada6bf1d0 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:32.754238 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87cb467-9059-4e1c-a652-b6b0423549a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:32.754971 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cb467-9059-4e1c-a652-b6b0423549a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:32.755259 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cb467-9059-4e1c-a652-b6b0423549a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:32.755533 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cb467-9059-4e1c-a652-b6b0423549a5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:32.756355 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cb467-9059-4e1c-a652-b6b0423549a5 admin admin] RBAC: Adding query filter params (role.id=9cc55fd0231448e2be372853425c8d01, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=797b76e6f16d428198e7f7f05c9c0fd3) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:32.756662 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cb467-9059-4e1c-a652-b6b0423549a5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:32.758558 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cb467-9059-4e1c-a652-b6b0423549a5 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:32.764154 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 467/944] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:18:32 2021] GET /identity/v3/role_assignments?user.id=797b76e6f16d428198e7f7f05c9c0fd3&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=9cc55fd0231448e2be372853425c8d01 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:33.855616 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808e30c-d3d9-4958-976d-3cf7496cb9e1 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:33.856117 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808e30c-d3d9-4958-976d-3cf7496cb9e1 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:33.856193 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808e30c-d3d9-4958-976d-3cf7496cb9e1 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:33.858124 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 478/945] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:33.865788 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a6835-1238-49f2-9ad6-9a0927865bb6 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:33.866260 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a6835-1238-49f2-9ad6-9a0927865bb6 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:33.866540 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a6835-1238-49f2-9ad6-9a0927865bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:33.884721 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-c28a6835-1238-49f2-9ad6-9a0927865bb6 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:33.886076 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c28a6835-1238-49f2-9ad6-9a0927865bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:33.895778 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 468/946] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:33 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:33.921257 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808e30c-d3d9-4958-976d-3cf7496cb9e1 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:33.933589 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808e30c-d3d9-4958-976d-3cf7496cb9e1 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:33.938095 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0853eb2-03ac-4933-ae30-c80b620994c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:33.938980 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0853eb2-03ac-4933-ae30-c80b620994c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:33.939363 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0853eb2-03ac-4933-ae30-c80b620994c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:33.939739 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0853eb2-03ac-4933-ae30-c80b620994c5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:33.941045 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0853eb2-03ac-4933-ae30-c80b620994c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:33.942820 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0853eb2-03ac-4933-ae30-c80b620994c5 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:33.944727 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 479/947] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:33 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:33.951030 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a6835-1238-49f2-9ad6-9a0927865bb6 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:33.960561 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a6835-1238-49f2-9ad6-9a0927865bb6 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:33.965125 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715eb92-0259-4428-8606-935dfb3ce984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:33.965788 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715eb92-0259-4428-8606-935dfb3ce984 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:33.966070 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715eb92-0259-4428-8606-935dfb3ce984 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:33.966341 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715eb92-0259-4428-8606-935dfb3ce984 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:33.967048 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715eb92-0259-4428-8606-935dfb3ce984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:33.968958 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715eb92-0259-4428-8606-935dfb3ce984 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:33.991102 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 469/948] 10.222.0.32 () {60 vars in 1154 bytes} [Wed Sep 15 02:18:33 2021] POST /identity/v3/users => generated 285 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:18:34.457316 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a6f4a-1eb2-4167-b7fb-e021b87a8394 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:34.457707 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a6f4a-1eb2-4167-b7fb-e021b87a8394 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:34.457884 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a6f4a-1eb2-4167-b7fb-e021b87a8394 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:34.459636 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 480/949] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:34.469111 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578cd03-32ea-451f-80a0-479716775c32 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:34.469111 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578cd03-32ea-451f-80a0-479716775c32 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:34.469111 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578cd03-32ea-451f-80a0-479716775c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:34.485482 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-1578cd03-32ea-451f-80a0-479716775c32 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:34.487227 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-1578cd03-32ea-451f-80a0-479716775c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:34.494999 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 470/950] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:34 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:34.518817 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a6f4a-1eb2-4167-b7fb-e021b87a8394 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:34.530920 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a6f4a-1eb2-4167-b7fb-e021b87a8394 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:34.535881 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b944361-861c-41c2-bc26-e2f19550d761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:34.536520 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b944361-861c-41c2-bc26-e2f19550d761 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:34.536804 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b944361-861c-41c2-bc26-e2f19550d761 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:34.537140 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b944361-861c-41c2-bc26-e2f19550d761 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:34.544834 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b944361-861c-41c2-bc26-e2f19550d761 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:34.546620 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b944361-861c-41c2-bc26-e2f19550d761 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:34.555577 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 481/951] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:18:34 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:18:34.562064 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578cd03-32ea-451f-80a0-479716775c32 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:34.570901 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578cd03-32ea-451f-80a0-479716775c32 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:34.575405 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d47b4b-da66-4373-ab36-637700917046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:34.576181 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d47b4b-da66-4373-ab36-637700917046 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:34.576472 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d47b4b-da66-4373-ab36-637700917046 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:34.576751 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d47b4b-da66-4373-ab36-637700917046 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:34.577957 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d47b4b-da66-4373-ab36-637700917046 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:34.580152 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d47b4b-da66-4373-ab36-637700917046 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:34.581935 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 471/952] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:34.890070 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323af2a-4679-45df-bce3-73114d7ec316 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:34.890592 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323af2a-4679-45df-bce3-73114d7ec316 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:34.890698 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323af2a-4679-45df-bce3-73114d7ec316 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:34.893006 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 482/953] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:34.899988 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b87188-a73b-49fc-9b92-e8e619f0c698 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:34.900381 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b87188-a73b-49fc-9b92-e8e619f0c698 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:34.900538 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b87188-a73b-49fc-9b92-e8e619f0c698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:34.917680 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-18b87188-a73b-49fc-9b92-e8e619f0c698 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:34.918855 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-18b87188-a73b-49fc-9b92-e8e619f0c698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:34.926498 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 472/954] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:34 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:34.949980 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323af2a-4679-45df-bce3-73114d7ec316 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:34.962328 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323af2a-4679-45df-bce3-73114d7ec316 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:34.966616 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe69adc-6cee-4914-8826-58980e93c003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:34.967402 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe69adc-6cee-4914-8826-58980e93c003 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:34.967677 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe69adc-6cee-4914-8826-58980e93c003 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:34.967946 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe69adc-6cee-4914-8826-58980e93c003 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:34.977802 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe69adc-6cee-4914-8826-58980e93c003 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:18:34.984938 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-ebe69adc-6cee-4914-8826-58980e93c003 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 02:18:34.986364 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 483/955] 10.222.0.32 () {56 vars in 1142 bytes} [Wed Sep 15 02:18:34 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:34.992593 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b87188-a73b-49fc-9b92-e8e619f0c698 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:35.001366 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b87188-a73b-49fc-9b92-e8e619f0c698 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:35.006593 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b31ac2-d788-436e-975a-1c9f2709befa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:35.007245 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b31ac2-d788-436e-975a-1c9f2709befa admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:35.007528 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b31ac2-d788-436e-975a-1c9f2709befa admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:35.007801 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b31ac2-d788-436e-975a-1c9f2709befa admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:35.008538 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b31ac2-d788-436e-975a-1c9f2709befa admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:35.008840 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b31ac2-d788-436e-975a-1c9f2709befa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:35.010444 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b31ac2-d788-436e-975a-1c9f2709befa admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:35.019499 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 473/956] 10.222.0.32 () {56 vars in 1137 bytes} [Wed Sep 15 02:18:34 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:35.025899 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe69adc-6cee-4914-8826-58980e93c003 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:35.036430 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe69adc-6cee-4914-8826-58980e93c003 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:35.041168 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0dfe0-5e8f-4441-ad81-7afb24f414b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:35.042895 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0dfe0-5e8f-4441-ad81-7afb24f414b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:35.043178 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0dfe0-5e8f-4441-ad81-7afb24f414b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:35.043452 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0dfe0-5e8f-4441-ad81-7afb24f414b4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:35.053594 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0dfe0-5e8f-4441-ad81-7afb24f414b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:35.055418 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0dfe0-5e8f-4441-ad81-7afb24f414b4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:35.072117 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-12e0dfe0-5e8f-4441-ad81-7afb24f414b4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:35.073354 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 484/957] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:35.079600 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b31ac2-d788-436e-975a-1c9f2709befa admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:35.089619 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b31ac2-d788-436e-975a-1c9f2709befa admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:35.094047 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8dc09-92be-4f3a-be07-0c1a0122ac5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:35.094687 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8dc09-92be-4f3a-be07-0c1a0122ac5b admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:35.094968 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8dc09-92be-4f3a-be07-0c1a0122ac5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:35.095240 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8dc09-92be-4f3a-be07-0c1a0122ac5b admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:35.095953 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8dc09-92be-4f3a-be07-0c1a0122ac5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:35.096259 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8dc09-92be-4f3a-be07-0c1a0122ac5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:35.097847 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8dc09-92be-4f3a-be07-0c1a0122ac5b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:35.109476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 474/958] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:35.116324 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0dfe0-5e8f-4441-ad81-7afb24f414b4 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:35.125903 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0dfe0-5e8f-4441-ad81-7afb24f414b4 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:35.130971 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a63f66-56b2-44d1-9284-7eb6e7dba2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:35.131748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a63f66-56b2-44d1-9284-7eb6e7dba2cd admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:35.132029 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a63f66-56b2-44d1-9284-7eb6e7dba2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:35.132303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a63f66-56b2-44d1-9284-7eb6e7dba2cd admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:35.139356 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a63f66-56b2-44d1-9284-7eb6e7dba2cd admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:35.141461 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a63f66-56b2-44d1-9284-7eb6e7dba2cd admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:35.154978 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-83a63f66-56b2-44d1-9284-7eb6e7dba2cd admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 02:18:35.156140 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 485/959] 10.222.0.32 () {56 vars in 1115 bytes} [Wed Sep 15 02:18:35 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:35.162485 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8dc09-92be-4f3a-be07-0c1a0122ac5b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:35.172001 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8dc09-92be-4f3a-be07-0c1a0122ac5b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:35.177041 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddf886-58d5-4d96-8f3e-a5722fab81c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:35.177699 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddf886-58d5-4d96-8f3e-a5722fab81c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:35.177985 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddf886-58d5-4d96-8f3e-a5722fab81c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:35.178263 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddf886-58d5-4d96-8f3e-a5722fab81c3 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:35.179093 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddf886-58d5-4d96-8f3e-a5722fab81c3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:35.179404 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddf886-58d5-4d96-8f3e-a5722fab81c3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:35.181244 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddf886-58d5-4d96-8f3e-a5722fab81c3 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:35.198499 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 475/960] 10.222.0.32 () {56 vars in 1155 bytes} [Wed Sep 15 02:18:35 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:35.204519 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a63f66-56b2-44d1-9284-7eb6e7dba2cd admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:35.214614 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a63f66-56b2-44d1-9284-7eb6e7dba2cd admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:35.219334 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1391201-1d0a-4236-97b8-310abb567127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:35.220136 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1391201-1d0a-4236-97b8-310abb567127 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:35.220418 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1391201-1d0a-4236-97b8-310abb567127 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:35.220692 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1391201-1d0a-4236-97b8-310abb567127 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:35.231162 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1391201-1d0a-4236-97b8-310abb567127 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:35.233047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1391201-1d0a-4236-97b8-310abb567127 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:35.249703 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-c1391201-1d0a-4236-97b8-310abb567127 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:35.250872 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 486/961] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:35.257777 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddf886-58d5-4d96-8f3e-a5722fab81c3 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:35.267400 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddf886-58d5-4d96-8f3e-a5722fab81c3 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:35.271986 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152de33c-6729-4492-9896-1ec3b51d450c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:35.272632 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152de33c-6729-4492-9896-1ec3b51d450c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:35.272943 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152de33c-6729-4492-9896-1ec3b51d450c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:35.273226 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152de33c-6729-4492-9896-1ec3b51d450c admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:35.273939 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152de33c-6729-4492-9896-1ec3b51d450c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:35.274246 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152de33c-6729-4492-9896-1ec3b51d450c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:35.275813 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152de33c-6729-4492-9896-1ec3b51d450c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:35.286787 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 476/962] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:35.292861 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1391201-1d0a-4236-97b8-310abb567127 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:35.302959 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1391201-1d0a-4236-97b8-310abb567127 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:35.307563 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce848aac-60f1-488e-af38-708398be360a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:35.308333 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce848aac-60f1-488e-af38-708398be360a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:35.308608 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce848aac-60f1-488e-af38-708398be360a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:35.308891 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce848aac-60f1-488e-af38-708398be360a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:35.316193 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce848aac-60f1-488e-af38-708398be360a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:35.318160 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce848aac-60f1-488e-af38-708398be360a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:35.330735 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-ce848aac-60f1-488e-af38-708398be360a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:18:35.332071 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 487/963] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:35.338286 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152de33c-6729-4492-9896-1ec3b51d450c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:35.347845 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152de33c-6729-4492-9896-1ec3b51d450c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:35.352398 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35255fc1-e15a-4e16-a8e9-0c9085649412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:35.353082 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35255fc1-e15a-4e16-a8e9-0c9085649412 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:35.353369 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35255fc1-e15a-4e16-a8e9-0c9085649412 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:35.353647 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35255fc1-e15a-4e16-a8e9-0c9085649412 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:35.354430 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35255fc1-e15a-4e16-a8e9-0c9085649412 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:35.354744 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35255fc1-e15a-4e16-a8e9-0c9085649412 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:35.356562 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35255fc1-e15a-4e16-a8e9-0c9085649412 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:35.368803 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 477/964] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:18:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:35.374904 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce848aac-60f1-488e-af38-708398be360a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:35.386328 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce848aac-60f1-488e-af38-708398be360a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:35.390897 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd5376-5f74-4256-a72e-3bfb17ae90b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:35.391790 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd5376-5f74-4256-a72e-3bfb17ae90b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:35.392010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd5376-5f74-4256-a72e-3bfb17ae90b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:35.392278 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd5376-5f74-4256-a72e-3bfb17ae90b7 admin admin] PATH_INFO: `/v3/projects/083ff2535d794e79a145a076aedeedd4/users/797b76e6f16d428198e7f7f05c9c0fd3/roles/9cc55fd0231448e2be372853425c8d01` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:35.394457 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd5376-5f74-4256-a72e-3bfb17ae90b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=083ff2535d794e79a145a076aedeedd4, user_id=797b76e6f16d428198e7f7f05c9c0fd3, role_id=9cc55fd0231448e2be372853425c8d01)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:35.397071 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd5376-5f74-4256-a72e-3bfb17ae90b7 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:35.409131 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 488/965] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:18:35 2021] PUT /identity/v3/projects/083ff2535d794e79a145a076aedeedd4/users/797b76e6f16d428198e7f7f05c9c0fd3/roles/9cc55fd0231448e2be372853425c8d01 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:18:36.196715 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a45eee-baeb-4941-9d85-f026e864d725 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:36.197298 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a45eee-baeb-4941-9d85-f026e864d725 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:36.197298 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a45eee-baeb-4941-9d85-f026e864d725 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:36.199069 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 478/966] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:36.207024 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6590c21-f914-4028-b079-5bb60637f86d None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:36.207892 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6590c21-f914-4028-b079-5bb60637f86d None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:36.207892 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6590c21-f914-4028-b079-5bb60637f86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:36.225034 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-a6590c21-f914-4028-b079-5bb60637f86d None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:36.226214 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-a6590c21-f914-4028-b079-5bb60637f86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:36.280892 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 489/967] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:36 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:36.304769 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a45eee-baeb-4941-9d85-f026e864d725 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:36.317282 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a45eee-baeb-4941-9d85-f026e864d725 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:36.321592 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc1fb3-3c54-4198-af1a-53dcb0d444b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:36.322364 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc1fb3-3c54-4198-af1a-53dcb0d444b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:36.322646 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc1fb3-3c54-4198-af1a-53dcb0d444b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:36.322927 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc1fb3-3c54-4198-af1a-53dcb0d444b1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:36.333335 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc1fb3-3c54-4198-af1a-53dcb0d444b1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:18:36.340061 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-35dc1fb3-3c54-4198-af1a-53dcb0d444b1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:18:36.341299 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 479/968] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:18:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:36.347758 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6590c21-f914-4028-b079-5bb60637f86d None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:36.356616 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6590c21-f914-4028-b079-5bb60637f86d None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:36.361480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ac946-dc9f-4492-8c12-6babfa1fb296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:36.362135 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ac946-dc9f-4492-8c12-6babfa1fb296 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:36.362416 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ac946-dc9f-4492-8c12-6babfa1fb296 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:36.362694 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ac946-dc9f-4492-8c12-6babfa1fb296 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:36.363435 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ac946-dc9f-4492-8c12-6babfa1fb296 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:36.363742 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ac946-dc9f-4492-8c12-6babfa1fb296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:36.365426 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ac946-dc9f-4492-8c12-6babfa1fb296 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:36.379129 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 490/969] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:18:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:36.380227 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc1fb3-3c54-4198-af1a-53dcb0d444b1 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:36.390039 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc1fb3-3c54-4198-af1a-53dcb0d444b1 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:36.395083 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca464cd-e94b-47d3-8a36-45c75b1e6d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:36.395923 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca464cd-e94b-47d3-8a36-45c75b1e6d18 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:36.396201 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca464cd-e94b-47d3-8a36-45c75b1e6d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:36.396473 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca464cd-e94b-47d3-8a36-45c75b1e6d18 admin admin] PATH_INFO: `/v3/users/4504a4ecbe2b440490effd102f3f1fd0` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:36.408970 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca464cd-e94b-47d3-8a36-45c75b1e6d18 admin admin] RBAC: Authorizing `identity:get_user(user_id=4504a4ecbe2b440490effd102f3f1fd0)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:36.411064 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca464cd-e94b-47d3-8a36-45c75b1e6d18 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:36.412696 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 480/970] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:18:36 2021] GET /identity/v3/users/4504a4ecbe2b440490effd102f3f1fd0 => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:36.419146 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ac946-dc9f-4492-8c12-6babfa1fb296 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:36.428740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ac946-dc9f-4492-8c12-6babfa1fb296 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:36.433261 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b5783-95b8-46bc-8364-21c283f21be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:36.433899 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b5783-95b8-46bc-8364-21c283f21be6 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:36.434180 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b5783-95b8-46bc-8364-21c283f21be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:36.434454 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b5783-95b8-46bc-8364-21c283f21be6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:36.442622 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b5783-95b8-46bc-8364-21c283f21be6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:36.444363 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b5783-95b8-46bc-8364-21c283f21be6 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:36.453107 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 491/971] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:18:36 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:18:36.460266 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca464cd-e94b-47d3-8a36-45c75b1e6d18 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:36.469662 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca464cd-e94b-47d3-8a36-45c75b1e6d18 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:36.474580 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c3d04-017a-4a24-8bf4-624e9323d5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:36.475419 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c3d04-017a-4a24-8bf4-624e9323d5fa admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:36.475698 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c3d04-017a-4a24-8bf4-624e9323d5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:36.475966 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c3d04-017a-4a24-8bf4-624e9323d5fa admin admin] PATH_INFO: `/v3/projects/93da85153ad4430aa74dd768afee248e` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:36.477165 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c3d04-017a-4a24-8bf4-624e9323d5fa admin admin] RBAC: Authorizing `identity:get_project(project_id=93da85153ad4430aa74dd768afee248e)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:36.479174 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c3d04-017a-4a24-8bf4-624e9323d5fa admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:36.480811 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 481/972] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:18:36 2021] GET /identity/v3/projects/93da85153ad4430aa74dd768afee248e => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:36.487774 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b5783-95b8-46bc-8364-21c283f21be6 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:36.496591 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b5783-95b8-46bc-8364-21c283f21be6 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:36.501233 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccce3f-bd07-4f26-a03b-82f7cea073a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:36.502364 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccce3f-bd07-4f26-a03b-82f7cea073a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:36.502650 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccce3f-bd07-4f26-a03b-82f7cea073a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:36.502928 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccce3f-bd07-4f26-a03b-82f7cea073a2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:36.503755 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccce3f-bd07-4f26-a03b-82f7cea073a2 admin admin] RBAC: Adding query filter params (role.id=19308d3515f546e9a04e44ae278cd111, scope.project.id=93da85153ad4430aa74dd768afee248e, user.id=4504a4ecbe2b440490effd102f3f1fd0) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:36.504072 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccce3f-bd07-4f26-a03b-82f7cea073a2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:36.505938 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccce3f-bd07-4f26-a03b-82f7cea073a2 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:36.511228 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 492/973] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:18:36 2021] GET /identity/v3/role_assignments?user.id=4504a4ecbe2b440490effd102f3f1fd0&scope.project.id=93da85153ad4430aa74dd768afee248e&role.id=19308d3515f546e9a04e44ae278cd111 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:37.523273 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a574b-0665-466d-a090-87789a898085 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:37.523797 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a574b-0665-466d-a090-87789a898085 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:37.523797 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a574b-0665-466d-a090-87789a898085 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:37.525610 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 482/974] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:37.533051 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3454fa5-5631-49b0-aaa9-9bab31a1f33f None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:37.533494 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3454fa5-5631-49b0-aaa9-9bab31a1f33f None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:37.533739 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3454fa5-5631-49b0-aaa9-9bab31a1f33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:37.551511 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-f3454fa5-5631-49b0-aaa9-9bab31a1f33f None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:37.552686 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f3454fa5-5631-49b0-aaa9-9bab31a1f33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:37.560453 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 493/975] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:37 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:37.585201 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a574b-0665-466d-a090-87789a898085 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:37.597572 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a574b-0665-466d-a090-87789a898085 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:37.601820 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cf985-0ef3-4344-865a-e5879125e0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:37.602607 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cf985-0ef3-4344-865a-e5879125e0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:37.602883 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cf985-0ef3-4344-865a-e5879125e0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:37.603161 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cf985-0ef3-4344-865a-e5879125e0b9 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:37.613151 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9cf985-0ef3-4344-865a-e5879125e0b9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:18:37.620299 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-7e9cf985-0ef3-4344-865a-e5879125e0b9 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 02:18:37.621463 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 483/976] 10.222.0.32 () {56 vars in 1142 bytes} [Wed Sep 15 02:18:37 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:37.628045 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3454fa5-5631-49b0-aaa9-9bab31a1f33f None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:37.637752 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3454fa5-5631-49b0-aaa9-9bab31a1f33f None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:37.642873 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03572a-7dee-4abf-85e0-d2ab1ad5c82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:37.643554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03572a-7dee-4abf-85e0-d2ab1ad5c82d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:37.643838 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03572a-7dee-4abf-85e0-d2ab1ad5c82d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:37.644119 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03572a-7dee-4abf-85e0-d2ab1ad5c82d admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:37.644903 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03572a-7dee-4abf-85e0-d2ab1ad5c82d admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:37.645212 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03572a-7dee-4abf-85e0-d2ab1ad5c82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:37.646867 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03572a-7dee-4abf-85e0-d2ab1ad5c82d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:37.655377 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 494/977] 10.222.0.32 () {56 vars in 1137 bytes} [Wed Sep 15 02:18:37 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:37.662478 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cf985-0ef3-4344-865a-e5879125e0b9 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:37.672646 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cf985-0ef3-4344-865a-e5879125e0b9 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:37.677188 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dcba5-e3cb-49f5-a894-ed10d1acc9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:37.677980 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dcba5-e3cb-49f5-a894-ed10d1acc9fd admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:37.678263 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dcba5-e3cb-49f5-a894-ed10d1acc9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:37.678538 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6dcba5-e3cb-49f5-a894-ed10d1acc9fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:37.688329 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dcba5-e3cb-49f5-a894-ed10d1acc9fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:37.690165 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6dcba5-e3cb-49f5-a894-ed10d1acc9fd admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:37.706719 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-fd6dcba5-e3cb-49f5-a894-ed10d1acc9fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:37.707864 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 484/978] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:37.714176 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03572a-7dee-4abf-85e0-d2ab1ad5c82d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:37.724171 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03572a-7dee-4abf-85e0-d2ab1ad5c82d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:37.728649 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d624d00-a05c-4d33-95d4-5eefb532116f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:37.729276 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d624d00-a05c-4d33-95d4-5eefb532116f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:37.729557 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d624d00-a05c-4d33-95d4-5eefb532116f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:37.729828 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d624d00-a05c-4d33-95d4-5eefb532116f admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:37.730539 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d624d00-a05c-4d33-95d4-5eefb532116f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:37.730841 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d624d00-a05c-4d33-95d4-5eefb532116f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:37.732492 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d624d00-a05c-4d33-95d4-5eefb532116f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:37.748817 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 495/979] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:37.750317 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dcba5-e3cb-49f5-a894-ed10d1acc9fd admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:37.760269 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6dcba5-e3cb-49f5-a894-ed10d1acc9fd admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:37.764736 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9286a-f19d-42a1-8710-c21a31efe01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:37.765533 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9286a-f19d-42a1-8710-c21a31efe01d admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:37.765812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9286a-f19d-42a1-8710-c21a31efe01d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:37.766083 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9286a-f19d-42a1-8710-c21a31efe01d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:37.773673 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9286a-f19d-42a1-8710-c21a31efe01d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:37.775632 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9286a-f19d-42a1-8710-c21a31efe01d admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:37.788820 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-6ae9286a-f19d-42a1-8710-c21a31efe01d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 02:18:37.789945 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 485/980] 10.222.0.32 () {56 vars in 1115 bytes} [Wed Sep 15 02:18:37 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:37.795908 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d624d00-a05c-4d33-95d4-5eefb532116f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:37.805375 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d624d00-a05c-4d33-95d4-5eefb532116f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:37.809881 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0bc24-44da-49f9-80d8-fcf02a23958c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:37.810532 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0bc24-44da-49f9-80d8-fcf02a23958c admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:37.810820 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0bc24-44da-49f9-80d8-fcf02a23958c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:37.811095 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0bc24-44da-49f9-80d8-fcf02a23958c admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:37.811931 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0bc24-44da-49f9-80d8-fcf02a23958c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:37.812228 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0bc24-44da-49f9-80d8-fcf02a23958c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:37.814618 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0bc24-44da-49f9-80d8-fcf02a23958c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:37.831654 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 496/981] 10.222.0.32 () {56 vars in 1155 bytes} [Wed Sep 15 02:18:37 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:37.837764 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9286a-f19d-42a1-8710-c21a31efe01d admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:37.847087 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9286a-f19d-42a1-8710-c21a31efe01d admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:37.851541 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20489f25-fc78-48b9-959d-496ae6e45b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:37.852164 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20489f25-fc78-48b9-959d-496ae6e45b00 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:37.852444 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20489f25-fc78-48b9-959d-496ae6e45b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:37.852715 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20489f25-fc78-48b9-959d-496ae6e45b00 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:37.860179 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20489f25-fc78-48b9-959d-496ae6e45b00 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:37.862213 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20489f25-fc78-48b9-959d-496ae6e45b00 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:37.870795 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 486/982] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:18:37 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:18:37.877246 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0bc24-44da-49f9-80d8-fcf02a23958c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:37.886449 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0bc24-44da-49f9-80d8-fcf02a23958c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:37.890939 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332c6b9-236b-4077-974c-0a2c911e5282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:37.891700 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332c6b9-236b-4077-974c-0a2c911e5282 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:37.891984 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332c6b9-236b-4077-974c-0a2c911e5282 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:37.892846 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332c6b9-236b-4077-974c-0a2c911e5282 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:37.902579 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332c6b9-236b-4077-974c-0a2c911e5282 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:37.904402 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332c6b9-236b-4077-974c-0a2c911e5282 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:37.920465 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-d332c6b9-236b-4077-974c-0a2c911e5282 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:18:37.921631 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 497/983] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:18:37.927950 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20489f25-fc78-48b9-959d-496ae6e45b00 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:37.936593 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20489f25-fc78-48b9-959d-496ae6e45b00 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:37.941739 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f89572-1d45-45b3-98a5-c5bd5025bbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:37.942445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f89572-1d45-45b3-98a5-c5bd5025bbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:37.942795 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f89572-1d45-45b3-98a5-c5bd5025bbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:37.943075 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f89572-1d45-45b3-98a5-c5bd5025bbf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:37.943781 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f89572-1d45-45b3-98a5-c5bd5025bbf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:37.944084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f89572-1d45-45b3-98a5-c5bd5025bbf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:37.945665 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f89572-1d45-45b3-98a5-c5bd5025bbf2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:37.957187 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 487/984] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:18:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:37.962990 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332c6b9-236b-4077-974c-0a2c911e5282 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:37.972255 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332c6b9-236b-4077-974c-0a2c911e5282 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:37.976706 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019bf5a-45b5-4b77-b1f7-b858dd4de082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:37.977503 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019bf5a-45b5-4b77-b1f7-b858dd4de082 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:37.977787 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019bf5a-45b5-4b77-b1f7-b858dd4de082 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:37.978059 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019bf5a-45b5-4b77-b1f7-b858dd4de082 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:37.984642 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019bf5a-45b5-4b77-b1f7-b858dd4de082 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:37.986862 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019bf5a-45b5-4b77-b1f7-b858dd4de082 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:37.999278 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-b019bf5a-45b5-4b77-b1f7-b858dd4de082 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:18:38.000404 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 498/985] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:18:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:38.007103 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f89572-1d45-45b3-98a5-c5bd5025bbf2 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:38.016547 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f89572-1d45-45b3-98a5-c5bd5025bbf2 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:38.021861 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0470d4-5042-483e-838d-08e0465abe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:38.022502 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0470d4-5042-483e-838d-08e0465abe2b admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:38.022782 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0470d4-5042-483e-838d-08e0465abe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:38.023054 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0470d4-5042-483e-838d-08e0465abe2b admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:38.023826 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0470d4-5042-483e-838d-08e0465abe2b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:38.024132 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0470d4-5042-483e-838d-08e0465abe2b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:38.025986 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0470d4-5042-483e-838d-08e0465abe2b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:38.037625 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 488/986] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:18:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:38.044243 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019bf5a-45b5-4b77-b1f7-b858dd4de082 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:38.054480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019bf5a-45b5-4b77-b1f7-b858dd4de082 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:38.058963 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6307d75-81f5-4c16-89c9-dcdf2a46d03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:38.059598 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6307d75-81f5-4c16-89c9-dcdf2a46d03d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:38.059877 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6307d75-81f5-4c16-89c9-dcdf2a46d03d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:38.060152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6307d75-81f5-4c16-89c9-dcdf2a46d03d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:38.061018 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6307d75-81f5-4c16-89c9-dcdf2a46d03d admin admin] RBAC: Adding query filter params (role.id=9cc55fd0231448e2be372853425c8d01, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=797b76e6f16d428198e7f7f05c9c0fd3) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:38.061336 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6307d75-81f5-4c16-89c9-dcdf2a46d03d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:38.063202 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6307d75-81f5-4c16-89c9-dcdf2a46d03d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:38.069415 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 499/987] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:18:38 2021] GET /identity/v3/role_assignments?user.id=797b76e6f16d428198e7f7f05c9c0fd3&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=9cc55fd0231448e2be372853425c8d01 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:38.622274 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba10c2-b7a5-4b37-b7cb-564af87b1785 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:38.622838 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba10c2-b7a5-4b37-b7cb-564af87b1785 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:38.622838 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba10c2-b7a5-4b37-b7cb-564af87b1785 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:38.624591 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 489/988] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:38.631889 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3ce14-dc40-4bb8-aaa2-8aa70790738b None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:38.632336 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3ce14-dc40-4bb8-aaa2-8aa70790738b None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:38.632420 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3ce14-dc40-4bb8-aaa2-8aa70790738b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:38.649334 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-48b3ce14-dc40-4bb8-aaa2-8aa70790738b None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:38.650509 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-48b3ce14-dc40-4bb8-aaa2-8aa70790738b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:38.658853 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 500/989] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:38 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:38.683248 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba10c2-b7a5-4b37-b7cb-564af87b1785 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:38.695706 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba10c2-b7a5-4b37-b7cb-564af87b1785 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:38.700204 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b61597-ff3e-4bc5-9357-0add97f3654d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:38.701067 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b61597-ff3e-4bc5-9357-0add97f3654d admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:38.701354 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b61597-ff3e-4bc5-9357-0add97f3654d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:38.701628 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b61597-ff3e-4bc5-9357-0add97f3654d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:38.712113 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b61597-ff3e-4bc5-9357-0add97f3654d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:18:38.718895 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-f9b61597-ff3e-4bc5-9357-0add97f3654d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:18:38.720072 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 490/990] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:18:38 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:38.727350 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3ce14-dc40-4bb8-aaa2-8aa70790738b None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:38.737186 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3ce14-dc40-4bb8-aaa2-8aa70790738b None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:38.741900 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6560e2b-ffbb-4ff6-a107-a81cb943a864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:38.742567 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6560e2b-ffbb-4ff6-a107-a81cb943a864 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:38.742834 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6560e2b-ffbb-4ff6-a107-a81cb943a864 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:38.743109 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6560e2b-ffbb-4ff6-a107-a81cb943a864 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:38.743857 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6560e2b-ffbb-4ff6-a107-a81cb943a864 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:38.744665 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6560e2b-ffbb-4ff6-a107-a81cb943a864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:38.745858 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6560e2b-ffbb-4ff6-a107-a81cb943a864 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:38.754316 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 501/991] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:18:38 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:38.760869 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b61597-ff3e-4bc5-9357-0add97f3654d admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:38.771255 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b61597-ff3e-4bc5-9357-0add97f3654d admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:38.775824 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7177ce3-5ace-4ce0-8143-1f3c3961ca76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:38.776679 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7177ce3-5ace-4ce0-8143-1f3c3961ca76 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:38.777016 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7177ce3-5ace-4ce0-8143-1f3c3961ca76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:38.777296 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7177ce3-5ace-4ce0-8143-1f3c3961ca76 admin admin] PATH_INFO: `/v3/users/4504a4ecbe2b440490effd102f3f1fd0` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:38.778489 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7177ce3-5ace-4ce0-8143-1f3c3961ca76 admin admin] RBAC: Authorizing `identity:get_user(user_id=4504a4ecbe2b440490effd102f3f1fd0)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:38.780594 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7177ce3-5ace-4ce0-8143-1f3c3961ca76 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:38.782214 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 491/992] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:18:38 2021] GET /identity/v3/users/4504a4ecbe2b440490effd102f3f1fd0 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:38.789019 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6560e2b-ffbb-4ff6-a107-a81cb943a864 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:38.799453 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6560e2b-ffbb-4ff6-a107-a81cb943a864 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:38.804283 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca24eb-b8c3-4d08-8046-ae687ebf363e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:38.805200 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca24eb-b8c3-4d08-8046-ae687ebf363e admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:38.805484 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca24eb-b8c3-4d08-8046-ae687ebf363e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:38.805769 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca24eb-b8c3-4d08-8046-ae687ebf363e admin admin] PATH_INFO: `/v3/projects/93da85153ad4430aa74dd768afee248e` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:38.806981 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca24eb-b8c3-4d08-8046-ae687ebf363e admin admin] RBAC: Authorizing `identity:get_project(project_id=93da85153ad4430aa74dd768afee248e)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:38.809115 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca24eb-b8c3-4d08-8046-ae687ebf363e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:38.811062 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 502/993] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:18:38 2021] GET /identity/v3/projects/93da85153ad4430aa74dd768afee248e => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:38.817505 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7177ce3-5ace-4ce0-8143-1f3c3961ca76 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:38.827147 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7177ce3-5ace-4ce0-8143-1f3c3961ca76 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:38.831807 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84b119-5743-45c4-8baa-32c6fd0163ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:38.832676 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84b119-5743-45c4-8baa-32c6fd0163ef admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:38.832998 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84b119-5743-45c4-8baa-32c6fd0163ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:38.833276 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84b119-5743-45c4-8baa-32c6fd0163ef admin admin] PATH_INFO: `/v3/projects/93da85153ad4430aa74dd768afee248e/users/4504a4ecbe2b440490effd102f3f1fd0/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:38.835272 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84b119-5743-45c4-8baa-32c6fd0163ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=93da85153ad4430aa74dd768afee248e, user_id=4504a4ecbe2b440490effd102f3f1fd0, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:38.837993 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84b119-5743-45c4-8baa-32c6fd0163ef admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:38.853842 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 492/994] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:18:38 2021] PUT /identity/v3/projects/93da85153ad4430aa74dd768afee248e/users/4504a4ecbe2b440490effd102f3f1fd0/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:18:40.954844 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5a19a-b2fd-4a1b-a1d1-4fcf4940cc5a None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:40.955381 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5a19a-b2fd-4a1b-a1d1-4fcf4940cc5a None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:40.955381 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5a19a-b2fd-4a1b-a1d1-4fcf4940cc5a None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:40.957187 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 503/995] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:40.964056 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db8ed3-03a7-4b9e-af8d-b8dd30fb690a None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:40.964449 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db8ed3-03a7-4b9e-af8d-b8dd30fb690a None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:40.964615 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db8ed3-03a7-4b9e-af8d-b8dd30fb690a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:40.983003 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-12db8ed3-03a7-4b9e-af8d-b8dd30fb690a None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:40.984171 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-12db8ed3-03a7-4b9e-af8d-b8dd30fb690a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:41.039131 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 493/996] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:40 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:41.064237 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5a19a-b2fd-4a1b-a1d1-4fcf4940cc5a None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:41.075952 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5a19a-b2fd-4a1b-a1d1-4fcf4940cc5a None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:41.080213 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d5364-4967-430a-a239-8d7c091ee0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:41.081016 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d5364-4967-430a-a239-8d7c091ee0dc admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:41.081298 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d5364-4967-430a-a239-8d7c091ee0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:41.081568 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d5364-4967-430a-a239-8d7c091ee0dc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:41.091673 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d5364-4967-430a-a239-8d7c091ee0dc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:18:41.098859 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-884d5364-4967-430a-a239-8d7c091ee0dc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:18:41.099986 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 504/997] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:18:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:18:41.106006 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db8ed3-03a7-4b9e-af8d-b8dd30fb690a None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:41.115241 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db8ed3-03a7-4b9e-af8d-b8dd30fb690a None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:41.119694 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4671f6-7783-4499-8516-389d5124790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:41.120343 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4671f6-7783-4499-8516-389d5124790f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:41.120623 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4671f6-7783-4499-8516-389d5124790f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:41.120913 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4671f6-7783-4499-8516-389d5124790f admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:41.121652 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4671f6-7783-4499-8516-389d5124790f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:41.121953 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4671f6-7783-4499-8516-389d5124790f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:41.123516 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4671f6-7783-4499-8516-389d5124790f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:41.131421 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 494/998] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:18:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:41.137361 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d5364-4967-430a-a239-8d7c091ee0dc admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:41.146996 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d5364-4967-430a-a239-8d7c091ee0dc admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:41.151508 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6ddcf-186f-484e-bf6b-becccd45973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:41.152292 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6ddcf-186f-484e-bf6b-becccd45973e admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:41.152567 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6ddcf-186f-484e-bf6b-becccd45973e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:41.152934 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6ddcf-186f-484e-bf6b-becccd45973e admin admin] PATH_INFO: `/v3/users/4504a4ecbe2b440490effd102f3f1fd0` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:41.154064 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6ddcf-186f-484e-bf6b-becccd45973e admin admin] RBAC: Authorizing `identity:get_user(user_id=4504a4ecbe2b440490effd102f3f1fd0)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:41.156152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe6ddcf-186f-484e-bf6b-becccd45973e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:41.158365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 505/999] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:18:41 2021] GET /identity/v3/users/4504a4ecbe2b440490effd102f3f1fd0 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:41.164195 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4671f6-7783-4499-8516-389d5124790f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:41.173357 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4671f6-7783-4499-8516-389d5124790f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:41.177811 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec64dc-be38-470d-b4e7-c4238a2992f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:41.178422 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec64dc-be38-470d-b4e7-c4238a2992f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:41.178705 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec64dc-be38-470d-b4e7-c4238a2992f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:41.178981 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec64dc-be38-470d-b4e7-c4238a2992f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:41.186420 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec64dc-be38-470d-b4e7-c4238a2992f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:41.188114 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec64dc-be38-470d-b4e7-c4238a2992f7 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:41.196779 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 495/1000] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:18:41 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:18:41.202304 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6ddcf-186f-484e-bf6b-becccd45973e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:41.212105 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe6ddcf-186f-484e-bf6b-becccd45973e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:41.216482 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c818e-26b1-4fb0-8831-1ca9f9b8394f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:41.217315 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c818e-26b1-4fb0-8831-1ca9f9b8394f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:41.217593 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c818e-26b1-4fb0-8831-1ca9f9b8394f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:41.217860 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c818e-26b1-4fb0-8831-1ca9f9b8394f admin admin] PATH_INFO: `/v3/projects/93da85153ad4430aa74dd768afee248e` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:41.218993 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c818e-26b1-4fb0-8831-1ca9f9b8394f admin admin] RBAC: Authorizing `identity:get_project(project_id=93da85153ad4430aa74dd768afee248e)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:41.221603 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c818e-26b1-4fb0-8831-1ca9f9b8394f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:41.223186 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 506/1001] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:18:41 2021] GET /identity/v3/projects/93da85153ad4430aa74dd768afee248e => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:41.229167 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec64dc-be38-470d-b4e7-c4238a2992f7 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:41.237742 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec64dc-be38-470d-b4e7-c4238a2992f7 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:41.242249 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26f91c-8df0-4467-982f-9e5050ce46ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:41.242857 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26f91c-8df0-4467-982f-9e5050ce46ec admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:41.243143 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26f91c-8df0-4467-982f-9e5050ce46ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:41.243422 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26f91c-8df0-4467-982f-9e5050ce46ec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:41.244225 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26f91c-8df0-4467-982f-9e5050ce46ec admin admin] RBAC: Adding query filter params (role.id=19308d3515f546e9a04e44ae278cd111, scope.project.id=93da85153ad4430aa74dd768afee248e, user.id=4504a4ecbe2b440490effd102f3f1fd0) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:41.244537 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26f91c-8df0-4467-982f-9e5050ce46ec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:41.246347 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26f91c-8df0-4467-982f-9e5050ce46ec admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:41.251792 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 496/1002] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:18:41 2021] GET /identity/v3/role_assignments?user.id=4504a4ecbe2b440490effd102f3f1fd0&scope.project.id=93da85153ad4430aa74dd768afee248e&role.id=19308d3515f546e9a04e44ae278cd111 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:43.436053 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcf0ec-2b00-480f-909d-2edad0d2032c None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:43.436626 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcf0ec-2b00-480f-909d-2edad0d2032c None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:43.436626 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcf0ec-2b00-480f-909d-2edad0d2032c None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:43.438488 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 507/1003] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:43.445654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96ad12-968c-428f-a3b8-9e547b7e6ccb None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:43.446088 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96ad12-968c-428f-a3b8-9e547b7e6ccb None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:43.446188 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96ad12-968c-428f-a3b8-9e547b7e6ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:43.463698 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-bc96ad12-968c-428f-a3b8-9e547b7e6ccb None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:43.464863 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-bc96ad12-968c-428f-a3b8-9e547b7e6ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:43.473229 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 497/1004] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:43 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:43.498040 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcf0ec-2b00-480f-909d-2edad0d2032c None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:43.510058 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcf0ec-2b00-480f-909d-2edad0d2032c None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:43.514543 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e85dd-896f-4781-bb71-f8eb782aab05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:43.515314 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e85dd-896f-4781-bb71-f8eb782aab05 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:43.515596 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e85dd-896f-4781-bb71-f8eb782aab05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:43.515872 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e85dd-896f-4781-bb71-f8eb782aab05 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:43.517559 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e85dd-896f-4781-bb71-f8eb782aab05 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:43.519225 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e85dd-896f-4781-bb71-f8eb782aab05 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:43.520780 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 508/1005] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:43.526632 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96ad12-968c-428f-a3b8-9e547b7e6ccb None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:43.535805 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96ad12-968c-428f-a3b8-9e547b7e6ccb None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:43.540264 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9a2e5-4c49-4235-bb7e-8b7bf6b354da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:43.540925 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9a2e5-4c49-4235-bb7e-8b7bf6b354da admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:43.541206 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9a2e5-4c49-4235-bb7e-8b7bf6b354da admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:43.541476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9a2e5-4c49-4235-bb7e-8b7bf6b354da admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:43.542173 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9a2e5-4c49-4235-bb7e-8b7bf6b354da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:43.544033 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9a2e5-4c49-4235-bb7e-8b7bf6b354da admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:43.563094 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 498/1006] 10.222.0.32 () {60 vars in 1154 bytes} [Wed Sep 15 02:18:43 2021] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:18:45.689853 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f6a0a-34a0-492f-b111-d6ac57a0ef2c None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:45.690374 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f6a0a-34a0-492f-b111-d6ac57a0ef2c None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:45.690374 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f6a0a-34a0-492f-b111-d6ac57a0ef2c None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:45.692151 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 509/1007] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:45.699114 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e72ad-8bb3-4370-91cb-7b090f7b0ce3 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:45.699542 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e72ad-8bb3-4370-91cb-7b090f7b0ce3 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:45.699668 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e72ad-8bb3-4370-91cb-7b090f7b0ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:45.716696 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-616e72ad-8bb3-4370-91cb-7b090f7b0ce3 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:45.717899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-616e72ad-8bb3-4370-91cb-7b090f7b0ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:45.725431 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 499/1008] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:45 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:45.749592 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f6a0a-34a0-492f-b111-d6ac57a0ef2c None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:45.761821 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f6a0a-34a0-492f-b111-d6ac57a0ef2c None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:45.766066 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e527a5b-511e-458d-b362-96d318b853ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:45.766888 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e527a5b-511e-458d-b362-96d318b853ff admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:45.767166 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e527a5b-511e-458d-b362-96d318b853ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:45.767437 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e527a5b-511e-458d-b362-96d318b853ff admin admin] PATH_INFO: `/v3/roles/4449685a6c854c46a265236ba82cd668` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:45.768870 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e527a5b-511e-458d-b362-96d318b853ff admin admin] RBAC: Authorizing `identity:get_role(role_id=4449685a6c854c46a265236ba82cd668)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:45.769886 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING py.warnings [None req-8e527a5b-511e-458d-b362-96d318b853ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:18:45.769886 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: warnings.warn(msg) Sep 15 02:18:45.769886 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: Sep 15 02:18:45.770748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e527a5b-511e-458d-b362-96d318b853ff admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:45.772034 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 510/1009] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:18:45 2021] GET /identity/v3/roles/4449685a6c854c46a265236ba82cd668 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:45.777800 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e72ad-8bb3-4370-91cb-7b090f7b0ce3 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:45.786329 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e72ad-8bb3-4370-91cb-7b090f7b0ce3 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:45.790762 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8db27-219c-4b28-9774-e5ad671be53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:45.791592 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8db27-219c-4b28-9774-e5ad671be53b admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:45.791870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8db27-219c-4b28-9774-e5ad671be53b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:45.792141 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8db27-219c-4b28-9774-e5ad671be53b admin admin] PATH_INFO: `/v3/users/b67e4cf76f9d41ccb5e6251ae294a529` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:45.805326 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8db27-219c-4b28-9774-e5ad671be53b admin admin] RBAC: Authorizing `identity:get_user(user_id=b67e4cf76f9d41ccb5e6251ae294a529)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:45.807413 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8db27-219c-4b28-9774-e5ad671be53b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:45.808991 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 500/1010] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:18:45 2021] GET /identity/v3/users/b67e4cf76f9d41ccb5e6251ae294a529 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:45.815452 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e527a5b-511e-458d-b362-96d318b853ff admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:45.824549 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e527a5b-511e-458d-b362-96d318b853ff admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:45.828971 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7abf3-b71e-457a-8717-3d87743f694a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:45.829576 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7abf3-b71e-457a-8717-3d87743f694a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:45.829854 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7abf3-b71e-457a-8717-3d87743f694a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:45.830122 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7abf3-b71e-457a-8717-3d87743f694a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:45.837519 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7abf3-b71e-457a-8717-3d87743f694a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:45.839199 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7abf3-b71e-457a-8717-3d87743f694a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:45.847635 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 511/1011] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:18:45 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:18:45.853509 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8db27-219c-4b28-9774-e5ad671be53b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:45.863148 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8db27-219c-4b28-9774-e5ad671be53b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:45.867603 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f2499-1801-46b6-bdc1-a568760a448e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:45.868391 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f2499-1801-46b6-bdc1-a568760a448e admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:45.868670 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f2499-1801-46b6-bdc1-a568760a448e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:45.868977 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f2499-1801-46b6-bdc1-a568760a448e admin admin] PATH_INFO: `/v3/projects/93da85153ad4430aa74dd768afee248e` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:45.870121 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f2499-1801-46b6-bdc1-a568760a448e admin admin] RBAC: Authorizing `identity:get_project(project_id=93da85153ad4430aa74dd768afee248e)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:45.872083 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f2499-1801-46b6-bdc1-a568760a448e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:45.873696 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 501/1012] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:18:45 2021] GET /identity/v3/projects/93da85153ad4430aa74dd768afee248e => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:45.880315 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7abf3-b71e-457a-8717-3d87743f694a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:45.888471 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7abf3-b71e-457a-8717-3d87743f694a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:45.892910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4be83-84af-4502-9b70-6cba44548724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:45.893501 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4be83-84af-4502-9b70-6cba44548724 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:45.893780 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4be83-84af-4502-9b70-6cba44548724 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:45.894052 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4be83-84af-4502-9b70-6cba44548724 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:45.894847 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4be83-84af-4502-9b70-6cba44548724 admin admin] RBAC: Adding query filter params (role.id=4449685a6c854c46a265236ba82cd668, scope.project.id=93da85153ad4430aa74dd768afee248e, user.id=b67e4cf76f9d41ccb5e6251ae294a529) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:45.895156 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4be83-84af-4502-9b70-6cba44548724 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:45.896921 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4be83-84af-4502-9b70-6cba44548724 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:45.902185 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 512/1013] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:18:45 2021] GET /identity/v3/role_assignments?user.id=b67e4cf76f9d41ccb5e6251ae294a529&scope.project.id=93da85153ad4430aa74dd768afee248e&role.id=4449685a6c854c46a265236ba82cd668 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:48.004406 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959033e-74b5-4aae-99cc-c509a4520e11 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:48.004978 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959033e-74b5-4aae-99cc-c509a4520e11 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:48.004978 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8959033e-74b5-4aae-99cc-c509a4520e11 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:48.006767 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 502/1014] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:48.014041 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04035ac4-a564-4359-9a38-e6c08f10ab0a None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:48.014470 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04035ac4-a564-4359-9a38-e6c08f10ab0a None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:48.014590 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04035ac4-a564-4359-9a38-e6c08f10ab0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:48.032100 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-04035ac4-a564-4359-9a38-e6c08f10ab0a None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:48.033920 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-04035ac4-a564-4359-9a38-e6c08f10ab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:48.041755 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 513/1015] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:48 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:48.064617 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959033e-74b5-4aae-99cc-c509a4520e11 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:48.076458 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8959033e-74b5-4aae-99cc-c509a4520e11 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:48.081389 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc68a2-e0df-479d-b4c1-810cca6960df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:48.082216 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc68a2-e0df-479d-b4c1-810cca6960df admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:48.082499 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc68a2-e0df-479d-b4c1-810cca6960df admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:48.082776 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc68a2-e0df-479d-b4c1-810cca6960df admin admin] PATH_INFO: `/v3/roles/4449685a6c854c46a265236ba82cd668` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:48.084237 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc68a2-e0df-479d-b4c1-810cca6960df admin admin] RBAC: Authorizing `identity:get_role(role_id=4449685a6c854c46a265236ba82cd668)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:48.085270 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING py.warnings [None req-ebcc68a2-e0df-479d-b4c1-810cca6960df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:18:48.085270 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: warnings.warn(msg) Sep 15 02:18:48.085270 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: Sep 15 02:18:48.086137 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc68a2-e0df-479d-b4c1-810cca6960df admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:48.087434 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 503/1016] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:18:48 2021] GET /identity/v3/roles/4449685a6c854c46a265236ba82cd668 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:48.093363 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04035ac4-a564-4359-9a38-e6c08f10ab0a None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:48.102481 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04035ac4-a564-4359-9a38-e6c08f10ab0a None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:48.106991 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de265e3-c6d3-4806-8466-1086fb4d6b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:48.107816 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de265e3-c6d3-4806-8466-1086fb4d6b27 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:48.108088 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de265e3-c6d3-4806-8466-1086fb4d6b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:48.108354 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de265e3-c6d3-4806-8466-1086fb4d6b27 admin admin] PATH_INFO: `/v3/users/b67e4cf76f9d41ccb5e6251ae294a529` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:48.109546 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de265e3-c6d3-4806-8466-1086fb4d6b27 admin admin] RBAC: Authorizing `identity:get_user(user_id=b67e4cf76f9d41ccb5e6251ae294a529)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:48.111900 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de265e3-c6d3-4806-8466-1086fb4d6b27 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:48.113467 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 514/1017] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:18:48 2021] GET /identity/v3/users/b67e4cf76f9d41ccb5e6251ae294a529 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:48.119146 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc68a2-e0df-479d-b4c1-810cca6960df admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:48.128130 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc68a2-e0df-479d-b4c1-810cca6960df admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:48.132590 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20c5fb-3ea6-44a9-be2c-a683f2bc4cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:48.133405 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20c5fb-3ea6-44a9-be2c-a683f2bc4cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:48.133690 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20c5fb-3ea6-44a9-be2c-a683f2bc4cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:48.133966 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20c5fb-3ea6-44a9-be2c-a683f2bc4cc8 admin admin] PATH_INFO: `/v3/projects/93da85153ad4430aa74dd768afee248e` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:48.135097 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20c5fb-3ea6-44a9-be2c-a683f2bc4cc8 admin admin] RBAC: Authorizing `identity:get_project(project_id=93da85153ad4430aa74dd768afee248e)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:48.137079 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20c5fb-3ea6-44a9-be2c-a683f2bc4cc8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:48.138658 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 504/1018] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:18:48 2021] GET /identity/v3/projects/93da85153ad4430aa74dd768afee248e => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:48.145047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de265e3-c6d3-4806-8466-1086fb4d6b27 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:48.153922 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de265e3-c6d3-4806-8466-1086fb4d6b27 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:48.158971 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44f3cd-6fe4-4828-92d7-f022f2858e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:48.159781 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44f3cd-6fe4-4828-92d7-f022f2858e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:48.160059 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44f3cd-6fe4-4828-92d7-f022f2858e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:48.160330 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44f3cd-6fe4-4828-92d7-f022f2858e27 admin admin] PATH_INFO: `/v3/projects/93da85153ad4430aa74dd768afee248e/users/b67e4cf76f9d41ccb5e6251ae294a529/roles/4449685a6c854c46a265236ba82cd668` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:48.162510 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44f3cd-6fe4-4828-92d7-f022f2858e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93da85153ad4430aa74dd768afee248e, user_id=b67e4cf76f9d41ccb5e6251ae294a529, role_id=4449685a6c854c46a265236ba82cd668)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:48.165055 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44f3cd-6fe4-4828-92d7-f022f2858e27 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:48.177218 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 515/1019] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:18:48 2021] PUT /identity/v3/projects/93da85153ad4430aa74dd768afee248e/users/b67e4cf76f9d41ccb5e6251ae294a529/roles/4449685a6c854c46a265236ba82cd668 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:18:50.278792 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7195c-2b4f-4665-9bd2-e13ff1551ef8 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:50.279355 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7195c-2b4f-4665-9bd2-e13ff1551ef8 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:50.279355 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7195c-2b4f-4665-9bd2-e13ff1551ef8 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:50.281126 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 505/1020] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:50.288254 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ebe60-89f6-4d40-a24b-85c1866a0902 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:50.288702 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ebe60-89f6-4d40-a24b-85c1866a0902 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:50.288797 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ebe60-89f6-4d40-a24b-85c1866a0902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:50.306360 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-ed8ebe60-89f6-4d40-a24b-85c1866a0902 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:50.307532 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ed8ebe60-89f6-4d40-a24b-85c1866a0902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:50.361761 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 516/1021] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:50 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:50.386269 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7195c-2b4f-4665-9bd2-e13ff1551ef8 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:50.398876 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7195c-2b4f-4665-9bd2-e13ff1551ef8 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:50.404593 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2cca9-8e0a-49b7-a563-0569c4bb437f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:50.405454 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2cca9-8e0a-49b7-a563-0569c4bb437f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:50.405732 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2cca9-8e0a-49b7-a563-0569c4bb437f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:50.406003 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2cca9-8e0a-49b7-a563-0569c4bb437f admin admin] PATH_INFO: `/v3/roles/4449685a6c854c46a265236ba82cd668` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:50.408170 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2cca9-8e0a-49b7-a563-0569c4bb437f admin admin] RBAC: Authorizing `identity:get_role(role_id=4449685a6c854c46a265236ba82cd668)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:50.410640 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2cca9-8e0a-49b7-a563-0569c4bb437f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:50.411958 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 506/1022] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:18:50 2021] GET /identity/v3/roles/4449685a6c854c46a265236ba82cd668 => generated 223 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:50.418402 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ebe60-89f6-4d40-a24b-85c1866a0902 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:50.427576 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ebe60-89f6-4d40-a24b-85c1866a0902 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:50.431976 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b85754-82ab-4bdb-88a0-60b223f91475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:50.432823 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b85754-82ab-4bdb-88a0-60b223f91475 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:50.433140 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b85754-82ab-4bdb-88a0-60b223f91475 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:50.433413 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b85754-82ab-4bdb-88a0-60b223f91475 admin admin] PATH_INFO: `/v3/users/b67e4cf76f9d41ccb5e6251ae294a529` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:50.434591 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b85754-82ab-4bdb-88a0-60b223f91475 admin admin] RBAC: Authorizing `identity:get_user(user_id=b67e4cf76f9d41ccb5e6251ae294a529)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:50.436700 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b85754-82ab-4bdb-88a0-60b223f91475 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:50.438283 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 517/1023] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:18:50 2021] GET /identity/v3/users/b67e4cf76f9d41ccb5e6251ae294a529 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:50.445522 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2cca9-8e0a-49b7-a563-0569c4bb437f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:50.454854 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2cca9-8e0a-49b7-a563-0569c4bb437f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:50.459414 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e485f89-bacd-4991-827f-89624c4d1c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:50.460029 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e485f89-bacd-4991-827f-89624c4d1c2e admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:50.460315 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e485f89-bacd-4991-827f-89624c4d1c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:50.460594 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e485f89-bacd-4991-827f-89624c4d1c2e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:50.468118 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e485f89-bacd-4991-827f-89624c4d1c2e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:50.469863 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e485f89-bacd-4991-827f-89624c4d1c2e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:50.478644 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 507/1024] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:18:50 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:18:50.484899 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b85754-82ab-4bdb-88a0-60b223f91475 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:50.494993 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b85754-82ab-4bdb-88a0-60b223f91475 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:50.499523 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03b99b-8a5e-4f18-ac00-b8768331570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:50.500345 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03b99b-8a5e-4f18-ac00-b8768331570b admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:50.500630 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03b99b-8a5e-4f18-ac00-b8768331570b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:50.500932 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03b99b-8a5e-4f18-ac00-b8768331570b admin admin] PATH_INFO: `/v3/projects/93da85153ad4430aa74dd768afee248e` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:50.502744 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03b99b-8a5e-4f18-ac00-b8768331570b admin admin] RBAC: Authorizing `identity:get_project(project_id=93da85153ad4430aa74dd768afee248e)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:50.504763 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03b99b-8a5e-4f18-ac00-b8768331570b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:50.506417 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 518/1025] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:18:50 2021] GET /identity/v3/projects/93da85153ad4430aa74dd768afee248e => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:50.512747 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e485f89-bacd-4991-827f-89624c4d1c2e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:50.521181 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e485f89-bacd-4991-827f-89624c4d1c2e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:50.525753 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a39168-33a6-4fba-97bd-7eeb2a471cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:50.526367 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a39168-33a6-4fba-97bd-7eeb2a471cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:50.526651 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a39168-33a6-4fba-97bd-7eeb2a471cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:50.526929 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a39168-33a6-4fba-97bd-7eeb2a471cb7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:50.527750 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a39168-33a6-4fba-97bd-7eeb2a471cb7 admin admin] RBAC: Adding query filter params (role.id=4449685a6c854c46a265236ba82cd668, scope.project.id=93da85153ad4430aa74dd768afee248e, user.id=b67e4cf76f9d41ccb5e6251ae294a529) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:50.528066 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a39168-33a6-4fba-97bd-7eeb2a471cb7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:50.529954 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a39168-33a6-4fba-97bd-7eeb2a471cb7 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:50.536026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 508/1026] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:18:50 2021] GET /identity/v3/role_assignments?user.id=b67e4cf76f9d41ccb5e6251ae294a529&scope.project.id=93da85153ad4430aa74dd768afee248e&role.id=4449685a6c854c46a265236ba82cd668 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:52.662388 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d8a74-d054-4c53-b5c7-61d51c246adf None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:52.662951 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d8a74-d054-4c53-b5c7-61d51c246adf None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:52.662951 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d8a74-d054-4c53-b5c7-61d51c246adf None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:52.664705 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 519/1027] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:52.671666 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de8825-3e7b-4f34-abfa-5a9fea2330bb None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:52.672069 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de8825-3e7b-4f34-abfa-5a9fea2330bb None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:52.672218 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de8825-3e7b-4f34-abfa-5a9fea2330bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:52.689200 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-70de8825-3e7b-4f34-abfa-5a9fea2330bb None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:52.690363 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-70de8825-3e7b-4f34-abfa-5a9fea2330bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:52.697852 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 509/1028] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:52 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:18:52.723024 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d8a74-d054-4c53-b5c7-61d51c246adf None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:52.734962 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d8a74-d054-4c53-b5c7-61d51c246adf None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:52.739530 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298e075-b4a5-4d97-b480-d76b190a3c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:52.740290 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298e075-b4a5-4d97-b480-d76b190a3c06 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:52.740572 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298e075-b4a5-4d97-b480-d76b190a3c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:52.740848 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298e075-b4a5-4d97-b480-d76b190a3c06 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:52.742021 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298e075-b4a5-4d97-b480-d76b190a3c06 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:52.743681 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298e075-b4a5-4d97-b480-d76b190a3c06 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:52.745250 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 520/1029] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:52 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:52.751573 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de8825-3e7b-4f34-abfa-5a9fea2330bb None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:52.760106 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de8825-3e7b-4f34-abfa-5a9fea2330bb None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:52.764581 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb978f9-6dc1-4a25-8de2-5bda6d1d943e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:52.765256 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb978f9-6dc1-4a25-8de2-5bda6d1d943e admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:52.765536 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb978f9-6dc1-4a25-8de2-5bda6d1d943e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:52.765893 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb978f9-6dc1-4a25-8de2-5bda6d1d943e admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:52.767179 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb978f9-6dc1-4a25-8de2-5bda6d1d943e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:52.769056 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb978f9-6dc1-4a25-8de2-5bda6d1d943e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:52.793812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 510/1030] 10.222.0.32 () {60 vars in 1163 bytes} [Wed Sep 15 02:18:52 2021] POST /identity/v3/projects => generated 311 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:18:54.928684 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87399e4-6661-4a10-96c6-16540e2d0194 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:54.929253 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87399e4-6661-4a10-96c6-16540e2d0194 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:54.929253 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87399e4-6661-4a10-96c6-16540e2d0194 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:54.931043 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 521/1031] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:54.938097 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456c523-90f5-4dd9-802e-a171e5c0b986 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:54.938518 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456c523-90f5-4dd9-802e-a171e5c0b986 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:54.938681 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456c523-90f5-4dd9-802e-a171e5c0b986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:54.956089 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-a456c523-90f5-4dd9-802e-a171e5c0b986 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:54.957288 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a456c523-90f5-4dd9-802e-a171e5c0b986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:55.010929 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 511/1032] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:54 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:55.036515 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87399e4-6661-4a10-96c6-16540e2d0194 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:55.048396 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87399e4-6661-4a10-96c6-16540e2d0194 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:55.052775 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2844ca-b11a-436f-a1d1-349fd5bf7bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:55.053575 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2844ca-b11a-436f-a1d1-349fd5bf7bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:55.053860 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2844ca-b11a-436f-a1d1-349fd5bf7bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:55.054135 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2844ca-b11a-436f-a1d1-349fd5bf7bb4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:55.055292 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2844ca-b11a-436f-a1d1-349fd5bf7bb4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:55.057009 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2844ca-b11a-436f-a1d1-349fd5bf7bb4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:55.058718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 522/1033] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:18:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:55.064853 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456c523-90f5-4dd9-802e-a171e5c0b986 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:55.073461 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456c523-90f5-4dd9-802e-a171e5c0b986 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:55.078017 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58d436-02df-4542-b32b-a2b001f2d5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:55.078667 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58d436-02df-4542-b32b-a2b001f2d5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:55.079545 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58d436-02df-4542-b32b-a2b001f2d5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:55.079830 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58d436-02df-4542-b32b-a2b001f2d5b0 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:55.080535 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58d436-02df-4542-b32b-a2b001f2d5b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:55.082444 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58d436-02df-4542-b32b-a2b001f2d5b0 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:55.100859 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 512/1034] 10.222.0.32 () {60 vars in 1154 bytes} [Wed Sep 15 02:18:55 2021] POST /identity/v3/users => generated 286 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:18:57.265662 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc226f-4c36-470c-a95d-366f009525ba None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:57.266256 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc226f-4c36-470c-a95d-366f009525ba None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:57.266256 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc226f-4c36-470c-a95d-366f009525ba None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:57.268636 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 523/1035] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:57.275571 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce22889-26ce-4719-abf0-fadca903a1d0 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:57.276014 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce22889-26ce-4719-abf0-fadca903a1d0 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:57.276135 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce22889-26ce-4719-abf0-fadca903a1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:57.293203 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-8ce22889-26ce-4719-abf0-fadca903a1d0 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:57.294375 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8ce22889-26ce-4719-abf0-fadca903a1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:57.301950 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 513/1036] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:57 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:57.326144 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc226f-4c36-470c-a95d-366f009525ba None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:57.338762 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc226f-4c36-470c-a95d-366f009525ba None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:57.343104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a904f74-62a8-44be-b2d8-a292926a5396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:57.343862 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a904f74-62a8-44be-b2d8-a292926a5396 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:57.344144 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a904f74-62a8-44be-b2d8-a292926a5396 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:57.344418 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a904f74-62a8-44be-b2d8-a292926a5396 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:57.354264 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a904f74-62a8-44be-b2d8-a292926a5396 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:18:57.361293 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-9a904f74-62a8-44be-b2d8-a292926a5396 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:18:57.362415 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 524/1037] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:18:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:18:57.368532 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce22889-26ce-4719-abf0-fadca903a1d0 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:57.377640 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce22889-26ce-4719-abf0-fadca903a1d0 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:57.382064 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64dfce0-5aa3-46b0-b073-7a6d0c27904f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:57.382705 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dfce0-5aa3-46b0-b073-7a6d0c27904f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:57.382986 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dfce0-5aa3-46b0-b073-7a6d0c27904f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:57.383261 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64dfce0-5aa3-46b0-b073-7a6d0c27904f admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:57.383993 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64dfce0-5aa3-46b0-b073-7a6d0c27904f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:57.384298 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64dfce0-5aa3-46b0-b073-7a6d0c27904f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:57.385892 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64dfce0-5aa3-46b0-b073-7a6d0c27904f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:57.394390 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 514/1038] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:18:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:57.400329 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a904f74-62a8-44be-b2d8-a292926a5396 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:57.410118 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a904f74-62a8-44be-b2d8-a292926a5396 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:57.414634 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f4a9a-5ee1-4dd7-b4c8-7764e09cc26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:57.415445 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f4a9a-5ee1-4dd7-b4c8-7764e09cc26d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:57.415733 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f4a9a-5ee1-4dd7-b4c8-7764e09cc26d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:57.416013 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f4a9a-5ee1-4dd7-b4c8-7764e09cc26d admin admin] PATH_INFO: `/v3/users/ff928b4686cf4c438936a7259af7d9a9` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:57.428556 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f4a9a-5ee1-4dd7-b4c8-7764e09cc26d admin admin] RBAC: Authorizing `identity:get_user(user_id=ff928b4686cf4c438936a7259af7d9a9)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:57.430738 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f4a9a-5ee1-4dd7-b4c8-7764e09cc26d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:57.432323 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 525/1039] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:18:57 2021] GET /identity/v3/users/ff928b4686cf4c438936a7259af7d9a9 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:18:57.438688 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64dfce0-5aa3-46b0-b073-7a6d0c27904f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:57.447775 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64dfce0-5aa3-46b0-b073-7a6d0c27904f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:57.452194 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb707f-9399-4a73-b209-8d89978fd57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:57.452800 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb707f-9399-4a73-b209-8d89978fd57e admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:57.453111 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb707f-9399-4a73-b209-8d89978fd57e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:57.453388 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb707f-9399-4a73-b209-8d89978fd57e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:57.461448 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb707f-9399-4a73-b209-8d89978fd57e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:57.463132 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb707f-9399-4a73-b209-8d89978fd57e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:57.471719 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 515/1040] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:18:57 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:18:57.477969 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f4a9a-5ee1-4dd7-b4c8-7764e09cc26d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:57.487824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f4a9a-5ee1-4dd7-b4c8-7764e09cc26d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:57.492389 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017981b-1e4e-4fec-950a-747a33ebc66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:57.493263 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017981b-1e4e-4fec-950a-747a33ebc66f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:57.493548 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017981b-1e4e-4fec-950a-747a33ebc66f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:57.493827 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017981b-1e4e-4fec-950a-747a33ebc66f admin admin] PATH_INFO: `/v3/projects/f1f9b76f476c48ecbaaa174761abe935` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:57.495770 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017981b-1e4e-4fec-950a-747a33ebc66f admin admin] RBAC: Authorizing `identity:get_project(project_id=f1f9b76f476c48ecbaaa174761abe935)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:57.498041 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017981b-1e4e-4fec-950a-747a33ebc66f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:57.499820 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 526/1041] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:18:57 2021] GET /identity/v3/projects/f1f9b76f476c48ecbaaa174761abe935 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:57.507295 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb707f-9399-4a73-b209-8d89978fd57e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:57.516080 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb707f-9399-4a73-b209-8d89978fd57e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:57.521153 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d9dbf-cf60-4c58-931a-3f648fff59f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:57.521780 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d9dbf-cf60-4c58-931a-3f648fff59f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:57.522085 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d9dbf-cf60-4c58-931a-3f648fff59f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:57.522358 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d9dbf-cf60-4c58-931a-3f648fff59f5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:57.523167 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d9dbf-cf60-4c58-931a-3f648fff59f5 admin admin] RBAC: Adding query filter params (role.id=19308d3515f546e9a04e44ae278cd111, scope.project.id=f1f9b76f476c48ecbaaa174761abe935, user.id=ff928b4686cf4c438936a7259af7d9a9) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:57.523475 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d9dbf-cf60-4c58-931a-3f648fff59f5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:57.525298 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d9dbf-cf60-4c58-931a-3f648fff59f5 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:57.530360 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 516/1042] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:18:57 2021] GET /identity/v3/role_assignments?user.id=ff928b4686cf4c438936a7259af7d9a9&scope.project.id=f1f9b76f476c48ecbaaa174761abe935&role.id=19308d3515f546e9a04e44ae278cd111 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:59.619010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f21355-1d5d-4e9b-a121-576e01649b46 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:59.619558 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f21355-1d5d-4e9b-a121-576e01649b46 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:59.619558 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f21355-1d5d-4e9b-a121-576e01649b46 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:59.621348 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 527/1043] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:18:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:18:59.628676 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e145b4-e3dd-4699-8945-1380d0c4ee1b None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:59.629101 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e145b4-e3dd-4699-8945-1380d0c4ee1b None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:59.629255 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e145b4-e3dd-4699-8945-1380d0c4ee1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:59.646688 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-36e145b4-e3dd-4699-8945-1380d0c4ee1b None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:18:59.647844 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-36e145b4-e3dd-4699-8945-1380d0c4ee1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:18:59.655289 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 517/1044] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:18:59 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:18:59.677933 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f21355-1d5d-4e9b-a121-576e01649b46 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:59.690094 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f21355-1d5d-4e9b-a121-576e01649b46 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:59.694327 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30455806-2663-44b7-801f-a34ab2fce5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:59.695085 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30455806-2663-44b7-801f-a34ab2fce5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:59.695365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30455806-2663-44b7-801f-a34ab2fce5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:59.695637 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30455806-2663-44b7-801f-a34ab2fce5d0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:59.705901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30455806-2663-44b7-801f-a34ab2fce5d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:18:59.712525 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-30455806-2663-44b7-801f-a34ab2fce5d0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:18:59.713669 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 528/1045] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:18:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:18:59.719638 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e145b4-e3dd-4699-8945-1380d0c4ee1b None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:59.728216 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e145b4-e3dd-4699-8945-1380d0c4ee1b None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:59.732522 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986c46d-020a-4667-8473-dce97ab94fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:59.733195 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986c46d-020a-4667-8473-dce97ab94fdc admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:59.733476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986c46d-020a-4667-8473-dce97ab94fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:59.733744 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986c46d-020a-4667-8473-dce97ab94fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:59.734474 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986c46d-020a-4667-8473-dce97ab94fdc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:18:59.734775 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986c46d-020a-4667-8473-dce97ab94fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:59.736622 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986c46d-020a-4667-8473-dce97ab94fdc admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:59.744413 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 518/1046] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:18:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:59.750370 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30455806-2663-44b7-801f-a34ab2fce5d0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:59.761386 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30455806-2663-44b7-801f-a34ab2fce5d0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:59.765861 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70801b7b-c834-46ce-adab-132dd9964c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:59.767263 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70801b7b-c834-46ce-adab-132dd9964c85 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:59.767540 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70801b7b-c834-46ce-adab-132dd9964c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:59.767812 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70801b7b-c834-46ce-adab-132dd9964c85 admin admin] PATH_INFO: `/v3/users/ff928b4686cf4c438936a7259af7d9a9` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:59.769008 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70801b7b-c834-46ce-adab-132dd9964c85 admin admin] RBAC: Authorizing `identity:get_user(user_id=ff928b4686cf4c438936a7259af7d9a9)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:59.771074 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70801b7b-c834-46ce-adab-132dd9964c85 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:59.772713 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 529/1047] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:18:59 2021] GET /identity/v3/users/ff928b4686cf4c438936a7259af7d9a9 => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:59.778229 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986c46d-020a-4667-8473-dce97ab94fdc admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:59.787353 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986c46d-020a-4667-8473-dce97ab94fdc admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:59.791752 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ca599-0feb-4d96-a19d-5dcde16c186c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:59.792565 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ca599-0feb-4d96-a19d-5dcde16c186c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:59.792847 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ca599-0feb-4d96-a19d-5dcde16c186c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:59.793151 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ca599-0feb-4d96-a19d-5dcde16c186c admin admin] PATH_INFO: `/v3/projects/f1f9b76f476c48ecbaaa174761abe935` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:59.794297 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ca599-0feb-4d96-a19d-5dcde16c186c admin admin] RBAC: Authorizing `identity:get_project(project_id=f1f9b76f476c48ecbaaa174761abe935)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:59.796271 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ca599-0feb-4d96-a19d-5dcde16c186c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:59.798020 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 519/1048] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:18:59 2021] GET /identity/v3/projects/f1f9b76f476c48ecbaaa174761abe935 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:18:59.803648 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70801b7b-c834-46ce-adab-132dd9964c85 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:18:59.812426 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70801b7b-c834-46ce-adab-132dd9964c85 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:18:59.817322 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20106378-c1ce-4d7e-b5d9-cc3f21c5dee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:18:59.818129 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20106378-c1ce-4d7e-b5d9-cc3f21c5dee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:18:59.818406 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20106378-c1ce-4d7e-b5d9-cc3f21c5dee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:18:59.818673 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20106378-c1ce-4d7e-b5d9-cc3f21c5dee3 admin admin] PATH_INFO: `/v3/projects/f1f9b76f476c48ecbaaa174761abe935/users/ff928b4686cf4c438936a7259af7d9a9/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:18:59.820551 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20106378-c1ce-4d7e-b5d9-cc3f21c5dee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f9b76f476c48ecbaaa174761abe935, user_id=ff928b4686cf4c438936a7259af7d9a9, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:18:59.823105 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20106378-c1ce-4d7e-b5d9-cc3f21c5dee3 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:18:59.836047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 530/1049] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:18:59 2021] PUT /identity/v3/projects/f1f9b76f476c48ecbaaa174761abe935/users/ff928b4686cf4c438936a7259af7d9a9/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:19:01.933599 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de805f0-3edc-4d58-a95c-a0842de83d0b None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:01.934156 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de805f0-3edc-4d58-a95c-a0842de83d0b None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:01.934156 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de805f0-3edc-4d58-a95c-a0842de83d0b None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:01.935906 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 520/1050] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:19:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:19:01.942853 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ff097-03fa-4edc-a426-6dde0fe20c1d None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:01.943270 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ff097-03fa-4edc-a426-6dde0fe20c1d None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:01.943403 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ff097-03fa-4edc-a426-6dde0fe20c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:01.960261 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-925ff097-03fa-4edc-a426-6dde0fe20c1d None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:19:01.961463 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-925ff097-03fa-4edc-a426-6dde0fe20c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:19:02.014568 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 531/1051] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:19:01 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:19:02.039586 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de805f0-3edc-4d58-a95c-a0842de83d0b None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:02.052013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de805f0-3edc-4d58-a95c-a0842de83d0b None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:02.056510 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0cb90-f2b9-44cb-aec4-7772d3834728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:02.057322 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0cb90-f2b9-44cb-aec4-7772d3834728 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:02.057608 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0cb90-f2b9-44cb-aec4-7772d3834728 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:02.057886 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0cb90-f2b9-44cb-aec4-7772d3834728 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:02.068080 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0cb90-f2b9-44cb-aec4-7772d3834728 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:19:02.074858 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-10a0cb90-f2b9-44cb-aec4-7772d3834728 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:19:02.076009 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 521/1052] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:19:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:19:02.082592 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ff097-03fa-4edc-a426-6dde0fe20c1d None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:02.091619 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ff097-03fa-4edc-a426-6dde0fe20c1d None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:02.096564 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a0496-161b-41db-a22d-a5f4e3735a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:02.097248 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a0496-161b-41db-a22d-a5f4e3735a6a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:02.097527 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a0496-161b-41db-a22d-a5f4e3735a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:02.097799 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a0496-161b-41db-a22d-a5f4e3735a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:02.098533 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a0496-161b-41db-a22d-a5f4e3735a6a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:19:02.098837 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a0496-161b-41db-a22d-a5f4e3735a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:02.100427 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a0496-161b-41db-a22d-a5f4e3735a6a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:02.108372 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 532/1053] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:19:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:19:02.115172 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0cb90-f2b9-44cb-aec4-7772d3834728 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:02.125105 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0cb90-f2b9-44cb-aec4-7772d3834728 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:02.129563 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f98d07-536e-407a-a4c2-e5ae443e45f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:02.130393 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f98d07-536e-407a-a4c2-e5ae443e45f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:02.130676 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f98d07-536e-407a-a4c2-e5ae443e45f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:02.130951 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f98d07-536e-407a-a4c2-e5ae443e45f8 admin admin] PATH_INFO: `/v3/users/ff928b4686cf4c438936a7259af7d9a9` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:02.132153 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f98d07-536e-407a-a4c2-e5ae443e45f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=ff928b4686cf4c438936a7259af7d9a9)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:02.134282 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f98d07-536e-407a-a4c2-e5ae443e45f8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:02.135934 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 522/1054] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:19:02 2021] GET /identity/v3/users/ff928b4686cf4c438936a7259af7d9a9 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:19:02.142037 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a0496-161b-41db-a22d-a5f4e3735a6a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:02.150979 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a0496-161b-41db-a22d-a5f4e3735a6a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:02.155444 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f115fa1-a81f-4dd5-ac0b-b938db0fe60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:02.156044 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f115fa1-a81f-4dd5-ac0b-b938db0fe60a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:02.156323 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f115fa1-a81f-4dd5-ac0b-b938db0fe60a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:02.156598 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f115fa1-a81f-4dd5-ac0b-b938db0fe60a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:02.164621 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f115fa1-a81f-4dd5-ac0b-b938db0fe60a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:02.166332 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f115fa1-a81f-4dd5-ac0b-b938db0fe60a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:02.174801 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 533/1055] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:19:02 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:19:02.180614 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f98d07-536e-407a-a4c2-e5ae443e45f8 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:02.189793 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f98d07-536e-407a-a4c2-e5ae443e45f8 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:02.194190 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461158ed-8889-4321-9b40-93131ccad8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:02.194983 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461158ed-8889-4321-9b40-93131ccad8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:02.195264 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461158ed-8889-4321-9b40-93131ccad8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:02.195538 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461158ed-8889-4321-9b40-93131ccad8f2 admin admin] PATH_INFO: `/v3/projects/f1f9b76f476c48ecbaaa174761abe935` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:02.196677 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461158ed-8889-4321-9b40-93131ccad8f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=f1f9b76f476c48ecbaaa174761abe935)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:02.198682 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461158ed-8889-4321-9b40-93131ccad8f2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:02.200411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 523/1056] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:19:02 2021] GET /identity/v3/projects/f1f9b76f476c48ecbaaa174761abe935 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:19:02.206715 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f115fa1-a81f-4dd5-ac0b-b938db0fe60a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:02.214922 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f115fa1-a81f-4dd5-ac0b-b938db0fe60a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:02.219923 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d13eff-23b6-41c5-81f4-008afbab21a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:02.220539 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d13eff-23b6-41c5-81f4-008afbab21a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:02.220818 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d13eff-23b6-41c5-81f4-008afbab21a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:02.221122 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d13eff-23b6-41c5-81f4-008afbab21a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:02.221921 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d13eff-23b6-41c5-81f4-008afbab21a9 admin admin] RBAC: Adding query filter params (role.id=19308d3515f546e9a04e44ae278cd111, scope.project.id=f1f9b76f476c48ecbaaa174761abe935, user.id=ff928b4686cf4c438936a7259af7d9a9) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:19:02.222229 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d13eff-23b6-41c5-81f4-008afbab21a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:02.223990 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d13eff-23b6-41c5-81f4-008afbab21a9 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:02.229442 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 534/1057] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:19:02 2021] GET /identity/v3/role_assignments?user.id=ff928b4686cf4c438936a7259af7d9a9&scope.project.id=f1f9b76f476c48ecbaaa174761abe935&role.id=19308d3515f546e9a04e44ae278cd111 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:19:04.342847 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13767588-41eb-4ed5-8d0d-048463557518 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:04.343414 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13767588-41eb-4ed5-8d0d-048463557518 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:04.343414 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13767588-41eb-4ed5-8d0d-048463557518 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:04.345198 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 524/1058] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:19:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:19:04.352064 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f28123-c701-4b1f-807f-3dc6898c6132 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:04.352484 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f28123-c701-4b1f-807f-3dc6898c6132 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:04.352607 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f28123-c701-4b1f-807f-3dc6898c6132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:04.370389 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-d2f28123-c701-4b1f-807f-3dc6898c6132 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:19:04.371556 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d2f28123-c701-4b1f-807f-3dc6898c6132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:19:04.379697 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 535/1059] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:19:04 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:19:04.402195 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13767588-41eb-4ed5-8d0d-048463557518 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:04.413995 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13767588-41eb-4ed5-8d0d-048463557518 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:04.418271 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bdc10-854f-47a0-b361-18fe2dfe76d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:04.418894 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bdc10-854f-47a0-b361-18fe2dfe76d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:04.419175 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bdc10-854f-47a0-b361-18fe2dfe76d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:04.419449 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bdc10-854f-47a0-b361-18fe2dfe76d1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:04.427371 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6bdc10-854f-47a0-b361-18fe2dfe76d1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:04.429112 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6bdc10-854f-47a0-b361-18fe2dfe76d1 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:04.437564 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 525/1060] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:19:04 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:19:04.444154 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f28123-c701-4b1f-807f-3dc6898c6132 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:04.452596 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f28123-c701-4b1f-807f-3dc6898c6132 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:04.457243 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d94fe-ba79-4c3e-b7d8-4d128f177dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:04.458011 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d94fe-ba79-4c3e-b7d8-4d128f177dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:04.458288 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d94fe-ba79-4c3e-b7d8-4d128f177dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:04.458560 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d94fe-ba79-4c3e-b7d8-4d128f177dc7 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:04.465129 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d94fe-ba79-4c3e-b7d8-4d128f177dc7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:04.466925 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d94fe-ba79-4c3e-b7d8-4d128f177dc7 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:04.480162 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-0f9d94fe-ba79-4c3e-b7d8-4d128f177dc7 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 15 02:19:04.481326 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 536/1061] 10.222.0.32 () {56 vars in 1139 bytes} [Wed Sep 15 02:19:04 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:19:04.488698 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bdc10-854f-47a0-b361-18fe2dfe76d1 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:04.497535 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bdc10-854f-47a0-b361-18fe2dfe76d1 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:04.502848 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06560571-656e-4bfd-ae17-ea88034dbd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:04.503491 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06560571-656e-4bfd-ae17-ea88034dbd55 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:04.503778 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06560571-656e-4bfd-ae17-ea88034dbd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:04.504056 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06560571-656e-4bfd-ae17-ea88034dbd55 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:04.504778 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06560571-656e-4bfd-ae17-ea88034dbd55 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:19:04.505239 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06560571-656e-4bfd-ae17-ea88034dbd55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:04.507369 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06560571-656e-4bfd-ae17-ea88034dbd55 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:04.514539 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 526/1062] 10.222.0.32 () {56 vars in 1137 bytes} [Wed Sep 15 02:19:04 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:19:06.602726 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cd0a7-2eb8-4599-9556-8f61f1cb1a70 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:06.603253 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cd0a7-2eb8-4599-9556-8f61f1cb1a70 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:06.603253 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cd0a7-2eb8-4599-9556-8f61f1cb1a70 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:06.605078 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 537/1063] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:19:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:19:06.612996 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2293132-a1e0-489f-b4e8-42a9556bf0d2 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:06.613389 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2293132-a1e0-489f-b4e8-42a9556bf0d2 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:06.613559 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2293132-a1e0-489f-b4e8-42a9556bf0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:06.630543 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-a2293132-a1e0-489f-b4e8-42a9556bf0d2 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:19:06.631759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a2293132-a1e0-489f-b4e8-42a9556bf0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:19:06.639370 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 527/1064] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:19:06 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:19:06.663717 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cd0a7-2eb8-4599-9556-8f61f1cb1a70 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:06.675424 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cd0a7-2eb8-4599-9556-8f61f1cb1a70 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:06.679775 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427eb6ba-79a1-4f64-b1ce-d147bef3a230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:06.680463 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eb6ba-79a1-4f64-b1ce-d147bef3a230 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:06.680741 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eb6ba-79a1-4f64-b1ce-d147bef3a230 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:06.681089 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427eb6ba-79a1-4f64-b1ce-d147bef3a230 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:06.681822 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427eb6ba-79a1-4f64-b1ce-d147bef3a230 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:06.682833 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING py.warnings [None req-427eb6ba-79a1-4f64-b1ce-d147bef3a230 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:19:06.682833 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: warnings.warn(msg) Sep 15 02:19:06.682833 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: Sep 15 02:19:06.683734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427eb6ba-79a1-4f64-b1ce-d147bef3a230 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:06.697404 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 538/1065] 10.222.0.32 () {60 vars in 1160 bytes} [Wed Sep 15 02:19:06 2021] POST /identity/v3/domains => generated 267 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:19:08.832112 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17349399-f9cb-4926-a33e-79e93947e9b4 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:08.832681 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17349399-f9cb-4926-a33e-79e93947e9b4 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:08.832681 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17349399-f9cb-4926-a33e-79e93947e9b4 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:08.834381 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 528/1066] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:19:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:19:08.841295 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cef44-30fd-4c91-a851-6f9e0ab90d9c None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:08.841740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cef44-30fd-4c91-a851-6f9e0ab90d9c None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:08.841834 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cef44-30fd-4c91-a851-6f9e0ab90d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:08.859020 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-287cef44-30fd-4c91-a851-6f9e0ab90d9c None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:19:08.860980 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-287cef44-30fd-4c91-a851-6f9e0ab90d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:19:08.914371 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 539/1067] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:19:08 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:19:08.939352 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17349399-f9cb-4926-a33e-79e93947e9b4 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:08.951088 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17349399-f9cb-4926-a33e-79e93947e9b4 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:08.955403 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847fcde-7902-467a-b712-aa2fc78d877a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:08.956230 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847fcde-7902-467a-b712-aa2fc78d877a admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:08.956511 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847fcde-7902-467a-b712-aa2fc78d877a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:08.956784 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847fcde-7902-467a-b712-aa2fc78d877a admin admin] PATH_INFO: `/v3/domains/71f3611f07cf4c049df045b246e825bf` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:08.966862 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847fcde-7902-467a-b712-aa2fc78d877a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=71f3611f07cf4c049df045b246e825bf)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:08.968800 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847fcde-7902-467a-b712-aa2fc78d877a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:08.970369 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 529/1068] 10.222.0.32 () {56 vars in 1205 bytes} [Wed Sep 15 02:19:08 2021] GET /identity/v3/domains/71f3611f07cf4c049df045b246e825bf => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:19:08.976293 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cef44-30fd-4c91-a851-6f9e0ab90d9c None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:08.985674 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cef44-30fd-4c91-a851-6f9e0ab90d9c None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:08.990154 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46e8c1-dddb-43a8-a4c2-c7fde12fcde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:08.990791 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46e8c1-dddb-43a8-a4c2-c7fde12fcde0 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:08.991071 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46e8c1-dddb-43a8-a4c2-c7fde12fcde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:08.991349 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46e8c1-dddb-43a8-a4c2-c7fde12fcde0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:08.992040 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46e8c1-dddb-43a8-a4c2-c7fde12fcde0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:08.993957 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46e8c1-dddb-43a8-a4c2-c7fde12fcde0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:09.018544 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 540/1069] 10.222.0.32 () {60 vars in 1163 bytes} [Wed Sep 15 02:19:08 2021] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:19:11.165852 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310f57d-6a5d-4f83-a682-ef6cb3d073e6 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:11.166387 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310f57d-6a5d-4f83-a682-ef6cb3d073e6 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:11.166387 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310f57d-6a5d-4f83-a682-ef6cb3d073e6 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:11.168169 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 530/1070] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:19:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:19:11.175172 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e5ed2-6426-4630-98ce-433293cb8670 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:11.175570 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e5ed2-6426-4630-98ce-433293cb8670 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:11.175731 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e5ed2-6426-4630-98ce-433293cb8670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:11.192854 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-639e5ed2-6426-4630-98ce-433293cb8670 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:19:11.194054 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-639e5ed2-6426-4630-98ce-433293cb8670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:19:11.248043 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 541/1071] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:19:11 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:19:11.273892 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310f57d-6a5d-4f83-a682-ef6cb3d073e6 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:11.286308 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310f57d-6a5d-4f83-a682-ef6cb3d073e6 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:11.290752 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56a6b1-ec29-4860-8837-ec289333c628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:11.291587 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56a6b1-ec29-4860-8837-ec289333c628 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:11.291866 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56a6b1-ec29-4860-8837-ec289333c628 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:11.292137 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56a6b1-ec29-4860-8837-ec289333c628 admin admin] PATH_INFO: `/v3/domains/71f3611f07cf4c049df045b246e825bf` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:11.293334 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56a6b1-ec29-4860-8837-ec289333c628 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=71f3611f07cf4c049df045b246e825bf)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:11.295255 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56a6b1-ec29-4860-8837-ec289333c628 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:11.296799 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 531/1072] 10.222.0.32 () {56 vars in 1205 bytes} [Wed Sep 15 02:19:11 2021] GET /identity/v3/domains/71f3611f07cf4c049df045b246e825bf => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:19:11.302640 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e5ed2-6426-4630-98ce-433293cb8670 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:11.311143 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e5ed2-6426-4630-98ce-433293cb8670 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:11.315562 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f35aa-21c1-49e3-b334-b03d13f13e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:11.316203 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f35aa-21c1-49e3-b334-b03d13f13e47 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:11.316481 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f35aa-21c1-49e3-b334-b03d13f13e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:11.316756 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f35aa-21c1-49e3-b334-b03d13f13e47 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:11.317560 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f35aa-21c1-49e3-b334-b03d13f13e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:11.319455 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f35aa-21c1-49e3-b334-b03d13f13e47 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:11.339672 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 542/1073] 10.222.0.32 () {60 vars in 1154 bytes} [Wed Sep 15 02:19:11 2021] POST /identity/v3/users => generated 311 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:19:13.496047 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386faf1-2128-42ba-bb0b-58480021a9ee None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:13.496459 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386faf1-2128-42ba-bb0b-58480021a9ee None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:13.496593 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386faf1-2128-42ba-bb0b-58480021a9ee None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:13.498481 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 532/1074] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:19:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:19:13.506311 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a609ae5-b8d9-4f66-b75a-9b29a4e1243c None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:13.506796 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a609ae5-b8d9-4f66-b75a-9b29a4e1243c None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:13.506891 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a609ae5-b8d9-4f66-b75a-9b29a4e1243c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:13.524019 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-5a609ae5-b8d9-4f66-b75a-9b29a4e1243c None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:19:13.525234 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-5a609ae5-b8d9-4f66-b75a-9b29a4e1243c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:19:13.532763 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 543/1075] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:19:13 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:19:13.556989 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386faf1-2128-42ba-bb0b-58480021a9ee None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:13.569295 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386faf1-2128-42ba-bb0b-58480021a9ee None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:13.573588 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2062b2-eafb-4d81-a050-135a90bfd3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:13.574347 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2062b2-eafb-4d81-a050-135a90bfd3ec admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:13.574625 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2062b2-eafb-4d81-a050-135a90bfd3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:13.574902 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2062b2-eafb-4d81-a050-135a90bfd3ec admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:13.585552 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2062b2-eafb-4d81-a050-135a90bfd3ec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:19:13.592235 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-fd2062b2-eafb-4d81-a050-135a90bfd3ec admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:19:13.593377 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 533/1076] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:19:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:19:13.599534 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a609ae5-b8d9-4f66-b75a-9b29a4e1243c None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:13.608154 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a609ae5-b8d9-4f66-b75a-9b29a4e1243c None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:13.613381 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbc489-4779-4df3-9616-b00efee2c020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:13.614019 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbc489-4779-4df3-9616-b00efee2c020 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:13.614301 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbc489-4779-4df3-9616-b00efee2c020 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:13.614579 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbc489-4779-4df3-9616-b00efee2c020 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:13.615320 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbc489-4779-4df3-9616-b00efee2c020 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:19:13.615627 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbc489-4779-4df3-9616-b00efee2c020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:13.617244 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbc489-4779-4df3-9616-b00efee2c020 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:13.625763 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 544/1077] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:19:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:19:13.631468 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2062b2-eafb-4d81-a050-135a90bfd3ec admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:13.640467 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2062b2-eafb-4d81-a050-135a90bfd3ec admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:13.645007 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665fcae-3c0f-407c-b786-bc98b3c486fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:13.645838 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665fcae-3c0f-407c-b786-bc98b3c486fa admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:13.646115 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665fcae-3c0f-407c-b786-bc98b3c486fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:13.646386 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665fcae-3c0f-407c-b786-bc98b3c486fa admin admin] PATH_INFO: `/v3/users/452834364e7e426db730e8f3d9f683eb` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:13.659086 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665fcae-3c0f-407c-b786-bc98b3c486fa admin admin] RBAC: Authorizing `identity:get_user(user_id=452834364e7e426db730e8f3d9f683eb)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:13.661260 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665fcae-3c0f-407c-b786-bc98b3c486fa admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:13.662836 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 534/1078] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:19:13 2021] GET /identity/v3/users/452834364e7e426db730e8f3d9f683eb => generated 311 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:19:13.668784 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbc489-4779-4df3-9616-b00efee2c020 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:13.678498 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbc489-4779-4df3-9616-b00efee2c020 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:13.683043 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68159e36-6075-4318-9f06-1bfdae9ae7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:13.683663 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68159e36-6075-4318-9f06-1bfdae9ae7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:13.683949 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68159e36-6075-4318-9f06-1bfdae9ae7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:13.684230 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68159e36-6075-4318-9f06-1bfdae9ae7f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:13.692369 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68159e36-6075-4318-9f06-1bfdae9ae7f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:13.694123 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68159e36-6075-4318-9f06-1bfdae9ae7f8 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:13.702720 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 545/1079] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:19:13 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:19:13.708570 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665fcae-3c0f-407c-b786-bc98b3c486fa admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:13.717661 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665fcae-3c0f-407c-b786-bc98b3c486fa admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:13.722158 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747efcd3-8fa8-423e-b5f2-3b44a25ae6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:13.722963 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747efcd3-8fa8-423e-b5f2-3b44a25ae6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:13.723244 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747efcd3-8fa8-423e-b5f2-3b44a25ae6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:13.723520 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747efcd3-8fa8-423e-b5f2-3b44a25ae6b3 admin admin] PATH_INFO: `/v3/projects/f6ad87048e524602a84d7b868809ef09` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:13.724656 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747efcd3-8fa8-423e-b5f2-3b44a25ae6b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6ad87048e524602a84d7b868809ef09)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:13.726661 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747efcd3-8fa8-423e-b5f2-3b44a25ae6b3 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:13.728291 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 535/1080] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:19:13 2021] GET /identity/v3/projects/f6ad87048e524602a84d7b868809ef09 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:19:13.734190 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68159e36-6075-4318-9f06-1bfdae9ae7f8 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:13.743252 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68159e36-6075-4318-9f06-1bfdae9ae7f8 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:13.747711 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6b586-80a5-4de7-a606-4a36175d491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:13.748316 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6b586-80a5-4de7-a606-4a36175d491f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:13.748603 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6b586-80a5-4de7-a606-4a36175d491f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:13.748913 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6b586-80a5-4de7-a606-4a36175d491f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:13.749725 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6b586-80a5-4de7-a606-4a36175d491f admin admin] RBAC: Adding query filter params (role.id=19308d3515f546e9a04e44ae278cd111, scope.project.id=f6ad87048e524602a84d7b868809ef09, user.id=452834364e7e426db730e8f3d9f683eb) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:19:13.750640 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6b586-80a5-4de7-a606-4a36175d491f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:13.752422 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6b586-80a5-4de7-a606-4a36175d491f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:13.757706 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 546/1081] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:19:13 2021] GET /identity/v3/role_assignments?user.id=452834364e7e426db730e8f3d9f683eb&scope.project.id=f6ad87048e524602a84d7b868809ef09&role.id=19308d3515f546e9a04e44ae278cd111 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:19:15.837143 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b0a43-f4e3-464c-8e1c-0cefe77c16a7 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:15.837671 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b0a43-f4e3-464c-8e1c-0cefe77c16a7 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:15.837671 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b0a43-f4e3-464c-8e1c-0cefe77c16a7 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:15.839396 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 536/1082] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:19:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:19:15.846203 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a776f-3784-4164-8b47-2e601b153ae9 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:15.846625 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a776f-3784-4164-8b47-2e601b153ae9 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:15.846758 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a776f-3784-4164-8b47-2e601b153ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:15.864411 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-a13a776f-3784-4164-8b47-2e601b153ae9 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:19:15.865602 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-a13a776f-3784-4164-8b47-2e601b153ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:19:15.873096 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 547/1083] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:19:15 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:19:15.897017 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b0a43-f4e3-464c-8e1c-0cefe77c16a7 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:15.908743 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b0a43-f4e3-464c-8e1c-0cefe77c16a7 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:15.913108 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c2946-b701-4c21-9ce0-b2bd8d39c6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:15.913865 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c2946-b701-4c21-9ce0-b2bd8d39c6ce admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:15.914147 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c2946-b701-4c21-9ce0-b2bd8d39c6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:15.914421 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c2946-b701-4c21-9ce0-b2bd8d39c6ce admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:15.924675 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c2946-b701-4c21-9ce0-b2bd8d39c6ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:19:15.931423 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-516c2946-b701-4c21-9ce0-b2bd8d39c6ce admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:19:15.932526 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 537/1084] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:19:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:19:15.939205 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a776f-3784-4164-8b47-2e601b153ae9 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:15.947701 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a776f-3784-4164-8b47-2e601b153ae9 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:15.952097 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb4cbe-e91b-4d8c-80e0-0283c3eb8b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:15.952730 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb4cbe-e91b-4d8c-80e0-0283c3eb8b26 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:15.953048 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb4cbe-e91b-4d8c-80e0-0283c3eb8b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:15.953322 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb4cbe-e91b-4d8c-80e0-0283c3eb8b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:15.954050 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb4cbe-e91b-4d8c-80e0-0283c3eb8b26 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:19:15.954352 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb4cbe-e91b-4d8c-80e0-0283c3eb8b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:15.955912 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb4cbe-e91b-4d8c-80e0-0283c3eb8b26 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:15.963734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 548/1085] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:19:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:19:15.969681 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c2946-b701-4c21-9ce0-b2bd8d39c6ce admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:15.979110 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c2946-b701-4c21-9ce0-b2bd8d39c6ce admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:15.983697 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16afaab6-5d3c-4f0e-8325-fe43700d081c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:15.985058 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afaab6-5d3c-4f0e-8325-fe43700d081c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:15.985592 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afaab6-5d3c-4f0e-8325-fe43700d081c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:15.985863 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afaab6-5d3c-4f0e-8325-fe43700d081c admin admin] PATH_INFO: `/v3/users/452834364e7e426db730e8f3d9f683eb` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:15.987029 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16afaab6-5d3c-4f0e-8325-fe43700d081c admin admin] RBAC: Authorizing `identity:get_user(user_id=452834364e7e426db730e8f3d9f683eb)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:15.989212 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16afaab6-5d3c-4f0e-8325-fe43700d081c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:15.990746 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 538/1086] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:19:15 2021] GET /identity/v3/users/452834364e7e426db730e8f3d9f683eb => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:19:15.996405 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb4cbe-e91b-4d8c-80e0-0283c3eb8b26 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:16.006102 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb4cbe-e91b-4d8c-80e0-0283c3eb8b26 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:16.010523 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791596a1-0e62-4697-a8f9-bda5d2145d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:16.011325 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791596a1-0e62-4697-a8f9-bda5d2145d55 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:16.011602 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791596a1-0e62-4697-a8f9-bda5d2145d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:16.011872 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791596a1-0e62-4697-a8f9-bda5d2145d55 admin admin] PATH_INFO: `/v3/projects/f6ad87048e524602a84d7b868809ef09` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:16.013037 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791596a1-0e62-4697-a8f9-bda5d2145d55 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6ad87048e524602a84d7b868809ef09)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:16.015021 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791596a1-0e62-4697-a8f9-bda5d2145d55 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:16.016593 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 549/1087] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:19:15 2021] GET /identity/v3/projects/f6ad87048e524602a84d7b868809ef09 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:19:16.022445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16afaab6-5d3c-4f0e-8325-fe43700d081c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:16.031821 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16afaab6-5d3c-4f0e-8325-fe43700d081c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:16.036219 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d0f8b-fd32-4f49-a557-35abdcbe29eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:16.037076 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d0f8b-fd32-4f49-a557-35abdcbe29eb admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:16.037358 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d0f8b-fd32-4f49-a557-35abdcbe29eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:16.037630 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d0f8b-fd32-4f49-a557-35abdcbe29eb admin admin] PATH_INFO: `/v3/projects/f6ad87048e524602a84d7b868809ef09/users/452834364e7e426db730e8f3d9f683eb/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:16.039495 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d0f8b-fd32-4f49-a557-35abdcbe29eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ad87048e524602a84d7b868809ef09, user_id=452834364e7e426db730e8f3d9f683eb, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:16.042050 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d0f8b-fd32-4f49-a557-35abdcbe29eb admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:16.055044 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 539/1088] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:19:16 2021] PUT /identity/v3/projects/f6ad87048e524602a84d7b868809ef09/users/452834364e7e426db730e8f3d9f683eb/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:19:18.140896 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067a1b4-0b7c-4a50-b808-c33cffa23c36 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:18.141436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067a1b4-0b7c-4a50-b808-c33cffa23c36 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:18.141543 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067a1b4-0b7c-4a50-b808-c33cffa23c36 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:18.143254 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 550/1089] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:19:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:19:18.150356 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2702ace-e547-45de-814c-2ed5a8dae85b None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:18.150767 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2702ace-e547-45de-814c-2ed5a8dae85b None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:18.150921 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2702ace-e547-45de-814c-2ed5a8dae85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:18.167970 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-f2702ace-e547-45de-814c-2ed5a8dae85b None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:19:18.169187 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-f2702ace-e547-45de-814c-2ed5a8dae85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:19:18.223604 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 540/1090] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:19:18 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:19:18.247953 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067a1b4-0b7c-4a50-b808-c33cffa23c36 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:18.260302 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067a1b4-0b7c-4a50-b808-c33cffa23c36 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:18.264588 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73e25c-f4b7-46ec-a491-39a3fb76e52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:18.265390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73e25c-f4b7-46ec-a491-39a3fb76e52a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:18.265670 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73e25c-f4b7-46ec-a491-39a3fb76e52a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:18.265942 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73e25c-f4b7-46ec-a491-39a3fb76e52a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:18.275598 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc73e25c-f4b7-46ec-a491-39a3fb76e52a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:19:18.282871 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-bc73e25c-f4b7-46ec-a491-39a3fb76e52a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:19:18.283987 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 551/1091] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:19:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:19:18.290006 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2702ace-e547-45de-814c-2ed5a8dae85b None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:18.299065 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2702ace-e547-45de-814c-2ed5a8dae85b None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:18.303682 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de106bf-24b7-4630-8fb7-81e642d26282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:18.304325 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de106bf-24b7-4630-8fb7-81e642d26282 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:18.304600 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de106bf-24b7-4630-8fb7-81e642d26282 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:18.304865 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de106bf-24b7-4630-8fb7-81e642d26282 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:18.305622 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de106bf-24b7-4630-8fb7-81e642d26282 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:19:18.305921 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de106bf-24b7-4630-8fb7-81e642d26282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:18.307483 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de106bf-24b7-4630-8fb7-81e642d26282 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:18.315327 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 541/1092] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:19:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:19:18.321542 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73e25c-f4b7-46ec-a491-39a3fb76e52a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:18.331174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc73e25c-f4b7-46ec-a491-39a3fb76e52a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:18.335642 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f980ace-9d96-45ba-ae05-d498d72d6771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:18.336456 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f980ace-9d96-45ba-ae05-d498d72d6771 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:18.336734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f980ace-9d96-45ba-ae05-d498d72d6771 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:18.337043 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f980ace-9d96-45ba-ae05-d498d72d6771 admin admin] PATH_INFO: `/v3/users/452834364e7e426db730e8f3d9f683eb` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:18.338193 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f980ace-9d96-45ba-ae05-d498d72d6771 admin admin] RBAC: Authorizing `identity:get_user(user_id=452834364e7e426db730e8f3d9f683eb)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:18.340272 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f980ace-9d96-45ba-ae05-d498d72d6771 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:18.341951 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 552/1093] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:19:18 2021] GET /identity/v3/users/452834364e7e426db730e8f3d9f683eb => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:19:18.347974 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de106bf-24b7-4630-8fb7-81e642d26282 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:18.356850 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de106bf-24b7-4630-8fb7-81e642d26282 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:18.362188 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc1e40-35b6-412f-9f91-8082911d41de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:18.362782 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc1e40-35b6-412f-9f91-8082911d41de admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:18.363062 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc1e40-35b6-412f-9f91-8082911d41de admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:18.363335 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc1e40-35b6-412f-9f91-8082911d41de admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:18.370653 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc1e40-35b6-412f-9f91-8082911d41de admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:18.372312 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc1e40-35b6-412f-9f91-8082911d41de admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:18.380667 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 542/1094] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:19:18 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:19:18.386636 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f980ace-9d96-45ba-ae05-d498d72d6771 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:18.395662 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f980ace-9d96-45ba-ae05-d498d72d6771 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:18.400081 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5253a-056c-4b87-8dbf-4964273bf9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:18.400860 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5253a-056c-4b87-8dbf-4964273bf9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:18.401166 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5253a-056c-4b87-8dbf-4964273bf9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:18.401433 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5253a-056c-4b87-8dbf-4964273bf9f7 admin admin] PATH_INFO: `/v3/projects/f6ad87048e524602a84d7b868809ef09` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:18.402562 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5253a-056c-4b87-8dbf-4964273bf9f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6ad87048e524602a84d7b868809ef09)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:18.404552 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5253a-056c-4b87-8dbf-4964273bf9f7 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:18.406644 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 553/1095] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:19:18 2021] GET /identity/v3/projects/f6ad87048e524602a84d7b868809ef09 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:19:18.412540 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc1e40-35b6-412f-9f91-8082911d41de admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:19:18.420621 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc1e40-35b6-412f-9f91-8082911d41de admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:19:18.425700 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcea6e2-3800-4273-acb6-a65c2efad095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:19:18.426319 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcea6e2-3800-4273-acb6-a65c2efad095 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:19:18.426601 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcea6e2-3800-4273-acb6-a65c2efad095 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:19:18.426872 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcea6e2-3800-4273-acb6-a65c2efad095 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:19:18.427662 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcea6e2-3800-4273-acb6-a65c2efad095 admin admin] RBAC: Adding query filter params (role.id=19308d3515f546e9a04e44ae278cd111, scope.project.id=f6ad87048e524602a84d7b868809ef09, user.id=452834364e7e426db730e8f3d9f683eb) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:19:18.427966 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcea6e2-3800-4273-acb6-a65c2efad095 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:19:18.429752 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcea6e2-3800-4273-acb6-a65c2efad095 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:19:18.435143 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 543/1096] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:19:18 2021] GET /identity/v3/role_assignments?user.id=452834364e7e426db730e8f3d9f683eb&scope.project.id=f6ad87048e524602a84d7b868809ef09&role.id=19308d3515f546e9a04e44ae278cd111 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:12.258066 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a0110-309a-4578-9ef5-2567ecf9c7db None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:12.258687 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a0110-309a-4578-9ef5-2567ecf9c7db None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:12.258687 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a0110-309a-4578-9ef5-2567ecf9c7db None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:12.260481 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 554/1097] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:20:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:20:12.269033 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ada3fe-f18b-44f2-be94-ba8636ee4137 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:12.269560 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ada3fe-f18b-44f2-be94-ba8636ee4137 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:12.269654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ada3fe-f18b-44f2-be94-ba8636ee4137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:12.288987 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-b1ada3fe-f18b-44f2-be94-ba8636ee4137 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:20:12.290300 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b1ada3fe-f18b-44f2-be94-ba8636ee4137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:20:12.299795 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 544/1098] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:20:12 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:20:12.328064 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a0110-309a-4578-9ef5-2567ecf9c7db None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:12.342412 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a0110-309a-4578-9ef5-2567ecf9c7db None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:12.348039 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf733b3-906b-4083-9828-cc5573709e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:12.348945 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf733b3-906b-4083-9828-cc5573709e11 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:12.349255 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf733b3-906b-4083-9828-cc5573709e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:12.349531 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf733b3-906b-4083-9828-cc5573709e11 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:12.362843 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf733b3-906b-4083-9828-cc5573709e11 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:12.364947 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf733b3-906b-4083-9828-cc5573709e11 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:12.386318 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-ddf733b3-906b-4083-9828-cc5573709e11 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:20:12.387849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 555/1099] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:20:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:12.396929 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ada3fe-f18b-44f2-be94-ba8636ee4137 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:12.405719 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ada3fe-f18b-44f2-be94-ba8636ee4137 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:12.410435 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b75a95-d1f1-4627-a404-57348875826f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:12.411225 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b75a95-d1f1-4627-a404-57348875826f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:12.411549 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b75a95-d1f1-4627-a404-57348875826f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:12.411899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b75a95-d1f1-4627-a404-57348875826f admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:12.412716 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b75a95-d1f1-4627-a404-57348875826f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:12.413100 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b75a95-d1f1-4627-a404-57348875826f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:12.414749 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b75a95-d1f1-4627-a404-57348875826f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:12.432906 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 545/1100] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:20:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:12.437953 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf733b3-906b-4083-9828-cc5573709e11 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:12.450079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf733b3-906b-4083-9828-cc5573709e11 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:12.457301 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72730c5b-e71d-467c-9f12-0abfdd6585c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:12.458066 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72730c5b-e71d-467c-9f12-0abfdd6585c2 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:12.458454 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72730c5b-e71d-467c-9f12-0abfdd6585c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:12.458765 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72730c5b-e71d-467c-9f12-0abfdd6585c2 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:12.459511 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72730c5b-e71d-467c-9f12-0abfdd6585c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:12.461995 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72730c5b-e71d-467c-9f12-0abfdd6585c2 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:12.497136 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 556/1101] 10.222.0.32 () {60 vars in 1154 bytes} [Wed Sep 15 02:20:12 2021] POST /identity/v3/users => generated 251 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:20:14.878342 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef64b6d-c51e-41c0-aee8-f448c5269e07 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:14.878911 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef64b6d-c51e-41c0-aee8-f448c5269e07 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:14.878911 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef64b6d-c51e-41c0-aee8-f448c5269e07 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:14.880642 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 546/1102] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:20:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:20:14.888849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caae245-6101-4709-b3e3-bdfd8b467822 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:14.889365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caae245-6101-4709-b3e3-bdfd8b467822 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:14.889475 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caae245-6101-4709-b3e3-bdfd8b467822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:14.909457 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-4caae245-6101-4709-b3e3-bdfd8b467822 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:20:14.910650 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4caae245-6101-4709-b3e3-bdfd8b467822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:20:14.920399 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 557/1103] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:20:14 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:20:14.949184 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef64b6d-c51e-41c0-aee8-f448c5269e07 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:14.962839 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef64b6d-c51e-41c0-aee8-f448c5269e07 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:14.968324 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2538d44-55c4-4e54-99a0-1be0bfb06d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:14.969213 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2538d44-55c4-4e54-99a0-1be0bfb06d0e admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:14.969526 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2538d44-55c4-4e54-99a0-1be0bfb06d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:14.969838 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2538d44-55c4-4e54-99a0-1be0bfb06d0e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:14.982683 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2538d44-55c4-4e54-99a0-1be0bfb06d0e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:20:14.990749 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-d2538d44-55c4-4e54-99a0-1be0bfb06d0e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 02:20:14.992240 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 547/1104] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:20:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:15.000256 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caae245-6101-4709-b3e3-bdfd8b467822 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:15.010393 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caae245-6101-4709-b3e3-bdfd8b467822 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:15.016545 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf737bcb-1eea-4ace-b361-4c6c04b2c8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:15.017322 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf737bcb-1eea-4ace-b361-4c6c04b2c8ca admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:15.017662 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf737bcb-1eea-4ace-b361-4c6c04b2c8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:15.017988 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf737bcb-1eea-4ace-b361-4c6c04b2c8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:15.018739 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf737bcb-1eea-4ace-b361-4c6c04b2c8ca admin admin] RBAC: Adding query filter params (name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:15.019053 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf737bcb-1eea-4ace-b361-4c6c04b2c8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:15.020785 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf737bcb-1eea-4ace-b361-4c6c04b2c8ca admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:15.030098 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 558/1105] 10.222.0.32 () {56 vars in 1125 bytes} [Wed Sep 15 02:20:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:15.036263 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2538d44-55c4-4e54-99a0-1be0bfb06d0e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:15.048246 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2538d44-55c4-4e54-99a0-1be0bfb06d0e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:15.054490 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d52b7f-a669-4cc5-a745-5c6846907079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:15.055393 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d52b7f-a669-4cc5-a745-5c6846907079 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:15.055772 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d52b7f-a669-4cc5-a745-5c6846907079 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:15.056189 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d52b7f-a669-4cc5-a745-5c6846907079 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:15.069522 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d52b7f-a669-4cc5-a745-5c6846907079 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:15.071587 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d52b7f-a669-4cc5-a745-5c6846907079 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:15.090590 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-10d52b7f-a669-4cc5-a745-5c6846907079 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:20:15.096908 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 548/1106] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:20:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:15.098721 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf737bcb-1eea-4ace-b361-4c6c04b2c8ca admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:15.114750 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf737bcb-1eea-4ace-b361-4c6c04b2c8ca admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:15.121121 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2651a0-45a1-46dc-8551-a25a37ad6083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:15.121948 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2651a0-45a1-46dc-8551-a25a37ad6083 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:15.122314 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2651a0-45a1-46dc-8551-a25a37ad6083 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:15.123366 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2651a0-45a1-46dc-8551-a25a37ad6083 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:15.124223 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2651a0-45a1-46dc-8551-a25a37ad6083 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:15.124652 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2651a0-45a1-46dc-8551-a25a37ad6083 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:15.126678 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2651a0-45a1-46dc-8551-a25a37ad6083 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:15.142075 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 559/1107] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:20:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:15.149702 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d52b7f-a669-4cc5-a745-5c6846907079 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:15.162945 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d52b7f-a669-4cc5-a745-5c6846907079 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:15.170956 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd517da-b430-4880-a9bf-d769608ecf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:15.171993 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd517da-b430-4880-a9bf-d769608ecf13 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:15.172531 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd517da-b430-4880-a9bf-d769608ecf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:15.172986 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd517da-b430-4880-a9bf-d769608ecf13 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:15.184804 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd517da-b430-4880-a9bf-d769608ecf13 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:15.188475 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd517da-b430-4880-a9bf-d769608ecf13 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:15.205595 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-2fd517da-b430-4880-a9bf-d769608ecf13 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 02:20:15.212212 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 549/1108] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:20:15 2021] GET /identity/v3/users/placement => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:15.213593 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2651a0-45a1-46dc-8551-a25a37ad6083 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:15.226359 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2651a0-45a1-46dc-8551-a25a37ad6083 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:15.237282 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123910c1-8d6a-4dd3-a58f-5ee4ea2e4296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:15.238184 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123910c1-8d6a-4dd3-a58f-5ee4ea2e4296 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:15.238662 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123910c1-8d6a-4dd3-a58f-5ee4ea2e4296 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:15.239045 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123910c1-8d6a-4dd3-a58f-5ee4ea2e4296 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:15.240164 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123910c1-8d6a-4dd3-a58f-5ee4ea2e4296 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:15.240587 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123910c1-8d6a-4dd3-a58f-5ee4ea2e4296 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:15.242565 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123910c1-8d6a-4dd3-a58f-5ee4ea2e4296 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:15.264205 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 560/1109] 10.222.0.32 () {56 vars in 1165 bytes} [Wed Sep 15 02:20:15 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:15.270632 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd517da-b430-4880-a9bf-d769608ecf13 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:15.282598 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd517da-b430-4880-a9bf-d769608ecf13 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:15.287793 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1e507-a28d-4a99-93ed-94b8d94a84c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:15.288469 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1e507-a28d-4a99-93ed-94b8d94a84c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:15.288859 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1e507-a28d-4a99-93ed-94b8d94a84c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:15.289231 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1e507-a28d-4a99-93ed-94b8d94a84c2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:15.300601 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1e507-a28d-4a99-93ed-94b8d94a84c2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:15.302592 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1e507-a28d-4a99-93ed-94b8d94a84c2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:15.313166 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 550/1110] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:20:15 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:20:15.321451 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123910c1-8d6a-4dd3-a58f-5ee4ea2e4296 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:15.333777 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123910c1-8d6a-4dd3-a58f-5ee4ea2e4296 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:15.339266 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd46b6-79f3-4466-8b6c-193293fc7c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:15.340061 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd46b6-79f3-4466-8b6c-193293fc7c65 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:15.340352 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd46b6-79f3-4466-8b6c-193293fc7c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:15.340628 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd46b6-79f3-4466-8b6c-193293fc7c65 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:15.353456 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd46b6-79f3-4466-8b6c-193293fc7c65 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:15.355730 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd46b6-79f3-4466-8b6c-193293fc7c65 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:15.377526 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-7bbd46b6-79f3-4466-8b6c-193293fc7c65 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:20:15.379244 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 561/1111] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:20:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:15.385507 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1e507-a28d-4a99-93ed-94b8d94a84c2 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:15.395898 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1e507-a28d-4a99-93ed-94b8d94a84c2 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:15.401905 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc42de9-ae5c-477f-8d3f-734f18e266e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:15.402841 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc42de9-ae5c-477f-8d3f-734f18e266e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:15.403408 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc42de9-ae5c-477f-8d3f-734f18e266e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:15.404277 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc42de9-ae5c-477f-8d3f-734f18e266e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:15.405309 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc42de9-ae5c-477f-8d3f-734f18e266e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:15.405710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc42de9-ae5c-477f-8d3f-734f18e266e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:15.407543 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc42de9-ae5c-477f-8d3f-734f18e266e1 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:15.422964 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 551/1112] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:20:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:20:15.429362 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd46b6-79f3-4466-8b6c-193293fc7c65 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:15.439953 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd46b6-79f3-4466-8b6c-193293fc7c65 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:15.444950 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d91f2-b7cd-4142-872c-9a76a1bc1c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:15.445872 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d91f2-b7cd-4142-872c-9a76a1bc1c6b admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:15.446230 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d91f2-b7cd-4142-872c-9a76a1bc1c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:15.446513 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d91f2-b7cd-4142-872c-9a76a1bc1c6b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:15.454347 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d91f2-b7cd-4142-872c-9a76a1bc1c6b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:15.456433 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d91f2-b7cd-4142-872c-9a76a1bc1c6b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:15.471278 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-448d91f2-b7cd-4142-872c-9a76a1bc1c6b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:20:15.472758 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 562/1113] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:20:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:15.479220 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc42de9-ae5c-477f-8d3f-734f18e266e1 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:15.491741 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc42de9-ae5c-477f-8d3f-734f18e266e1 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:15.497003 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae59cca-ee5c-4f52-aa71-659d8d1c4381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:15.497656 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae59cca-ee5c-4f52-aa71-659d8d1c4381 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:15.497941 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae59cca-ee5c-4f52-aa71-659d8d1c4381 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:15.498221 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae59cca-ee5c-4f52-aa71-659d8d1c4381 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:15.498993 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae59cca-ee5c-4f52-aa71-659d8d1c4381 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:15.499302 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae59cca-ee5c-4f52-aa71-659d8d1c4381 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:15.501144 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae59cca-ee5c-4f52-aa71-659d8d1c4381 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:15.513812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 552/1114] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:20:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:15.520897 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d91f2-b7cd-4142-872c-9a76a1bc1c6b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:15.533493 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d91f2-b7cd-4142-872c-9a76a1bc1c6b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:15.538897 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd6675-91a7-4d6f-b294-bef0ecf92cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:15.539863 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd6675-91a7-4d6f-b294-bef0ecf92cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:15.540320 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd6675-91a7-4d6f-b294-bef0ecf92cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:15.540740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd6675-91a7-4d6f-b294-bef0ecf92cb8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:15.541770 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd6675-91a7-4d6f-b294-bef0ecf92cb8 admin admin] RBAC: Adding query filter params (role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=9312539f749645d38ed87a0a47e52aa4) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:15.542156 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd6675-91a7-4d6f-b294-bef0ecf92cb8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:15.544911 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd6675-91a7-4d6f-b294-bef0ecf92cb8 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:15.554095 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 563/1115] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:20:15 2021] GET /identity/v3/role_assignments?user.id=9312539f749645d38ed87a0a47e52aa4&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:17.953915 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe1d16-061c-479f-9372-c412100f7ad0 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:17.954485 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe1d16-061c-479f-9372-c412100f7ad0 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:17.954485 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe1d16-061c-479f-9372-c412100f7ad0 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:17.956835 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 553/1116] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:20:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:20:17.965000 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc566770-2bf0-493d-b64f-7a218b8a1589 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:17.965581 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc566770-2bf0-493d-b64f-7a218b8a1589 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:17.965687 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc566770-2bf0-493d-b64f-7a218b8a1589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:17.984377 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-dc566770-2bf0-493d-b64f-7a218b8a1589 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:20:17.985590 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-dc566770-2bf0-493d-b64f-7a218b8a1589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:20:17.993500 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 564/1117] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:20:17 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:20:18.020531 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe1d16-061c-479f-9372-c412100f7ad0 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:18.035532 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe1d16-061c-479f-9372-c412100f7ad0 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:18.040870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37639f11-9289-4c57-8cb8-ee5a9d4296e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:18.041745 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37639f11-9289-4c57-8cb8-ee5a9d4296e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:18.042091 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37639f11-9289-4c57-8cb8-ee5a9d4296e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:18.042437 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37639f11-9289-4c57-8cb8-ee5a9d4296e6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:18.057416 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37639f11-9289-4c57-8cb8-ee5a9d4296e6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:20:18.065409 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-37639f11-9289-4c57-8cb8-ee5a9d4296e6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 02:20:18.066671 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 554/1118] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:20:18 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:18.073675 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc566770-2bf0-493d-b64f-7a218b8a1589 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:18.083571 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc566770-2bf0-493d-b64f-7a218b8a1589 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:18.088475 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba063cf1-79b6-47e6-9b80-970231f3bb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:18.089371 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba063cf1-79b6-47e6-9b80-970231f3bb2e admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:18.089663 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba063cf1-79b6-47e6-9b80-970231f3bb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:18.089938 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba063cf1-79b6-47e6-9b80-970231f3bb2e admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:18.090829 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba063cf1-79b6-47e6-9b80-970231f3bb2e admin admin] RBAC: Adding query filter params (name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:18.091861 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba063cf1-79b6-47e6-9b80-970231f3bb2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:18.093626 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba063cf1-79b6-47e6-9b80-970231f3bb2e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:18.103230 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 565/1119] 10.222.0.32 () {56 vars in 1125 bytes} [Wed Sep 15 02:20:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:18.110245 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37639f11-9289-4c57-8cb8-ee5a9d4296e6 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:18.120979 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37639f11-9289-4c57-8cb8-ee5a9d4296e6 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:18.126274 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214185a1-4812-4dbc-b05a-bda3de75f80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:18.127084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214185a1-4812-4dbc-b05a-bda3de75f80c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:18.127433 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214185a1-4812-4dbc-b05a-bda3de75f80c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:18.127746 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214185a1-4812-4dbc-b05a-bda3de75f80c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:18.140043 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214185a1-4812-4dbc-b05a-bda3de75f80c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:18.142194 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214185a1-4812-4dbc-b05a-bda3de75f80c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:18.160371 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-214185a1-4812-4dbc-b05a-bda3de75f80c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:20:18.161588 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 555/1120] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:20:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:18.168191 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba063cf1-79b6-47e6-9b80-970231f3bb2e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:18.179527 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba063cf1-79b6-47e6-9b80-970231f3bb2e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:18.185568 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf73a03-d2ef-4950-8eda-05e7e1bda4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:18.186297 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf73a03-d2ef-4950-8eda-05e7e1bda4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:18.186648 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf73a03-d2ef-4950-8eda-05e7e1bda4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:18.186936 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf73a03-d2ef-4950-8eda-05e7e1bda4f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:18.187799 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf73a03-d2ef-4950-8eda-05e7e1bda4f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:18.188184 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf73a03-d2ef-4950-8eda-05e7e1bda4f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:18.190095 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf73a03-d2ef-4950-8eda-05e7e1bda4f4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:18.210025 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 566/1121] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:20:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:20:18.211141 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214185a1-4812-4dbc-b05a-bda3de75f80c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:18.222551 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214185a1-4812-4dbc-b05a-bda3de75f80c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:18.227568 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c0f4b-1d55-4954-b3c5-dea26c55af18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:18.228490 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c0f4b-1d55-4954-b3c5-dea26c55af18 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:18.228777 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c0f4b-1d55-4954-b3c5-dea26c55af18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:18.229166 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c0f4b-1d55-4954-b3c5-dea26c55af18 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:18.237791 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c0f4b-1d55-4954-b3c5-dea26c55af18 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:18.239965 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c0f4b-1d55-4954-b3c5-dea26c55af18 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:18.256570 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-aa7c0f4b-1d55-4954-b3c5-dea26c55af18 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 02:20:18.257832 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 556/1122] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:20:18 2021] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:18.265068 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf73a03-d2ef-4950-8eda-05e7e1bda4f4 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:18.275901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf73a03-d2ef-4950-8eda-05e7e1bda4f4 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:18.281544 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3b341-ac8d-4301-9957-11d708e40b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:18.282195 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3b341-ac8d-4301-9957-11d708e40b38 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:18.282482 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3b341-ac8d-4301-9957-11d708e40b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:18.282762 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3b341-ac8d-4301-9957-11d708e40b38 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:18.284189 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3b341-ac8d-4301-9957-11d708e40b38 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:18.284663 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3b341-ac8d-4301-9957-11d708e40b38 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:18.286794 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3b341-ac8d-4301-9957-11d708e40b38 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:18.305815 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 567/1123] 10.222.0.32 () {56 vars in 1165 bytes} [Wed Sep 15 02:20:18 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:18.313272 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c0f4b-1d55-4954-b3c5-dea26c55af18 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:18.323654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c0f4b-1d55-4954-b3c5-dea26c55af18 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:18.329288 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26441b18-120a-4727-8a6e-ec15dfff3638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:18.330145 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26441b18-120a-4727-8a6e-ec15dfff3638 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:18.330471 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26441b18-120a-4727-8a6e-ec15dfff3638 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:18.330787 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26441b18-120a-4727-8a6e-ec15dfff3638 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:18.342378 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26441b18-120a-4727-8a6e-ec15dfff3638 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:18.344523 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26441b18-120a-4727-8a6e-ec15dfff3638 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:18.362399 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-26441b18-120a-4727-8a6e-ec15dfff3638 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:20:18.363693 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 557/1124] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:20:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:18.370762 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3b341-ac8d-4301-9957-11d708e40b38 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:18.380838 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3b341-ac8d-4301-9957-11d708e40b38 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:18.385455 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af13a1-6c0c-4acb-8fea-23c686577a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:18.386107 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af13a1-6c0c-4acb-8fea-23c686577a4f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:18.386384 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af13a1-6c0c-4acb-8fea-23c686577a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:18.386653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af13a1-6c0c-4acb-8fea-23c686577a4f admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:18.387367 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af13a1-6c0c-4acb-8fea-23c686577a4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:18.387673 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af13a1-6c0c-4acb-8fea-23c686577a4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:18.389875 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af13a1-6c0c-4acb-8fea-23c686577a4f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:18.401989 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 568/1125] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:20:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:20:18.408252 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26441b18-120a-4727-8a6e-ec15dfff3638 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:18.418499 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26441b18-120a-4727-8a6e-ec15dfff3638 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:18.423090 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4310e-a1a2-43f6-ac1c-8a29bce2f59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:18.423865 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4310e-a1a2-43f6-ac1c-8a29bce2f59f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:18.424145 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4310e-a1a2-43f6-ac1c-8a29bce2f59f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:18.424411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4310e-a1a2-43f6-ac1c-8a29bce2f59f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:18.431238 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4310e-a1a2-43f6-ac1c-8a29bce2f59f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:18.433179 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4310e-a1a2-43f6-ac1c-8a29bce2f59f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:18.446278 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-d5c4310e-a1a2-43f6-ac1c-8a29bce2f59f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:20:18.447437 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 558/1126] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:20:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:20:18.453998 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af13a1-6c0c-4acb-8fea-23c686577a4f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:18.464478 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af13a1-6c0c-4acb-8fea-23c686577a4f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:18.472638 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41e3e5-02cd-471d-b7cd-311bb20dfa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:18.473364 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41e3e5-02cd-471d-b7cd-311bb20dfa3f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:18.473650 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41e3e5-02cd-471d-b7cd-311bb20dfa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:18.473963 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41e3e5-02cd-471d-b7cd-311bb20dfa3f admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:18.474725 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41e3e5-02cd-471d-b7cd-311bb20dfa3f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:18.475035 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41e3e5-02cd-471d-b7cd-311bb20dfa3f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:18.476914 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41e3e5-02cd-471d-b7cd-311bb20dfa3f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:18.489913 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 569/1127] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:20:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:20:18.496447 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4310e-a1a2-43f6-ac1c-8a29bce2f59f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:18.507077 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4310e-a1a2-43f6-ac1c-8a29bce2f59f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:18.511942 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a7408-6336-488d-9435-c02f24882bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:18.512787 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a7408-6336-488d-9435-c02f24882bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:18.513126 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a7408-6336-488d-9435-c02f24882bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:18.513527 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a7408-6336-488d-9435-c02f24882bf6 admin admin] PATH_INFO: `/v3/projects/083ff2535d794e79a145a076aedeedd4/users/9312539f749645d38ed87a0a47e52aa4/roles/33ed3f5cd26a4ea9a99eb0e09856c1a8` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:18.527666 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a7408-6336-488d-9435-c02f24882bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=083ff2535d794e79a145a076aedeedd4, user_id=9312539f749645d38ed87a0a47e52aa4, role_id=33ed3f5cd26a4ea9a99eb0e09856c1a8)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:18.531073 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a7408-6336-488d-9435-c02f24882bf6 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:18.544803 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 559/1128] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:20:18 2021] PUT /identity/v3/projects/083ff2535d794e79a145a076aedeedd4/users/9312539f749645d38ed87a0a47e52aa4/roles/33ed3f5cd26a4ea9a99eb0e09856c1a8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:20:20.956609 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e75b8e-00bd-44d9-b24a-c9c7c2132504 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:20.957206 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e75b8e-00bd-44d9-b24a-c9c7c2132504 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:20.957206 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e75b8e-00bd-44d9-b24a-c9c7c2132504 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:20.959375 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 570/1129] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:20:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:20:20.969071 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc475ae8-f662-454b-aeba-afdead8f897f None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:20.969548 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc475ae8-f662-454b-aeba-afdead8f897f None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:20.969639 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc475ae8-f662-454b-aeba-afdead8f897f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:20.987898 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-cc475ae8-f662-454b-aeba-afdead8f897f None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:20:20.989196 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-cc475ae8-f662-454b-aeba-afdead8f897f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:20:21.055876 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 560/1130] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:20:20 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:20:21.082792 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e75b8e-00bd-44d9-b24a-c9c7c2132504 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:21.096057 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e75b8e-00bd-44d9-b24a-c9c7c2132504 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:21.100757 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced24fe8-49fb-4f6d-9bd5-dd5ae5c8c0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:21.101569 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced24fe8-49fb-4f6d-9bd5-dd5ae5c8c0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:21.101854 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced24fe8-49fb-4f6d-9bd5-dd5ae5c8c0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:21.102202 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced24fe8-49fb-4f6d-9bd5-dd5ae5c8c0c8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:21.112809 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced24fe8-49fb-4f6d-9bd5-dd5ae5c8c0c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:20:21.119753 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-ced24fe8-49fb-4f6d-9bd5-dd5ae5c8c0c8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 02:20:21.120937 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 571/1131] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Sep 15 02:20:21 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:20:21.127815 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc475ae8-f662-454b-aeba-afdead8f897f None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:21.136659 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc475ae8-f662-454b-aeba-afdead8f897f None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:21.142335 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b7892-4819-4e66-9cae-fb9871491066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:21.143195 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b7892-4819-4e66-9cae-fb9871491066 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:21.143486 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b7892-4819-4e66-9cae-fb9871491066 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:21.143812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b7892-4819-4e66-9cae-fb9871491066 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:21.144678 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b7892-4819-4e66-9cae-fb9871491066 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:21.144982 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b7892-4819-4e66-9cae-fb9871491066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:21.146778 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b7892-4819-4e66-9cae-fb9871491066 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:21.157122 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 561/1132] 10.222.0.32 () {56 vars in 1125 bytes} [Wed Sep 15 02:20:21 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:21.163260 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced24fe8-49fb-4f6d-9bd5-dd5ae5c8c0c8 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:21.176219 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced24fe8-49fb-4f6d-9bd5-dd5ae5c8c0c8 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:21.181479 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74472595-0658-49d7-863a-385961c11f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:21.182233 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74472595-0658-49d7-863a-385961c11f6d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:21.182500 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74472595-0658-49d7-863a-385961c11f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:21.182774 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74472595-0658-49d7-863a-385961c11f6d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:21.193727 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74472595-0658-49d7-863a-385961c11f6d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:21.195599 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74472595-0658-49d7-863a-385961c11f6d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:21.212936 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-74472595-0658-49d7-863a-385961c11f6d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:20:21.214058 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 572/1133] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:20:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:21.221613 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b7892-4819-4e66-9cae-fb9871491066 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:21.231403 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b7892-4819-4e66-9cae-fb9871491066 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:21.236243 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1cc6ea-1907-4d28-bae6-787bd8ae85a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:21.236892 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cc6ea-1907-4d28-bae6-787bd8ae85a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:21.237187 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cc6ea-1907-4d28-bae6-787bd8ae85a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:21.237464 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cc6ea-1907-4d28-bae6-787bd8ae85a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:21.238177 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1cc6ea-1907-4d28-bae6-787bd8ae85a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:21.238491 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1cc6ea-1907-4d28-bae6-787bd8ae85a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:21.240066 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1cc6ea-1907-4d28-bae6-787bd8ae85a2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:21.252363 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 562/1134] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:20:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:21.258486 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74472595-0658-49d7-863a-385961c11f6d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:21.268553 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74472595-0658-49d7-863a-385961c11f6d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:21.273513 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31d8f4-0629-4f8f-bc03-adace77864c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:21.274300 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31d8f4-0629-4f8f-bc03-adace77864c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:21.274585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31d8f4-0629-4f8f-bc03-adace77864c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:21.274862 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31d8f4-0629-4f8f-bc03-adace77864c0 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:21.282899 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31d8f4-0629-4f8f-bc03-adace77864c0 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:21.285330 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31d8f4-0629-4f8f-bc03-adace77864c0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:21.303104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-bf31d8f4-0629-4f8f-bc03-adace77864c0 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 02:20:21.305213 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 573/1135] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:20:21 2021] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:20:21.315143 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1cc6ea-1907-4d28-bae6-787bd8ae85a2 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:21.332152 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1cc6ea-1907-4d28-bae6-787bd8ae85a2 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:21.338702 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616df2b-298f-4b97-8181-cfaf28644f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:21.339986 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616df2b-298f-4b97-8181-cfaf28644f4a admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:21.340384 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616df2b-298f-4b97-8181-cfaf28644f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:21.340696 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616df2b-298f-4b97-8181-cfaf28644f4a admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:21.342164 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616df2b-298f-4b97-8181-cfaf28644f4a admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:21.342733 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616df2b-298f-4b97-8181-cfaf28644f4a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:21.345288 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616df2b-298f-4b97-8181-cfaf28644f4a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:21.368563 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 563/1136] 10.222.0.32 () {56 vars in 1165 bytes} [Wed Sep 15 02:20:21 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:21.375527 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31d8f4-0629-4f8f-bc03-adace77864c0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:21.387043 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31d8f4-0629-4f8f-bc03-adace77864c0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:21.392112 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c415d6-ad89-4cd3-9f23-134b7dfaad40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:21.392755 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c415d6-ad89-4cd3-9f23-134b7dfaad40 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:21.393070 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c415d6-ad89-4cd3-9f23-134b7dfaad40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:21.393348 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c415d6-ad89-4cd3-9f23-134b7dfaad40 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:21.402804 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c415d6-ad89-4cd3-9f23-134b7dfaad40 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:21.404997 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c415d6-ad89-4cd3-9f23-134b7dfaad40 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:21.415803 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 574/1137] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:20:21 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:20:21.423829 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616df2b-298f-4b97-8181-cfaf28644f4a admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:21.435610 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616df2b-298f-4b97-8181-cfaf28644f4a admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:21.441168 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705d01a-e64f-4b9d-ad42-34d15fb8bfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:21.441951 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705d01a-e64f-4b9d-ad42-34d15fb8bfe9 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:21.442432 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705d01a-e64f-4b9d-ad42-34d15fb8bfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:21.442896 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705d01a-e64f-4b9d-ad42-34d15fb8bfe9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:21.456743 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705d01a-e64f-4b9d-ad42-34d15fb8bfe9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:21.459551 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705d01a-e64f-4b9d-ad42-34d15fb8bfe9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:21.481916 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-7705d01a-e64f-4b9d-ad42-34d15fb8bfe9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:20:21.484498 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 564/1138] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:20:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:20:21.492567 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c415d6-ad89-4cd3-9f23-134b7dfaad40 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:21.504132 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c415d6-ad89-4cd3-9f23-134b7dfaad40 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:21.509351 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95359d-2bdc-4ac4-92bc-f746b988c6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:21.510198 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95359d-2bdc-4ac4-92bc-f746b988c6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:21.510533 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95359d-2bdc-4ac4-92bc-f746b988c6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:21.510832 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95359d-2bdc-4ac4-92bc-f746b988c6d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:21.511797 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95359d-2bdc-4ac4-92bc-f746b988c6d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:21.512232 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95359d-2bdc-4ac4-92bc-f746b988c6d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:21.514479 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95359d-2bdc-4ac4-92bc-f746b988c6d9 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:21.527236 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 575/1139] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:20:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:21.533576 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705d01a-e64f-4b9d-ad42-34d15fb8bfe9 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:21.543611 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705d01a-e64f-4b9d-ad42-34d15fb8bfe9 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:21.548232 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b278b9-0ad1-44f9-8d74-4bb5bf606a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:21.549189 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b278b9-0ad1-44f9-8d74-4bb5bf606a68 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:21.549455 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b278b9-0ad1-44f9-8d74-4bb5bf606a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:21.549733 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b278b9-0ad1-44f9-8d74-4bb5bf606a68 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:21.557446 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b278b9-0ad1-44f9-8d74-4bb5bf606a68 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:21.560322 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b278b9-0ad1-44f9-8d74-4bb5bf606a68 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:21.574099 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-19b278b9-0ad1-44f9-8d74-4bb5bf606a68 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:20:21.576122 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 565/1140] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:20:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:21.583074 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95359d-2bdc-4ac4-92bc-f746b988c6d9 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:21.594179 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95359d-2bdc-4ac4-92bc-f746b988c6d9 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:21.599334 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a7285-8050-4709-b5e1-d867f5463e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:21.600020 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a7285-8050-4709-b5e1-d867f5463e0d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:21.600278 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a7285-8050-4709-b5e1-d867f5463e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:21.600548 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a7285-8050-4709-b5e1-d867f5463e0d admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:21.601369 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a7285-8050-4709-b5e1-d867f5463e0d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:21.601678 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a7285-8050-4709-b5e1-d867f5463e0d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:21.603517 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a7285-8050-4709-b5e1-d867f5463e0d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:21.618040 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 576/1141] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:20:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:21.625288 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b278b9-0ad1-44f9-8d74-4bb5bf606a68 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:21.637419 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b278b9-0ad1-44f9-8d74-4bb5bf606a68 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:21.642714 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90695d4a-0c9f-4bd2-a9cb-0406b07c51ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:21.643350 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90695d4a-0c9f-4bd2-a9cb-0406b07c51ce admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:21.643622 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90695d4a-0c9f-4bd2-a9cb-0406b07c51ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:21.643899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90695d4a-0c9f-4bd2-a9cb-0406b07c51ce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:21.644720 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90695d4a-0c9f-4bd2-a9cb-0406b07c51ce admin admin] RBAC: Adding query filter params (role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=9312539f749645d38ed87a0a47e52aa4) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:21.645076 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90695d4a-0c9f-4bd2-a9cb-0406b07c51ce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:21.646888 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90695d4a-0c9f-4bd2-a9cb-0406b07c51ce admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:21.652673 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 566/1142] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:20:21 2021] GET /identity/v3/role_assignments?user.id=9312539f749645d38ed87a0a47e52aa4&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=33ed3f5cd26a4ea9a99eb0e09856c1a8 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:23.849985 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dfb54-05d4-42c8-b46b-ce4d3eb76ce1 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:23.850575 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dfb54-05d4-42c8-b46b-ce4d3eb76ce1 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:23.850822 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718dfb54-05d4-42c8-b46b-ce4d3eb76ce1 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:23.852666 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 577/1143] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:20:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:20:23.861096 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662f5a1-c792-49ed-adb2-e3e467aa4413 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:23.861573 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662f5a1-c792-49ed-adb2-e3e467aa4413 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:23.861715 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662f5a1-c792-49ed-adb2-e3e467aa4413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:23.879220 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-7662f5a1-c792-49ed-adb2-e3e467aa4413 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:20:23.880627 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7662f5a1-c792-49ed-adb2-e3e467aa4413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:20:23.889498 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 567/1144] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:20:23 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:20:23.914477 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dfb54-05d4-42c8-b46b-ce4d3eb76ce1 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:23.926687 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718dfb54-05d4-42c8-b46b-ce4d3eb76ce1 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:23.930995 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3eff8c-9835-4183-bb38-58f8e244698f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:23.931768 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3eff8c-9835-4183-bb38-58f8e244698f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:23.932044 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3eff8c-9835-4183-bb38-58f8e244698f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:23.932311 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3eff8c-9835-4183-bb38-58f8e244698f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:23.942337 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3eff8c-9835-4183-bb38-58f8e244698f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:20:23.948961 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-4b3eff8c-9835-4183-bb38-58f8e244698f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:20:23.957420 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 578/1145] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:20:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:20:23.958614 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662f5a1-c792-49ed-adb2-e3e467aa4413 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:23.969157 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662f5a1-c792-49ed-adb2-e3e467aa4413 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:23.975361 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e8e27-cdbe-4f05-88ee-6fa6e4aad61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:23.976143 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e8e27-cdbe-4f05-88ee-6fa6e4aad61f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:23.976466 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e8e27-cdbe-4f05-88ee-6fa6e4aad61f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:23.976815 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e8e27-cdbe-4f05-88ee-6fa6e4aad61f admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:23.977695 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e8e27-cdbe-4f05-88ee-6fa6e4aad61f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:23.978021 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e8e27-cdbe-4f05-88ee-6fa6e4aad61f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:23.979866 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e8e27-cdbe-4f05-88ee-6fa6e4aad61f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:23.994541 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 568/1146] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:20:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:20:23.995667 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3eff8c-9835-4183-bb38-58f8e244698f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:24.006010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3eff8c-9835-4183-bb38-58f8e244698f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:24.011732 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6dd66c-57b8-4c35-8390-5833e7e67434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:24.013202 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6dd66c-57b8-4c35-8390-5833e7e67434 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:24.013515 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6dd66c-57b8-4c35-8390-5833e7e67434 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:24.013923 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6dd66c-57b8-4c35-8390-5833e7e67434 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:24.025909 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6dd66c-57b8-4c35-8390-5833e7e67434 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:24.028367 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6dd66c-57b8-4c35-8390-5833e7e67434 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:24.048072 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-5b6dd66c-57b8-4c35-8390-5833e7e67434 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:20:24.049553 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 579/1147] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:20:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:20:24.057291 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e8e27-cdbe-4f05-88ee-6fa6e4aad61f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:24.066915 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e8e27-cdbe-4f05-88ee-6fa6e4aad61f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:24.071492 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d83119-8e82-4841-96aa-6003923c3426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:24.072140 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d83119-8e82-4841-96aa-6003923c3426 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:24.072421 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d83119-8e82-4841-96aa-6003923c3426 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:24.072695 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d83119-8e82-4841-96aa-6003923c3426 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:24.073440 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d83119-8e82-4841-96aa-6003923c3426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:24.073746 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d83119-8e82-4841-96aa-6003923c3426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:24.075829 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d83119-8e82-4841-96aa-6003923c3426 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:24.087569 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 569/1148] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:20:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:24.095452 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6dd66c-57b8-4c35-8390-5833e7e67434 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:24.105769 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6dd66c-57b8-4c35-8390-5833e7e67434 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:24.110654 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66038b1-3838-4c2b-a937-f45ee278117a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:24.111443 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66038b1-3838-4c2b-a937-f45ee278117a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:24.111724 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66038b1-3838-4c2b-a937-f45ee278117a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:24.111994 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66038b1-3838-4c2b-a937-f45ee278117a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:24.119890 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66038b1-3838-4c2b-a937-f45ee278117a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:24.121922 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66038b1-3838-4c2b-a937-f45ee278117a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:24.135327 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-c66038b1-3838-4c2b-a937-f45ee278117a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 02:20:24.136493 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 580/1149] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:20:24 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:20:24.143507 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d83119-8e82-4841-96aa-6003923c3426 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:24.153295 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d83119-8e82-4841-96aa-6003923c3426 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:24.158433 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bb370-fc81-45b6-90bc-5c3979786d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:24.159087 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bb370-fc81-45b6-90bc-5c3979786d57 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:24.159364 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bb370-fc81-45b6-90bc-5c3979786d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:24.159648 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bb370-fc81-45b6-90bc-5c3979786d57 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:24.160445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bb370-fc81-45b6-90bc-5c3979786d57 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:24.160744 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bb370-fc81-45b6-90bc-5c3979786d57 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:24.162595 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bb370-fc81-45b6-90bc-5c3979786d57 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:24.180356 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 570/1150] 10.222.0.32 () {56 vars in 1165 bytes} [Wed Sep 15 02:20:24 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:24.188104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66038b1-3838-4c2b-a937-f45ee278117a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:24.204246 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66038b1-3838-4c2b-a937-f45ee278117a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:24.211130 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cc427-2aab-44f1-acc2-e9cfe52e98de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:24.211922 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cc427-2aab-44f1-acc2-e9cfe52e98de admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:24.212596 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cc427-2aab-44f1-acc2-e9cfe52e98de admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:24.213258 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cc427-2aab-44f1-acc2-e9cfe52e98de admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:24.227049 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cc427-2aab-44f1-acc2-e9cfe52e98de admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:24.229441 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cc427-2aab-44f1-acc2-e9cfe52e98de admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:24.241160 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 581/1151] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:20:24 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:20:24.248627 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bb370-fc81-45b6-90bc-5c3979786d57 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:24.258255 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bb370-fc81-45b6-90bc-5c3979786d57 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:24.264962 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc87c5-23cf-42a8-a7ea-4e799195e7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:24.265876 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc87c5-23cf-42a8-a7ea-4e799195e7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:24.266238 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc87c5-23cf-42a8-a7ea-4e799195e7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:24.266514 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc87c5-23cf-42a8-a7ea-4e799195e7d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:24.276835 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc87c5-23cf-42a8-a7ea-4e799195e7d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:24.278663 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc87c5-23cf-42a8-a7ea-4e799195e7d3 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:24.295723 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-e0fc87c5-23cf-42a8-a7ea-4e799195e7d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:20:24.296916 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 571/1152] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:20:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:24.303521 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cc427-2aab-44f1-acc2-e9cfe52e98de admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:24.314862 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cc427-2aab-44f1-acc2-e9cfe52e98de admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:24.321275 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563e552-8c7f-41bb-9abc-8aca73cc04ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:24.322149 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563e552-8c7f-41bb-9abc-8aca73cc04ce admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:24.322559 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563e552-8c7f-41bb-9abc-8aca73cc04ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:24.322911 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563e552-8c7f-41bb-9abc-8aca73cc04ce admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:24.323853 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563e552-8c7f-41bb-9abc-8aca73cc04ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:24.324335 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563e552-8c7f-41bb-9abc-8aca73cc04ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:24.326640 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563e552-8c7f-41bb-9abc-8aca73cc04ce admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:24.339471 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 582/1153] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:20:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:20:24.346374 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc87c5-23cf-42a8-a7ea-4e799195e7d3 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:24.355965 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc87c5-23cf-42a8-a7ea-4e799195e7d3 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:24.364207 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302ddf7-4292-4bc8-b2a5-56177705f3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:24.365028 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302ddf7-4292-4bc8-b2a5-56177705f3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:24.365308 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302ddf7-4292-4bc8-b2a5-56177705f3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:24.365563 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302ddf7-4292-4bc8-b2a5-56177705f3c9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:24.373089 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302ddf7-4292-4bc8-b2a5-56177705f3c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:24.375019 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302ddf7-4292-4bc8-b2a5-56177705f3c9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:24.389177 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-f302ddf7-4292-4bc8-b2a5-56177705f3c9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:20:24.390377 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 572/1154] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:20:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:24.397299 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563e552-8c7f-41bb-9abc-8aca73cc04ce admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:24.407731 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563e552-8c7f-41bb-9abc-8aca73cc04ce admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:24.413793 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec015bcf-6fc8-4eb9-baf6-51469d93ac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:24.414794 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec015bcf-6fc8-4eb9-baf6-51469d93ac51 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:24.415106 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec015bcf-6fc8-4eb9-baf6-51469d93ac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:24.415501 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec015bcf-6fc8-4eb9-baf6-51469d93ac51 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:24.416464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec015bcf-6fc8-4eb9-baf6-51469d93ac51 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:24.416771 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec015bcf-6fc8-4eb9-baf6-51469d93ac51 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:24.419906 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec015bcf-6fc8-4eb9-baf6-51469d93ac51 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:24.433200 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 583/1155] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:20:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:20:24.441460 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302ddf7-4292-4bc8-b2a5-56177705f3c9 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:24.452203 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302ddf7-4292-4bc8-b2a5-56177705f3c9 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:24.457804 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50495f91-f164-4247-a729-b67aae50c03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:24.458443 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50495f91-f164-4247-a729-b67aae50c03b admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:24.458718 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50495f91-f164-4247-a729-b67aae50c03b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:24.458987 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50495f91-f164-4247-a729-b67aae50c03b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:24.459814 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50495f91-f164-4247-a729-b67aae50c03b admin admin] RBAC: Adding query filter params (role.id=19308d3515f546e9a04e44ae278cd111, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=9312539f749645d38ed87a0a47e52aa4) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:24.460120 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50495f91-f164-4247-a729-b67aae50c03b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:24.462517 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50495f91-f164-4247-a729-b67aae50c03b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:24.471132 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 573/1156] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:20:24 2021] GET /identity/v3/role_assignments?user.id=9312539f749645d38ed87a0a47e52aa4&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=19308d3515f546e9a04e44ae278cd111 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:26.716556 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5256d-2cff-4143-9b60-ebf951b5de48 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:26.717141 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5256d-2cff-4143-9b60-ebf951b5de48 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:26.717141 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5256d-2cff-4143-9b60-ebf951b5de48 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:26.719164 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 584/1157] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:20:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:20:26.726644 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ecfb8-9d6c-4626-a0a1-6bc7e330d75f None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:26.727099 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ecfb8-9d6c-4626-a0a1-6bc7e330d75f None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:26.727215 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ecfb8-9d6c-4626-a0a1-6bc7e330d75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:26.746548 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-c12ecfb8-9d6c-4626-a0a1-6bc7e330d75f None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:20:26.747757 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c12ecfb8-9d6c-4626-a0a1-6bc7e330d75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:20:26.756354 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 574/1158] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:20:26 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:20:26.782309 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5256d-2cff-4143-9b60-ebf951b5de48 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:26.797150 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5256d-2cff-4143-9b60-ebf951b5de48 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:26.801832 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d18a3-6969-4106-b308-e9f7044f7512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:26.802702 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d18a3-6969-4106-b308-e9f7044f7512 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:26.803020 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d18a3-6969-4106-b308-e9f7044f7512 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:26.803295 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d18a3-6969-4106-b308-e9f7044f7512 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:26.813980 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d18a3-6969-4106-b308-e9f7044f7512 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:20:26.820718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-b77d18a3-6969-4106-b308-e9f7044f7512 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:20:26.821921 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 585/1159] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:20:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:26.828535 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ecfb8-9d6c-4626-a0a1-6bc7e330d75f None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:26.837484 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ecfb8-9d6c-4626-a0a1-6bc7e330d75f None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:26.842614 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7268f50-fc4b-4dd3-ac3c-585cbb6e5c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:26.843266 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7268f50-fc4b-4dd3-ac3c-585cbb6e5c54 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:26.843562 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7268f50-fc4b-4dd3-ac3c-585cbb6e5c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:26.843817 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7268f50-fc4b-4dd3-ac3c-585cbb6e5c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:26.844546 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7268f50-fc4b-4dd3-ac3c-585cbb6e5c54 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:26.844860 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7268f50-fc4b-4dd3-ac3c-585cbb6e5c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:26.846452 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7268f50-fc4b-4dd3-ac3c-585cbb6e5c54 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:26.854678 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 575/1160] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:20:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:20:26.862054 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d18a3-6969-4106-b308-e9f7044f7512 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:26.872976 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d18a3-6969-4106-b308-e9f7044f7512 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:26.878217 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec48c1e-c2a3-4670-99ee-f204098220fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:26.879082 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec48c1e-c2a3-4670-99ee-f204098220fe admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:26.879381 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec48c1e-c2a3-4670-99ee-f204098220fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:26.879678 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec48c1e-c2a3-4670-99ee-f204098220fe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:26.891223 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec48c1e-c2a3-4670-99ee-f204098220fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:26.893211 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec48c1e-c2a3-4670-99ee-f204098220fe admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:26.910692 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-4ec48c1e-c2a3-4670-99ee-f204098220fe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:20:26.911857 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 586/1161] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:20:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:26.918722 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7268f50-fc4b-4dd3-ac3c-585cbb6e5c54 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:26.928539 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7268f50-fc4b-4dd3-ac3c-585cbb6e5c54 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:26.933280 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba6fb1-0f55-4b19-ad2a-993c8ffddfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:26.933926 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba6fb1-0f55-4b19-ad2a-993c8ffddfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:26.934207 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba6fb1-0f55-4b19-ad2a-993c8ffddfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:26.934520 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba6fb1-0f55-4b19-ad2a-993c8ffddfa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:26.935223 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba6fb1-0f55-4b19-ad2a-993c8ffddfa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:26.935539 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba6fb1-0f55-4b19-ad2a-993c8ffddfa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:26.937133 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba6fb1-0f55-4b19-ad2a-993c8ffddfa2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:26.948841 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 576/1162] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:20:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:26.955710 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec48c1e-c2a3-4670-99ee-f204098220fe admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:26.966707 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec48c1e-c2a3-4670-99ee-f204098220fe admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:26.971962 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9edb4f-5099-487e-abfd-ff6fcc6a2f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:26.972840 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9edb4f-5099-487e-abfd-ff6fcc6a2f7a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:26.973160 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9edb4f-5099-487e-abfd-ff6fcc6a2f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:26.973436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9edb4f-5099-487e-abfd-ff6fcc6a2f7a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:26.981417 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9edb4f-5099-487e-abfd-ff6fcc6a2f7a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:26.983858 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9edb4f-5099-487e-abfd-ff6fcc6a2f7a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:26.999249 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-1f9edb4f-5099-487e-abfd-ff6fcc6a2f7a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 02:20:27.000366 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 587/1163] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:20:26 2021] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:20:27.007396 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba6fb1-0f55-4b19-ad2a-993c8ffddfa2 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:27.017684 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba6fb1-0f55-4b19-ad2a-993c8ffddfa2 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:27.022326 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cd070-9042-44fa-867a-70ecc74bc174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:27.022985 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cd070-9042-44fa-867a-70ecc74bc174 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:27.023267 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cd070-9042-44fa-867a-70ecc74bc174 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:27.023537 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cd070-9042-44fa-867a-70ecc74bc174 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:27.024365 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cd070-9042-44fa-867a-70ecc74bc174 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:27.024706 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cd070-9042-44fa-867a-70ecc74bc174 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:27.026541 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cd070-9042-44fa-867a-70ecc74bc174 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:27.045202 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 577/1164] 10.222.0.32 () {56 vars in 1165 bytes} [Wed Sep 15 02:20:27 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:27.051516 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9edb4f-5099-487e-abfd-ff6fcc6a2f7a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:27.061275 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9edb4f-5099-487e-abfd-ff6fcc6a2f7a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:27.066131 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15540285-bfa0-49e1-9cb5-854138e847a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:27.066906 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15540285-bfa0-49e1-9cb5-854138e847a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:27.068491 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15540285-bfa0-49e1-9cb5-854138e847a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:27.068491 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15540285-bfa0-49e1-9cb5-854138e847a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:27.078185 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15540285-bfa0-49e1-9cb5-854138e847a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:27.080008 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15540285-bfa0-49e1-9cb5-854138e847a0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:27.097154 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-15540285-bfa0-49e1-9cb5-854138e847a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:20:27.098319 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 588/1165] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:20:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:20:27.104763 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cd070-9042-44fa-867a-70ecc74bc174 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:27.114687 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cd070-9042-44fa-867a-70ecc74bc174 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:27.119381 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49737f0d-96a1-430b-b281-b45d17938e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:27.120034 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49737f0d-96a1-430b-b281-b45d17938e1e admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:27.120315 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49737f0d-96a1-430b-b281-b45d17938e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:27.120593 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49737f0d-96a1-430b-b281-b45d17938e1e admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:27.121348 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49737f0d-96a1-430b-b281-b45d17938e1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:27.121657 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49737f0d-96a1-430b-b281-b45d17938e1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:27.123254 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49737f0d-96a1-430b-b281-b45d17938e1e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:27.134836 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 578/1166] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:20:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:27.142104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15540285-bfa0-49e1-9cb5-854138e847a0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:27.152240 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15540285-bfa0-49e1-9cb5-854138e847a0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:27.157336 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ec79a-fa66-457f-b2ac-130845b67b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:27.159071 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ec79a-fa66-457f-b2ac-130845b67b20 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:27.159071 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ec79a-fa66-457f-b2ac-130845b67b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:27.159071 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ec79a-fa66-457f-b2ac-130845b67b20 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:27.166554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ec79a-fa66-457f-b2ac-130845b67b20 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:27.169293 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ec79a-fa66-457f-b2ac-130845b67b20 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:27.184430 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-782ec79a-fa66-457f-b2ac-130845b67b20 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:20:27.186232 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 589/1167] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:20:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 02:20:27.194091 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49737f0d-96a1-430b-b281-b45d17938e1e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:27.204356 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49737f0d-96a1-430b-b281-b45d17938e1e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:27.209769 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a741ca-1961-439b-bc0a-ae5f64792448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:27.210424 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a741ca-1961-439b-bc0a-ae5f64792448 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:27.210704 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a741ca-1961-439b-bc0a-ae5f64792448 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:27.210981 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a741ca-1961-439b-bc0a-ae5f64792448 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:27.211767 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a741ca-1961-439b-bc0a-ae5f64792448 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:27.212070 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a741ca-1961-439b-bc0a-ae5f64792448 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:27.213963 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a741ca-1961-439b-bc0a-ae5f64792448 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:27.227099 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 579/1168] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:20:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:27.234519 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ec79a-fa66-457f-b2ac-130845b67b20 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:27.245204 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ec79a-fa66-457f-b2ac-130845b67b20 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:27.250159 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a9901-2d7b-42b7-a1e8-d09a4bbeedae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:27.251028 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a9901-2d7b-42b7-a1e8-d09a4bbeedae admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:27.251310 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a9901-2d7b-42b7-a1e8-d09a4bbeedae admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:27.251582 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a9901-2d7b-42b7-a1e8-d09a4bbeedae admin admin] PATH_INFO: `/v3/projects/083ff2535d794e79a145a076aedeedd4/users/9312539f749645d38ed87a0a47e52aa4/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:27.253667 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a9901-2d7b-42b7-a1e8-d09a4bbeedae admin admin] RBAC: Authorizing `identity:create_grant(project_id=083ff2535d794e79a145a076aedeedd4, user_id=9312539f749645d38ed87a0a47e52aa4, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:27.256299 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a9901-2d7b-42b7-a1e8-d09a4bbeedae admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:27.269432 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 590/1169] 10.222.0.32 () {58 vars in 1461 bytes} [Wed Sep 15 02:20:27 2021] PUT /identity/v3/projects/083ff2535d794e79a145a076aedeedd4/users/9312539f749645d38ed87a0a47e52aa4/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:20:29.486640 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb34cb-483d-463c-959f-f4f4c0c2db73 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:29.487112 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb34cb-483d-463c-959f-f4f4c0c2db73 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:29.487207 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb34cb-483d-463c-959f-f4f4c0c2db73 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:29.488998 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 580/1170] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:20:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:20:29.496090 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d4a88-2901-4991-b0dd-0c939e1802bc None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:29.496499 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d4a88-2901-4991-b0dd-0c939e1802bc None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:29.496645 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d4a88-2901-4991-b0dd-0c939e1802bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:29.514428 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-bf4d4a88-2901-4991-b0dd-0c939e1802bc None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:20:29.515591 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-bf4d4a88-2901-4991-b0dd-0c939e1802bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:20:29.568572 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 591/1171] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:20:29 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:20:29.592749 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb34cb-483d-463c-959f-f4f4c0c2db73 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:29.604542 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb34cb-483d-463c-959f-f4f4c0c2db73 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:29.609218 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05287b34-2408-45bd-9ae1-da754e30b0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:29.609990 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05287b34-2408-45bd-9ae1-da754e30b0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:29.610271 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05287b34-2408-45bd-9ae1-da754e30b0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:29.610547 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05287b34-2408-45bd-9ae1-da754e30b0e6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:29.620244 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05287b34-2408-45bd-9ae1-da754e30b0e6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 02:20:29.627519 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-05287b34-2408-45bd-9ae1-da754e30b0e6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 02:20:29.628639 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 581/1172] 10.222.0.32 () {56 vars in 1118 bytes} [Wed Sep 15 02:20:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:29.634595 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d4a88-2901-4991-b0dd-0c939e1802bc None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:29.643706 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d4a88-2901-4991-b0dd-0c939e1802bc None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:29.648154 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63f574-95ef-45d8-9456-db63e391cd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:29.648797 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63f574-95ef-45d8-9456-db63e391cd1f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:29.649109 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63f574-95ef-45d8-9456-db63e391cd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:29.649385 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63f574-95ef-45d8-9456-db63e391cd1f admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:29.650119 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63f574-95ef-45d8-9456-db63e391cd1f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:29.650428 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63f574-95ef-45d8-9456-db63e391cd1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:29.652001 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63f574-95ef-45d8-9456-db63e391cd1f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:29.659806 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 592/1173] 10.222.0.32 () {56 vars in 1121 bytes} [Wed Sep 15 02:20:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:29.665565 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05287b34-2408-45bd-9ae1-da754e30b0e6 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:29.675119 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05287b34-2408-45bd-9ae1-da754e30b0e6 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:29.679593 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827fe54-8624-4ac4-830e-6925db06d02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:29.680316 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827fe54-8624-4ac4-830e-6925db06d02c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:29.680597 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827fe54-8624-4ac4-830e-6925db06d02c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:29.680872 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827fe54-8624-4ac4-830e-6925db06d02c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:29.691177 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827fe54-8624-4ac4-830e-6925db06d02c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:29.692991 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827fe54-8624-4ac4-830e-6925db06d02c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:29.709515 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-7827fe54-8624-4ac4-830e-6925db06d02c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:20:29.710599 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 582/1174] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:20:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:29.716528 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63f574-95ef-45d8-9456-db63e391cd1f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:29.725562 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63f574-95ef-45d8-9456-db63e391cd1f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:29.729992 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc4512-404d-4a7b-ac1c-9492f6eaea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:29.730587 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc4512-404d-4a7b-ac1c-9492f6eaea7d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:29.730864 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc4512-404d-4a7b-ac1c-9492f6eaea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:29.731156 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc4512-404d-4a7b-ac1c-9492f6eaea7d admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:29.731853 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc4512-404d-4a7b-ac1c-9492f6eaea7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:29.732153 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc4512-404d-4a7b-ac1c-9492f6eaea7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:29.734005 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc4512-404d-4a7b-ac1c-9492f6eaea7d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:29.745385 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 593/1175] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:20:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:29.751475 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827fe54-8624-4ac4-830e-6925db06d02c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:29.760637 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827fe54-8624-4ac4-830e-6925db06d02c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:29.765773 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d44a5e-36d9-4507-808d-d02b83094c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:29.766522 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d44a5e-36d9-4507-808d-d02b83094c61 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:29.766805 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d44a5e-36d9-4507-808d-d02b83094c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:29.767077 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d44a5e-36d9-4507-808d-d02b83094c61 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:29.774033 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d44a5e-36d9-4507-808d-d02b83094c61 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:29.775983 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d44a5e-36d9-4507-808d-d02b83094c61 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:29.789331 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-d3d44a5e-36d9-4507-808d-d02b83094c61 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 02:20:29.790427 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 583/1176] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:20:29 2021] GET /identity/v3/users/placement => generated 87 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:29.796088 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc4512-404d-4a7b-ac1c-9492f6eaea7d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:29.805292 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc4512-404d-4a7b-ac1c-9492f6eaea7d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:29.810300 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad6de2-2727-4b7c-bfd8-f511f028c20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:29.810925 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad6de2-2727-4b7c-bfd8-f511f028c20d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:29.811203 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad6de2-2727-4b7c-bfd8-f511f028c20d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:29.811474 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad6de2-2727-4b7c-bfd8-f511f028c20d admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:29.812285 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad6de2-2727-4b7c-bfd8-f511f028c20d admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:29.812588 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad6de2-2727-4b7c-bfd8-f511f028c20d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:29.814421 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad6de2-2727-4b7c-bfd8-f511f028c20d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:29.831155 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 594/1177] 10.222.0.32 () {56 vars in 1165 bytes} [Wed Sep 15 02:20:29 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:20:29.836757 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d44a5e-36d9-4507-808d-d02b83094c61 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:29.845859 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d44a5e-36d9-4507-808d-d02b83094c61 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:29.850285 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6074851-6f22-4d57-8dcf-5ae6cea5f663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:29.850882 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6074851-6f22-4d57-8dcf-5ae6cea5f663 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:29.851161 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6074851-6f22-4d57-8dcf-5ae6cea5f663 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:29.851435 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6074851-6f22-4d57-8dcf-5ae6cea5f663 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:29.859660 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6074851-6f22-4d57-8dcf-5ae6cea5f663 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:29.861371 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6074851-6f22-4d57-8dcf-5ae6cea5f663 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:29.870003 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 584/1178] 10.222.0.32 () {58 vars in 1325 bytes} [Wed Sep 15 02:20:29 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:20:29.876181 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad6de2-2727-4b7c-bfd8-f511f028c20d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:29.885199 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad6de2-2727-4b7c-bfd8-f511f028c20d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:29.889696 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69839ea8-01c5-40ca-ad0f-155b73e2825d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:29.890435 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69839ea8-01c5-40ca-ad0f-155b73e2825d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:29.890712 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69839ea8-01c5-40ca-ad0f-155b73e2825d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:29.890986 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69839ea8-01c5-40ca-ad0f-155b73e2825d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:29.900596 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69839ea8-01c5-40ca-ad0f-155b73e2825d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:29.902466 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69839ea8-01c5-40ca-ad0f-155b73e2825d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:29.919583 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-69839ea8-01c5-40ca-ad0f-155b73e2825d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 02:20:29.920666 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 595/1179] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Sep 15 02:20:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:29.926484 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6074851-6f22-4d57-8dcf-5ae6cea5f663 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:29.935559 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6074851-6f22-4d57-8dcf-5ae6cea5f663 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:29.940004 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50130b0-a484-4a03-831e-87f0c6009267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:29.940618 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50130b0-a484-4a03-831e-87f0c6009267 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:29.940917 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50130b0-a484-4a03-831e-87f0c6009267 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:29.941194 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50130b0-a484-4a03-831e-87f0c6009267 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:29.941888 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50130b0-a484-4a03-831e-87f0c6009267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:29.942191 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50130b0-a484-4a03-831e-87f0c6009267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:29.943705 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50130b0-a484-4a03-831e-87f0c6009267 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:29.954412 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 585/1180] 10.222.0.32 () {56 vars in 1131 bytes} [Wed Sep 15 02:20:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:29.959999 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69839ea8-01c5-40ca-ad0f-155b73e2825d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:29.969407 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69839ea8-01c5-40ca-ad0f-155b73e2825d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:29.973911 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d927ee-c2b5-47d1-b8ee-540dc2ab3830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:29.974657 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d927ee-c2b5-47d1-b8ee-540dc2ab3830 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:29.974936 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d927ee-c2b5-47d1-b8ee-540dc2ab3830 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:29.975207 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d927ee-c2b5-47d1-b8ee-540dc2ab3830 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:29.982318 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d927ee-c2b5-47d1-b8ee-540dc2ab3830 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:29.984446 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d927ee-c2b5-47d1-b8ee-540dc2ab3830 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:29.997498 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING keystone.server.flask.application [None req-25d927ee-c2b5-47d1-b8ee-540dc2ab3830 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 02:20:29.998599 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 596/1181] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Sep 15 02:20:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:30.004443 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50130b0-a484-4a03-831e-87f0c6009267 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:30.013584 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50130b0-a484-4a03-831e-87f0c6009267 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:30.018067 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213d51e-2f15-42cd-989b-ceaa7dc8c642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:30.018690 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213d51e-2f15-42cd-989b-ceaa7dc8c642 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:30.018972 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213d51e-2f15-42cd-989b-ceaa7dc8c642 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:30.019250 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213d51e-2f15-42cd-989b-ceaa7dc8c642 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:30.020020 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213d51e-2f15-42cd-989b-ceaa7dc8c642 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:30.020330 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213d51e-2f15-42cd-989b-ceaa7dc8c642 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:30.022162 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213d51e-2f15-42cd-989b-ceaa7dc8c642 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:30.033836 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 586/1182] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Sep 15 02:20:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:30.039753 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d927ee-c2b5-47d1-b8ee-540dc2ab3830 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:30.050088 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d927ee-c2b5-47d1-b8ee-540dc2ab3830 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:30.054710 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57421b8a-ad89-4a1f-b26d-be1e324047c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:30.055325 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57421b8a-ad89-4a1f-b26d-be1e324047c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:30.055603 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57421b8a-ad89-4a1f-b26d-be1e324047c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:30.055876 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57421b8a-ad89-4a1f-b26d-be1e324047c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:30.056688 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57421b8a-ad89-4a1f-b26d-be1e324047c7 admin admin] RBAC: Adding query filter params (role.id=19308d3515f546e9a04e44ae278cd111, scope.project.id=083ff2535d794e79a145a076aedeedd4, user.id=9312539f749645d38ed87a0a47e52aa4) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:30.057030 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57421b8a-ad89-4a1f-b26d-be1e324047c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:30.058822 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57421b8a-ad89-4a1f-b26d-be1e324047c7 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:30.064995 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 597/1183] 10.222.0.32 () {56 vars in 1396 bytes} [Wed Sep 15 02:20:30 2021] GET /identity/v3/role_assignments?user.id=9312539f749645d38ed87a0a47e52aa4&scope.project.id=083ff2535d794e79a145a076aedeedd4&role.id=19308d3515f546e9a04e44ae278cd111 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:32.226681 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18845271-a097-4fd4-b703-0675cb389504 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:32.227231 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18845271-a097-4fd4-b703-0675cb389504 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:32.227447 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18845271-a097-4fd4-b703-0675cb389504 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:32.229477 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 587/1184] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:20:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:20:32.237709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1163a71-697b-4b98-aa20-5a63cda2f33a None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:32.238129 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1163a71-697b-4b98-aa20-5a63cda2f33a None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:32.238250 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1163a71-697b-4b98-aa20-5a63cda2f33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:32.255431 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-c1163a71-697b-4b98-aa20-5a63cda2f33a None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:20:32.256600 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-c1163a71-697b-4b98-aa20-5a63cda2f33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:20:32.264837 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 598/1185] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:20:32 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:20:32.288074 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18845271-a097-4fd4-b703-0675cb389504 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:32.299801 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18845271-a097-4fd4-b703-0675cb389504 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:32.304310 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76844a1d-624c-44ca-9482-2edf4267f4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:32.305126 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76844a1d-624c-44ca-9482-2edf4267f4cc admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:32.305412 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76844a1d-624c-44ca-9482-2edf4267f4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:32.305688 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76844a1d-624c-44ca-9482-2edf4267f4cc admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:32.306332 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76844a1d-624c-44ca-9482-2edf4267f4cc admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:32.307890 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76844a1d-624c-44ca-9482-2edf4267f4cc admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:32.318649 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-76844a1d-624c-44ca-9482-2edf4267f4cc admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 02:20:32.319750 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 588/1186] 10.222.0.32 () {56 vars in 1139 bytes} [Wed Sep 15 02:20:32 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:32.326224 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1163a71-697b-4b98-aa20-5a63cda2f33a None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:32.334747 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1163a71-697b-4b98-aa20-5a63cda2f33a None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:32.339203 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12a00e-f720-4203-a6d4-0ffb76798684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:32.339838 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12a00e-f720-4203-a6d4-0ffb76798684 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:32.340116 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12a00e-f720-4203-a6d4-0ffb76798684 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:32.341014 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12a00e-f720-4203-a6d4-0ffb76798684 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:32.341738 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12a00e-f720-4203-a6d4-0ffb76798684 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:32.342041 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12a00e-f720-4203-a6d4-0ffb76798684 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:32.343606 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12a00e-f720-4203-a6d4-0ffb76798684 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:32.348167 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 599/1187] 10.222.0.32 () {56 vars in 1138 bytes} [Wed Sep 15 02:20:32 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:20:32.353929 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76844a1d-624c-44ca-9482-2edf4267f4cc admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:32.363239 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76844a1d-624c-44ca-9482-2edf4267f4cc admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:32.367672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381912da-4b71-4285-b00e-363d6adf0ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:32.368279 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381912da-4b71-4285-b00e-363d6adf0ede admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:32.368561 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381912da-4b71-4285-b00e-363d6adf0ede admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:32.368839 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381912da-4b71-4285-b00e-363d6adf0ede admin admin] PATH_INFO: `/v3/services` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:32.369556 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381912da-4b71-4285-b00e-363d6adf0ede admin admin] RBAC: Adding query filter params (type=placement) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:32.369862 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381912da-4b71-4285-b00e-363d6adf0ede admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:32.371376 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381912da-4b71-4285-b00e-363d6adf0ede admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:32.375559 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 589/1188] 10.222.0.32 () {56 vars in 1138 bytes} [Wed Sep 15 02:20:32 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:34.491709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8137e-f601-4dab-94c6-14d71264440f None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:34.492144 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8137e-f601-4dab-94c6-14d71264440f None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:34.492271 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8137e-f601-4dab-94c6-14d71264440f None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:34.494091 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 600/1189] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:20:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:20:34.501748 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4aaab-6dce-4fff-b67e-b1dc335a7052 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:34.502144 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4aaab-6dce-4fff-b67e-b1dc335a7052 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:34.502330 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4aaab-6dce-4fff-b67e-b1dc335a7052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:34.519454 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-bfa4aaab-6dce-4fff-b67e-b1dc335a7052 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:20:34.520621 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-bfa4aaab-6dce-4fff-b67e-b1dc335a7052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:20:34.528150 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 590/1190] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:20:34 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:20:34.551656 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8137e-f601-4dab-94c6-14d71264440f None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:34.564084 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8137e-f601-4dab-94c6-14d71264440f None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:34.568526 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d73319-10c6-4279-950b-657302ee296a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:34.569193 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d73319-10c6-4279-950b-657302ee296a admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:34.569474 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d73319-10c6-4279-950b-657302ee296a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:34.569748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d73319-10c6-4279-950b-657302ee296a admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:34.570462 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d73319-10c6-4279-950b-657302ee296a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:34.572034 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d73319-10c6-4279-950b-657302ee296a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:34.584958 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 601/1191] 10.222.0.32 () {60 vars in 1163 bytes} [Wed Sep 15 02:20:34 2021] POST /identity/v3/services => generated 246 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:20:36.734979 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ba361-7c42-4f77-859e-a2d61312725e None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:36.735503 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ba361-7c42-4f77-859e-a2d61312725e None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:36.735503 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ba361-7c42-4f77-859e-a2d61312725e None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:36.737237 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 591/1192] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:20:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:20:36.744198 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda14766-2163-4f13-af31-ec4f841fc4ac None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:36.744575 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda14766-2163-4f13-af31-ec4f841fc4ac None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:36.744745 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda14766-2163-4f13-af31-ec4f841fc4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:36.762306 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-dda14766-2163-4f13-af31-ec4f841fc4ac None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:20:36.763475 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-dda14766-2163-4f13-af31-ec4f841fc4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:20:36.779353 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 602/1193] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:20:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:20:36.802843 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ba361-7c42-4f77-859e-a2d61312725e None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:36.815170 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ba361-7c42-4f77-859e-a2d61312725e None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:36.819461 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9ece0-7721-4c6f-bfb6-fb3687d8da3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:36.820234 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9ece0-7721-4c6f-bfb6-fb3687d8da3e admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:36.820514 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9ece0-7721-4c6f-bfb6-fb3687d8da3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:36.820790 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9ece0-7721-4c6f-bfb6-fb3687d8da3e admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:36.821463 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9ece0-7721-4c6f-bfb6-fb3687d8da3e admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:36.823027 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9ece0-7721-4c6f-bfb6-fb3687d8da3e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:36.833709 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-8ce9ece0-7721-4c6f-bfb6-fb3687d8da3e admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 02:20:36.834801 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 592/1194] 10.222.0.32 () {56 vars in 1139 bytes} [Wed Sep 15 02:20:36 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:36.840947 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda14766-2163-4f13-af31-ec4f841fc4ac None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:36.849378 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda14766-2163-4f13-af31-ec4f841fc4ac None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:36.853801 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9df5b7-ffd2-4b9e-a630-67252e3d29b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:36.854430 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9df5b7-ffd2-4b9e-a630-67252e3d29b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:36.854706 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9df5b7-ffd2-4b9e-a630-67252e3d29b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:36.854979 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9df5b7-ffd2-4b9e-a630-67252e3d29b4 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:36.855671 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9df5b7-ffd2-4b9e-a630-67252e3d29b4 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:36.856479 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9df5b7-ffd2-4b9e-a630-67252e3d29b4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:36.858348 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9df5b7-ffd2-4b9e-a630-67252e3d29b4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:36.863194 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 603/1195] 10.222.0.32 () {56 vars in 1138 bytes} [Wed Sep 15 02:20:36 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:36.869084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9ece0-7721-4c6f-bfb6-fb3687d8da3e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:36.878792 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9ece0-7721-4c6f-bfb6-fb3687d8da3e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:36.883198 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fe196-2250-47db-960e-3466c58ea092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:36.883803 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fe196-2250-47db-960e-3466c58ea092 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:36.884081 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fe196-2250-47db-960e-3466c58ea092 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:36.884347 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fe196-2250-47db-960e-3466c58ea092 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:36.885146 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fe196-2250-47db-960e-3466c58ea092 admin admin] RBAC: Adding query filter params (interface=public, service_id=4f571d215c054b098e58f641016e0a69, region_id=RegionOne) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:36.885448 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fe196-2250-47db-960e-3466c58ea092 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:36.886974 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fe196-2250-47db-960e-3466c58ea092 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:36.891756 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 593/1196] 10.222.0.32 () {56 vars in 1273 bytes} [Wed Sep 15 02:20:36 2021] GET /identity/v3/endpoints?service_id=4f571d215c054b098e58f641016e0a69&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:36.897236 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9df5b7-ffd2-4b9e-a630-67252e3d29b4 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:36.906130 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9df5b7-ffd2-4b9e-a630-67252e3d29b4 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:36.910506 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e69383-3d66-4c90-9ab1-55f53d8f31e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:36.911104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e69383-3d66-4c90-9ab1-55f53d8f31e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:36.911379 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e69383-3d66-4c90-9ab1-55f53d8f31e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:36.911648 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e69383-3d66-4c90-9ab1-55f53d8f31e0 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:36.912295 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e69383-3d66-4c90-9ab1-55f53d8f31e0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:36.913827 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e69383-3d66-4c90-9ab1-55f53d8f31e0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:36.920733 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 604/1197] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Sep 15 02:20:36 2021] GET /identity/v3/services => generated 2191 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:20:39.036597 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae046c-e75d-41ff-a758-a54ab378b575 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:39.037165 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae046c-e75d-41ff-a758-a54ab378b575 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:39.037165 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae046c-e75d-41ff-a758-a54ab378b575 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:39.038912 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 594/1198] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:20:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:20:39.045839 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4246609-59e7-4619-a7ad-93f5313e1f63 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:39.046277 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4246609-59e7-4619-a7ad-93f5313e1f63 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:39.046368 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4246609-59e7-4619-a7ad-93f5313e1f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:39.063284 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-b4246609-59e7-4619-a7ad-93f5313e1f63 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:20:39.064443 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b4246609-59e7-4619-a7ad-93f5313e1f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:20:39.071888 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 605/1199] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:20:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:20:39.096124 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae046c-e75d-41ff-a758-a54ab378b575 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:39.108170 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae046c-e75d-41ff-a758-a54ab378b575 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:39.112461 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620c398-6b0d-4194-92d8-13333b83cf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:39.113258 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620c398-6b0d-4194-92d8-13333b83cf54 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:39.113542 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620c398-6b0d-4194-92d8-13333b83cf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:39.113812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620c398-6b0d-4194-92d8-13333b83cf54 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:39.114452 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620c398-6b0d-4194-92d8-13333b83cf54 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:39.115994 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620c398-6b0d-4194-92d8-13333b83cf54 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:39.126483 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-9620c398-6b0d-4194-92d8-13333b83cf54 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 02:20:39.127568 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 595/1200] 10.222.0.32 () {56 vars in 1139 bytes} [Wed Sep 15 02:20:39 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 02:20:39.133485 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4246609-59e7-4619-a7ad-93f5313e1f63 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:39.142472 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4246609-59e7-4619-a7ad-93f5313e1f63 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:39.146937 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0695f0f-8a27-4c1d-8182-cd817d69cf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:39.147566 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0695f0f-8a27-4c1d-8182-cd817d69cf19 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:39.147843 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0695f0f-8a27-4c1d-8182-cd817d69cf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:39.148114 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0695f0f-8a27-4c1d-8182-cd817d69cf19 admin admin] PATH_INFO: `/v3/services` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:39.148803 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0695f0f-8a27-4c1d-8182-cd817d69cf19 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:20:39.149130 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0695f0f-8a27-4c1d-8182-cd817d69cf19 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:39.150684 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0695f0f-8a27-4c1d-8182-cd817d69cf19 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:39.156060 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 606/1201] 10.222.0.32 () {56 vars in 1138 bytes} [Wed Sep 15 02:20:39 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:20:39.161747 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620c398-6b0d-4194-92d8-13333b83cf54 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:20:39.171812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620c398-6b0d-4194-92d8-13333b83cf54 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:20:39.176905 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffc37e-1364-4bbd-9e42-89eaeb83e25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:20:39.177562 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffc37e-1364-4bbd-9e42-89eaeb83e25b admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:20:39.177869 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffc37e-1364-4bbd-9e42-89eaeb83e25b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:20:39.178131 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffc37e-1364-4bbd-9e42-89eaeb83e25b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:20:39.179146 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffc37e-1364-4bbd-9e42-89eaeb83e25b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:20:39.181011 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffc37e-1364-4bbd-9e42-89eaeb83e25b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:20:39.205115 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 596/1202] 10.222.0.32 () {60 vars in 1166 bytes} [Wed Sep 15 02:20:39 2021] POST /identity/v3/endpoints => generated 331 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:21:41.569362 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a53fd4-f980-4cf8-b0cc-1ca9d755c7dd None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:41.570406 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a53fd4-f980-4cf8-b0cc-1ca9d755c7dd None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:41.570906 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a53fd4-f980-4cf8-b0cc-1ca9d755c7dd None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:41.579641 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 607/1203] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:21:41 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:21:41.581079 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39e9f6-67b6-4e7a-b821-e25f3c95df35 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:41.581978 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39e9f6-67b6-4e7a-b821-e25f3c95df35 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:41.582493 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39e9f6-67b6-4e7a-b821-e25f3c95df35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:41.664125 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-8d39e9f6-67b6-4e7a-b821-e25f3c95df35 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:21:41.665613 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8d39e9f6-67b6-4e7a-b821-e25f3c95df35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:21:41.869168 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 597/1204] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:21:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:21:41.870748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a53fd4-f980-4cf8-b0cc-1ca9d755c7dd None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:21:41.872490 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-a5a53fd4-f980-4cf8-b0cc-1ca9d755c7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:21:42.027534 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a53fd4-f980-4cf8-b0cc-1ca9d755c7dd None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:21:42.135963 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32ee78-e85a-45ac-b60f-3dc00e8ed5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:21:42.137755 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32ee78-e85a-45ac-b60f-3dc00e8ed5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:42.137755 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32ee78-e85a-45ac-b60f-3dc00e8ed5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:42.138102 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32ee78-e85a-45ac-b60f-3dc00e8ed5c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:42.138770 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32ee78-e85a-45ac-b60f-3dc00e8ed5c0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:21:42.140669 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32ee78-e85a-45ac-b60f-3dc00e8ed5c0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:21:42.160173 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 608/1205] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Sep 15 02:21:41 2021] GET /identity/v3/projects => generated 2553 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:21:44.339831 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166bf9e-0ef3-4ffc-af18-f1b7cae0c19a None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:44.340392 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166bf9e-0ef3-4ffc-af18-f1b7cae0c19a None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:44.340392 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166bf9e-0ef3-4ffc-af18-f1b7cae0c19a None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:44.342204 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 598/1206] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:21:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:21:44.349594 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb280996-7d13-46e0-8c4e-69739d6dd0ec None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:44.349963 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb280996-7d13-46e0-8c4e-69739d6dd0ec None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:44.350203 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb280996-7d13-46e0-8c4e-69739d6dd0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:44.423584 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-bb280996-7d13-46e0-8c4e-69739d6dd0ec None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:21:44.424779 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-bb280996-7d13-46e0-8c4e-69739d6dd0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:21:44.517234 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 609/1207] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:21:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:21:44.569759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2f263-b75d-4da6-b53c-5bb5d3b3d9db None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:44.570032 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2f263-b75d-4da6-b53c-5bb5d3b3d9db None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:44.570307 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2f263-b75d-4da6-b53c-5bb5d3b3d9db None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:44.572092 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 599/1208] 10.222.0.32 () {54 vars in 964 bytes} [Wed Sep 15 02:21:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:21:44.578765 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ec4cf-d001-46e3-8379-6830549de8a6 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:44.579057 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ec4cf-d001-46e3-8379-6830549de8a6 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:44.579334 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ec4cf-d001-46e3-8379-6830549de8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:44.653955 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-ab5ec4cf-d001-46e3-8379-6830549de8a6 None None] MFA Rules not processed for user `91566418241b40ab840e1c3bf9e096c9`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:21:44.655139 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ab5ec4cf-d001-46e3-8379-6830549de8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:21:44.726673 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 610/1209] 10.222.0.32 () {58 vars in 1062 bytes} [Wed Sep 15 02:21:44 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:21:44.737141 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2f263-b75d-4da6-b53c-5bb5d3b3d9db None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:21:44.738707 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8ba2f263-b75d-4da6-b53c-5bb5d3b3d9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:21:44.836158 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2f263-b75d-4da6-b53c-5bb5d3b3d9db None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:21:44.908118 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab76b1-1260-47f4-b45c-b3a16684a3a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:21:44.908647 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab76b1-1260-47f4-b45c-b3a16684a3a2 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:44.908956 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab76b1-1260-47f4-b45c-b3a16684a3a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:44.909229 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab76b1-1260-47f4-b45c-b3a16684a3a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:44.910822 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b9ab76b1-1260-47f4-b45c-b3a16684a3a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:21:45.014106 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab76b1-1260-47f4-b45c-b3a16684a3a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:21:45.015519 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab76b1-1260-47f4-b45c-b3a16684a3a2 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:21:45.033322 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 600/1210] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:21:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:21:47.496537 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d93cf-65cd-418d-ad57-ff6a9dea5c14 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:47.496984 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d93cf-65cd-418d-ad57-ff6a9dea5c14 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:47.497126 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d93cf-65cd-418d-ad57-ff6a9dea5c14 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:47.498946 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 611/1211] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:21:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:21:47.505964 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431b61d-33d0-4101-8eb4-d62aefd6650a None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:47.506403 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431b61d-33d0-4101-8eb4-d62aefd6650a None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:47.506521 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431b61d-33d0-4101-8eb4-d62aefd6650a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:47.567660 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-b431b61d-33d0-4101-8eb4-d62aefd6650a None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:21:47.568826 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b431b61d-33d0-4101-8eb4-d62aefd6650a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:21:47.658792 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 601/1212] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:21:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:21:47.697136 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d93cf-65cd-418d-ad57-ff6a9dea5c14 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:21:47.698667 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4c0d93cf-65cd-418d-ad57-ff6a9dea5c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:21:47.796192 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d93cf-65cd-418d-ad57-ff6a9dea5c14 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:21:47.865213 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062b295-fc22-413b-b44a-b24f70da37e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:21:47.865845 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062b295-fc22-413b-b44a-b24f70da37e0 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:47.866126 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062b295-fc22-413b-b44a-b24f70da37e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:47.866399 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062b295-fc22-413b-b44a-b24f70da37e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:47.867988 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-5062b295-fc22-413b-b44a-b24f70da37e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:21:47.969558 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062b295-fc22-413b-b44a-b24f70da37e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:21:47.970914 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062b295-fc22-413b-b44a-b24f70da37e0 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:21:47.988186 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 612/1213] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:21:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:21:50.409461 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea75ef-05b4-4c10-881e-3c7d19322c41 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:50.409955 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea75ef-05b4-4c10-881e-3c7d19322c41 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:50.410045 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea75ef-05b4-4c10-881e-3c7d19322c41 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:50.411768 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 602/1214] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:21:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:21:50.418692 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f201e3-ff0f-4919-ae30-983b7ded9c25 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:50.419147 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f201e3-ff0f-4919-ae30-983b7ded9c25 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:50.419241 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f201e3-ff0f-4919-ae30-983b7ded9c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:50.481886 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-39f201e3-ff0f-4919-ae30-983b7ded9c25 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:21:50.483102 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-39f201e3-ff0f-4919-ae30-983b7ded9c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:21:50.573364 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 613/1215] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:21:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:21:50.607829 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea75ef-05b4-4c10-881e-3c7d19322c41 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:21:50.609308 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a2ea75ef-05b4-4c10-881e-3c7d19322c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:21:50.732994 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea75ef-05b4-4c10-881e-3c7d19322c41 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:21:50.820250 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04cf60-9cb1-4e70-a9a3-df33f2baa9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:21:50.821106 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04cf60-9cb1-4e70-a9a3-df33f2baa9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:50.821384 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04cf60-9cb1-4e70-a9a3-df33f2baa9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:50.821654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04cf60-9cb1-4e70-a9a3-df33f2baa9f9 admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:50.831643 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04cf60-9cb1-4e70-a9a3-df33f2baa9f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=911c2d8152d7481fad6c6c9125f3d5a0)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:21:50.833718 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04cf60-9cb1-4e70-a9a3-df33f2baa9f9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:21:50.835388 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 603/1216] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:21:50 2021] GET /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:21:50.864772 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bd0c6-69c9-4e15-b4b7-26c11492fbeb None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:50.865004 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bd0c6-69c9-4e15-b4b7-26c11492fbeb None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:50.865282 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bd0c6-69c9-4e15-b4b7-26c11492fbeb None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:50.867070 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 614/1217] 10.222.0.32 () {54 vars in 964 bytes} [Wed Sep 15 02:21:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:21:50.873613 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a44952-7d7a-484f-8b2d-4f0efeab26f5 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:50.873901 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a44952-7d7a-484f-8b2d-4f0efeab26f5 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:50.874180 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a44952-7d7a-484f-8b2d-4f0efeab26f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:50.945158 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-a0a44952-7d7a-484f-8b2d-4f0efeab26f5 None None] MFA Rules not processed for user `91566418241b40ab840e1c3bf9e096c9`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:21:50.946335 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a0a44952-7d7a-484f-8b2d-4f0efeab26f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:21:51.017409 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 604/1218] 10.222.0.32 () {58 vars in 1062 bytes} [Wed Sep 15 02:21:50 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:21:51.026728 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bd0c6-69c9-4e15-b4b7-26c11492fbeb None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:21:51.028227 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-cc8bd0c6-69c9-4e15-b4b7-26c11492fbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:21:51.125843 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bd0c6-69c9-4e15-b4b7-26c11492fbeb None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:21:51.193921 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7aa5c2-aabf-4407-a0cc-e80951839753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:21:51.194559 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7aa5c2-aabf-4407-a0cc-e80951839753 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:51.194841 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7aa5c2-aabf-4407-a0cc-e80951839753 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:51.195112 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7aa5c2-aabf-4407-a0cc-e80951839753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:51.196704 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-6c7aa5c2-aabf-4407-a0cc-e80951839753 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:21:51.298407 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7aa5c2-aabf-4407-a0cc-e80951839753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:21:51.299831 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7aa5c2-aabf-4407-a0cc-e80951839753 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:21:51.316765 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 615/1219] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:21:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:21:54.354901 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546e71f-837c-438d-9fdd-9077ba34b9a5 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:54.355316 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546e71f-837c-438d-9fdd-9077ba34b9a5 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:54.355715 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546e71f-837c-438d-9fdd-9077ba34b9a5 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:54.357539 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 605/1220] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:21:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:21:54.364630 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3cf59-057d-4ab7-9b2a-ac15b0dd4908 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:54.365066 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3cf59-057d-4ab7-9b2a-ac15b0dd4908 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:54.365247 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3cf59-057d-4ab7-9b2a-ac15b0dd4908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:54.427862 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-f2d3cf59-057d-4ab7-9b2a-ac15b0dd4908 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:21:54.429087 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f2d3cf59-057d-4ab7-9b2a-ac15b0dd4908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:21:54.520570 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 616/1221] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:21:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:21:54.553706 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546e71f-837c-438d-9fdd-9077ba34b9a5 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:21:54.555217 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-d546e71f-837c-438d-9fdd-9077ba34b9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:21:54.673193 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546e71f-837c-438d-9fdd-9077ba34b9a5 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:21:54.759992 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2f94d-632d-4c51-a23c-485eef4fd138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:21:54.760834 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2f94d-632d-4c51-a23c-485eef4fd138 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:54.761148 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2f94d-632d-4c51-a23c-485eef4fd138 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:54.761424 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2f94d-632d-4c51-a23c-485eef4fd138 admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:54.770721 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2f94d-632d-4c51-a23c-485eef4fd138 admin admin] RBAC: Authorizing `identity:get_project(project_id=911c2d8152d7481fad6c6c9125f3d5a0)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:21:54.772741 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2f94d-632d-4c51-a23c-485eef4fd138 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:21:54.774432 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 606/1222] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:21:54 2021] GET /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:21:54.786623 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3cf59-057d-4ab7-9b2a-ac15b0dd4908 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:21:54.787805 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f2d3cf59-057d-4ab7-9b2a-ac15b0dd4908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:21:54.873680 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3cf59-057d-4ab7-9b2a-ac15b0dd4908 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:21:54.941803 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c296b1e-8cbc-4a60-908e-f4f5d423243e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:21:54.942379 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c296b1e-8cbc-4a60-908e-f4f5d423243e service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:54.942660 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c296b1e-8cbc-4a60-908e-f4f5d423243e service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:54.942934 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c296b1e-8cbc-4a60-908e-f4f5d423243e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:54.944522 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-7c296b1e-8cbc-4a60-908e-f4f5d423243e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:21:55.045469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c296b1e-8cbc-4a60-908e-f4f5d423243e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:21:55.046895 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c296b1e-8cbc-4a60-908e-f4f5d423243e service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:21:55.063647 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 617/1223] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:21:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:21:57.918720 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589cba9-2d2b-4ed9-81cb-3aab81b7c819 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:57.919254 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589cba9-2d2b-4ed9-81cb-3aab81b7c819 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:57.919254 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589cba9-2d2b-4ed9-81cb-3aab81b7c819 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:57.921041 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 607/1224] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:21:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:21:57.928280 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2578ce4-bf81-45d8-a400-88ade1b6e75d None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:57.928690 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2578ce4-bf81-45d8-a400-88ade1b6e75d None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:57.928829 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2578ce4-bf81-45d8-a400-88ade1b6e75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:57.990267 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-b2578ce4-bf81-45d8-a400-88ade1b6e75d None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:21:57.991371 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b2578ce4-bf81-45d8-a400-88ade1b6e75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:21:58.083162 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 618/1225] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:21:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:21:58.120937 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589cba9-2d2b-4ed9-81cb-3aab81b7c819 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:21:58.122541 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a589cba9-2d2b-4ed9-81cb-3aab81b7c819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:21:58.222896 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589cba9-2d2b-4ed9-81cb-3aab81b7c819 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:21:58.291911 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d35f4-0820-4f84-97ab-5d80e84fe9e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:21:58.292546 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d35f4-0820-4f84-97ab-5d80e84fe9e0 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:21:58.292822 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d35f4-0820-4f84-97ab-5d80e84fe9e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:21:58.293117 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d35f4-0820-4f84-97ab-5d80e84fe9e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:21:58.294710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b15d35f4-0820-4f84-97ab-5d80e84fe9e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:21:58.398517 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d35f4-0820-4f84-97ab-5d80e84fe9e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:21:58.399932 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d35f4-0820-4f84-97ab-5d80e84fe9e0 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:21:58.417860 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 608/1226] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:21:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:22:00.630895 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85239970-d4e4-4276-b630-f9c2b613be27 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:00.631499 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85239970-d4e4-4276-b630-f9c2b613be27 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:00.631499 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85239970-d4e4-4276-b630-f9c2b613be27 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:00.633188 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 619/1227] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:22:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:00.641104 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac27c4-7dff-4909-a870-fefd2c7dff7d None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:00.641525 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac27c4-7dff-4909-a870-fefd2c7dff7d None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:00.641639 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac27c4-7dff-4909-a870-fefd2c7dff7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:00.703709 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-d7ac27c4-7dff-4909-a870-fefd2c7dff7d None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:00.704951 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-d7ac27c4-7dff-4909-a870-fefd2c7dff7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:00.796190 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 609/1228] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:22:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:22:00.832931 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85239970-d4e4-4276-b630-f9c2b613be27 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:22:00.834449 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-85239970-d4e4-4276-b630-f9c2b613be27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:00.931973 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85239970-d4e4-4276-b630-f9c2b613be27 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:22:01.004863 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130fa51-861a-4b66-8a9e-0987e673497a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:22:01.005541 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130fa51-861a-4b66-8a9e-0987e673497a service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:01.005819 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130fa51-861a-4b66-8a9e-0987e673497a service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:01.006091 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130fa51-861a-4b66-8a9e-0987e673497a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:01.008332 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-7130fa51-861a-4b66-8a9e-0987e673497a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:01.111619 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130fa51-861a-4b66-8a9e-0987e673497a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:22:01.113090 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130fa51-861a-4b66-8a9e-0987e673497a service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:22:01.130910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 620/1229] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:22:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:22:03.331476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d94e54-2247-4e97-85c7-bb188f2d6cc3 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:03.332049 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d94e54-2247-4e97-85c7-bb188f2d6cc3 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:03.332049 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d94e54-2247-4e97-85c7-bb188f2d6cc3 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:03.333832 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 610/1230] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:22:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:03.340824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335a356-5b20-41db-a46e-88e367610a53 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:03.341275 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335a356-5b20-41db-a46e-88e367610a53 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:03.341389 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335a356-5b20-41db-a46e-88e367610a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:03.403350 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-a335a356-5b20-41db-a46e-88e367610a53 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:03.404540 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-a335a356-5b20-41db-a46e-88e367610a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:03.498037 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 621/1231] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:22:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:22:03.531183 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d94e54-2247-4e97-85c7-bb188f2d6cc3 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:22:03.532703 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e1d94e54-2247-4e97-85c7-bb188f2d6cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:03.651320 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d94e54-2247-4e97-85c7-bb188f2d6cc3 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:22:03.738270 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34809b77-ee89-4952-9d66-32346c856af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:22:03.739120 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34809b77-ee89-4952-9d66-32346c856af9 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:03.739401 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34809b77-ee89-4952-9d66-32346c856af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:03.739676 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34809b77-ee89-4952-9d66-32346c856af9 admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:03.749260 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34809b77-ee89-4952-9d66-32346c856af9 admin admin] RBAC: Authorizing `identity:get_project(project_id=911c2d8152d7481fad6c6c9125f3d5a0)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:22:03.751316 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34809b77-ee89-4952-9d66-32346c856af9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:22:03.753043 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 611/1232] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:22:03 2021] GET /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:22:03.765718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335a356-5b20-41db-a46e-88e367610a53 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:22:03.766967 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-a335a356-5b20-41db-a46e-88e367610a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:03.855777 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335a356-5b20-41db-a46e-88e367610a53 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:22:03.924107 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433b576-7e6e-43fb-944a-68aa5d34c273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:22:03.924684 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433b576-7e6e-43fb-944a-68aa5d34c273 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:03.925012 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433b576-7e6e-43fb-944a-68aa5d34c273 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:03.925327 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433b576-7e6e-43fb-944a-68aa5d34c273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:03.926968 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-0433b576-7e6e-43fb-944a-68aa5d34c273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:04.035933 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433b576-7e6e-43fb-944a-68aa5d34c273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:22:04.037430 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0433b576-7e6e-43fb-944a-68aa5d34c273 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:22:04.055927 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 622/1233] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:22:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:22:06.465958 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7464f2b-701c-42a1-8c38-60150efd09ae None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:06.466506 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7464f2b-701c-42a1-8c38-60150efd09ae None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:06.466506 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7464f2b-701c-42a1-8c38-60150efd09ae None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:06.468324 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 612/1234] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:22:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:06.476115 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d0d9b-2db1-44b8-b920-167981b0c424 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:06.476582 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d0d9b-2db1-44b8-b920-167981b0c424 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:06.476697 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d0d9b-2db1-44b8-b920-167981b0c424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:06.539765 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-a40d0d9b-2db1-44b8-b920-167981b0c424 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:06.541041 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-a40d0d9b-2db1-44b8-b920-167981b0c424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:06.633156 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 623/1235] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:22:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:22:06.669629 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7464f2b-701c-42a1-8c38-60150efd09ae None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:22:06.671137 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a7464f2b-701c-42a1-8c38-60150efd09ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:06.769104 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7464f2b-701c-42a1-8c38-60150efd09ae None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:22:06.838174 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090288e-a87f-484b-bbe4-085ad125b1a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:22:06.838805 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090288e-a87f-484b-bbe4-085ad125b1a6 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:06.839084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090288e-a87f-484b-bbe4-085ad125b1a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:06.839356 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090288e-a87f-484b-bbe4-085ad125b1a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:06.840955 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-2090288e-a87f-484b-bbe4-085ad125b1a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:06.942606 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090288e-a87f-484b-bbe4-085ad125b1a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:22:06.943949 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090288e-a87f-484b-bbe4-085ad125b1a6 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:22:06.960903 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 613/1236] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:22:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:22:09.147338 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49682236-a0a9-4245-81ab-160937219e64 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:09.147931 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49682236-a0a9-4245-81ab-160937219e64 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:09.147931 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49682236-a0a9-4245-81ab-160937219e64 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:09.150342 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 624/1237] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:22:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:09.157337 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7729cc7-d122-48ec-bac7-44b68074fda9 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:09.157785 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7729cc7-d122-48ec-bac7-44b68074fda9 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:09.157878 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7729cc7-d122-48ec-bac7-44b68074fda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:09.220223 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-f7729cc7-d122-48ec-bac7-44b68074fda9 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:09.221437 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-f7729cc7-d122-48ec-bac7-44b68074fda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:09.314204 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 614/1238] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:22:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:22:09.359192 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49682236-a0a9-4245-81ab-160937219e64 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:22:09.360691 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-49682236-a0a9-4245-81ab-160937219e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:09.457581 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49682236-a0a9-4245-81ab-160937219e64 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:22:09.525462 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510312a6-0052-4161-83c8-4a2237f10450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:22:09.526106 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510312a6-0052-4161-83c8-4a2237f10450 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:09.526447 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510312a6-0052-4161-83c8-4a2237f10450 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:09.526727 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510312a6-0052-4161-83c8-4a2237f10450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:09.528327 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-510312a6-0052-4161-83c8-4a2237f10450 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:09.629834 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510312a6-0052-4161-83c8-4a2237f10450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:22:09.631247 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510312a6-0052-4161-83c8-4a2237f10450 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:22:09.648009 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 625/1239] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:22:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:22:12.125462 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bb21f-73c4-44fb-97fc-6400e59888f0 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:12.126004 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bb21f-73c4-44fb-97fc-6400e59888f0 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:12.126004 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bb21f-73c4-44fb-97fc-6400e59888f0 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:12.127799 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 615/1240] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:22:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:12.135178 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19c119-a78a-4662-9b3a-ac19df8f2a33 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:12.135575 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19c119-a78a-4662-9b3a-ac19df8f2a33 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:12.135722 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19c119-a78a-4662-9b3a-ac19df8f2a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:12.202225 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-2d19c119-a78a-4662-9b3a-ac19df8f2a33 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:12.203328 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-2d19c119-a78a-4662-9b3a-ac19df8f2a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:12.299600 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 626/1241] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:22:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:22:12.336769 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bb21f-73c4-44fb-97fc-6400e59888f0 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:22:12.338870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8c2bb21f-73c4-44fb-97fc-6400e59888f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:12.427257 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bb21f-73c4-44fb-97fc-6400e59888f0 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:22:12.431267 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55209c0e-a9b9-4865-afa7-f72d8b28926b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:22:12.431917 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55209c0e-a9b9-4865-afa7-f72d8b28926b service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:12.432196 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55209c0e-a9b9-4865-afa7-f72d8b28926b service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:12.432468 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55209c0e-a9b9-4865-afa7-f72d8b28926b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:12.440928 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55209c0e-a9b9-4865-afa7-f72d8b28926b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:22:12.442326 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55209c0e-a9b9-4865-afa7-f72d8b28926b service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:22:12.451749 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 616/1242] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:22:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:22:16.589424 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a41e73-355b-4452-b5c9-33d4ec6087f0 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:16.589951 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a41e73-355b-4452-b5c9-33d4ec6087f0 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:16.590154 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a41e73-355b-4452-b5c9-33d4ec6087f0 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:16.592026 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 627/1243] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:22:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:16.599367 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd7924-e5da-4a5a-b058-300b90324cec None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:16.599829 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd7924-e5da-4a5a-b058-300b90324cec None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:16.599923 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd7924-e5da-4a5a-b058-300b90324cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:16.617695 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-81dd7924-e5da-4a5a-b058-300b90324cec None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:16.619457 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-81dd7924-e5da-4a5a-b058-300b90324cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:16.627363 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 617/1244] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:22:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:22:16.667886 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a41e73-355b-4452-b5c9-33d4ec6087f0 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:22:16.669603 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-61a41e73-355b-4452-b5c9-33d4ec6087f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:16.682620 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a41e73-355b-4452-b5c9-33d4ec6087f0 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:22:16.686368 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c74b69-05f6-4723-bbc8-05472cbff7c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:22:16.687032 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c74b69-05f6-4723-bbc8-05472cbff7c6 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:16.687318 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c74b69-05f6-4723-bbc8-05472cbff7c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:16.687590 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c74b69-05f6-4723-bbc8-05472cbff7c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:16.696619 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c74b69-05f6-4723-bbc8-05472cbff7c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:22:16.698094 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c74b69-05f6-4723-bbc8-05472cbff7c6 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:22:16.707451 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 628/1245] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:22:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:22:19.435779 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d04a35-8de7-4439-a4be-afa8c0b170a1 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:19.436368 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d04a35-8de7-4439-a4be-afa8c0b170a1 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:19.436368 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d04a35-8de7-4439-a4be-afa8c0b170a1 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:19.438280 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 618/1246] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:22:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:19.445913 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853941f2-a3d5-4107-8faf-bdeb55dc7851 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:19.447106 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853941f2-a3d5-4107-8faf-bdeb55dc7851 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:19.447106 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853941f2-a3d5-4107-8faf-bdeb55dc7851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:19.464694 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-853941f2-a3d5-4107-8faf-bdeb55dc7851 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:19.465936 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-853941f2-a3d5-4107-8faf-bdeb55dc7851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:19.474295 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 629/1247] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:22:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:22:19.512559 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d04a35-8de7-4439-a4be-afa8c0b170a1 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:22:19.522926 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d04a35-8de7-4439-a4be-afa8c0b170a1 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:22:19.526452 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f700db7-5564-4169-a0c3-dd0c653af0d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:22:19.527147 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f700db7-5564-4169-a0c3-dd0c653af0d8 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:19.527493 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f700db7-5564-4169-a0c3-dd0c653af0d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:19.527829 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f700db7-5564-4169-a0c3-dd0c653af0d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:19.536721 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f700db7-5564-4169-a0c3-dd0c653af0d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:22:19.538242 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f700db7-5564-4169-a0c3-dd0c653af0d8 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:22:19.547698 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 619/1248] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:22:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:22:23.906682 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7b1d5-e244-4d78-90d1-dce5f5d996f6 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:23.907269 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7b1d5-e244-4d78-90d1-dce5f5d996f6 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:23.907269 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7b1d5-e244-4d78-90d1-dce5f5d996f6 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:23.909044 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 630/1249] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:22:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:23.916389 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4735d-0493-4e3e-9d66-d9c91d3d0f5d None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:23.916861 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4735d-0493-4e3e-9d66-d9c91d3d0f5d None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:23.916979 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4735d-0493-4e3e-9d66-d9c91d3d0f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:23.935012 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-19e4735d-0493-4e3e-9d66-d9c91d3d0f5d None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:23.936213 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-19e4735d-0493-4e3e-9d66-d9c91d3d0f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:23.945341 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 620/1250] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:22:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:22:23.986536 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7b1d5-e244-4d78-90d1-dce5f5d996f6 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:22:23.997644 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7b1d5-e244-4d78-90d1-dce5f5d996f6 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:22:24.001223 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da974eb7-0a51-47bc-9722-c5481d81f82f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:22:24.001885 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da974eb7-0a51-47bc-9722-c5481d81f82f service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:24.002244 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da974eb7-0a51-47bc-9722-c5481d81f82f service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:24.002520 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da974eb7-0a51-47bc-9722-c5481d81f82f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:24.012355 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da974eb7-0a51-47bc-9722-c5481d81f82f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:22:24.013844 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da974eb7-0a51-47bc-9722-c5481d81f82f service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:22:24.037239 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 631/1251] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:22:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:22:29.041512 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca006502-e61d-4703-8122-5e2304190385 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:29.042078 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca006502-e61d-4703-8122-5e2304190385 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:29.042161 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca006502-e61d-4703-8122-5e2304190385 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:29.044025 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 621/1252] 10.222.0.32 () {54 vars in 921 bytes} [Wed Sep 15 02:22:29 2021] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:29.051274 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccaa50-acf0-40bb-8ca8-7c0f0d5d9a42 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:29.051751 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccaa50-acf0-40bb-8ca8-7c0f0d5d9a42 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:29.051846 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccaa50-acf0-40bb-8ca8-7c0f0d5d9a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:29.130063 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-17ccaa50-acf0-40bb-8ca8-7c0f0d5d9a42 None None] MFA Rules not processed for user `9312539f749645d38ed87a0a47e52aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:29.131608 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-17ccaa50-acf0-40bb-8ca8-7c0f0d5d9a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:29.222940 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 632/1253] 10.222.0.32 () {58 vars in 1019 bytes} [Wed Sep 15 02:22:29 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:22:33.422549 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66daa06-263e-46ed-8e8d-04c1e37cf4b7 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:33.423148 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66daa06-263e-46ed-8e8d-04c1e37cf4b7 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:33.423148 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66daa06-263e-46ed-8e8d-04c1e37cf4b7 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:33.425096 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 622/1254] 10.222.0.32 () {54 vars in 921 bytes} [Wed Sep 15 02:22:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:33.430677 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da4817-fa40-4837-a752-02be423d4097 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:33.431507 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da4817-fa40-4837-a752-02be423d4097 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:33.432025 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da4817-fa40-4837-a752-02be423d4097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:33.452207 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-72da4817-fa40-4837-a752-02be423d4097 None None] MFA Rules not processed for user `9312539f749645d38ed87a0a47e52aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:33.453744 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-72da4817-fa40-4837-a752-02be423d4097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:33.463733 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 633/1255] 10.222.0.32 () {58 vars in 1019 bytes} [Wed Sep 15 02:22:33 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:22:35.128700 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe36cc-d506-4d2d-a1dc-b370690a1f83 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:35.129273 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe36cc-d506-4d2d-a1dc-b370690a1f83 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:35.129273 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe36cc-d506-4d2d-a1dc-b370690a1f83 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:35.131016 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 623/1256] 10.222.0.32 () {54 vars in 921 bytes} [Wed Sep 15 02:22:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:35.137078 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b9964-8a3c-480d-9e0e-4ea0114cf5b9 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:35.137498 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b9964-8a3c-480d-9e0e-4ea0114cf5b9 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:35.137669 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b9964-8a3c-480d-9e0e-4ea0114cf5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:35.156394 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-6a7b9964-8a3c-480d-9e0e-4ea0114cf5b9 None None] MFA Rules not processed for user `9312539f749645d38ed87a0a47e52aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:35.157665 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-6a7b9964-8a3c-480d-9e0e-4ea0114cf5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:35.165965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 634/1257] 10.222.0.32 () {58 vars in 1019 bytes} [Wed Sep 15 02:22:35 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:22:38.889218 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae52a1-396e-4956-af7c-d1e92d3cde63 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:38.889774 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae52a1-396e-4956-af7c-d1e92d3cde63 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:38.889955 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae52a1-396e-4956-af7c-d1e92d3cde63 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:38.891940 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 624/1258] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:22:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:38.899306 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a98ab2-38ea-48d4-8bb2-3a7d70b284e1 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:38.899778 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a98ab2-38ea-48d4-8bb2-3a7d70b284e1 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:38.899872 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a98ab2-38ea-48d4-8bb2-3a7d70b284e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:38.917231 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-d9a98ab2-38ea-48d4-8bb2-3a7d70b284e1 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:38.918422 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d9a98ab2-38ea-48d4-8bb2-3a7d70b284e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:38.926837 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 635/1259] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:22:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:22:38.976965 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6aa92e-1590-4ae6-a948-8b06bda36000 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:38.977462 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6aa92e-1590-4ae6-a948-8b06bda36000 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:38.977742 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6aa92e-1590-4ae6-a948-8b06bda36000 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:38.979899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 625/1260] 10.222.0.32 () {54 vars in 961 bytes} [Wed Sep 15 02:22:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:38.985639 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc8ecb-e029-494d-9686-e22a850aade1 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:38.985995 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc8ecb-e029-494d-9686-e22a850aade1 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:38.986341 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc8ecb-e029-494d-9686-e22a850aade1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:39.039246 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-d4cc8ecb-e029-494d-9686-e22a850aade1 None None] MFA Rules not processed for user `797b76e6f16d428198e7f7f05c9c0fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:39.040438 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d4cc8ecb-e029-494d-9686-e22a850aade1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:39.125137 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 636/1261] 10.222.0.32 () {58 vars in 1059 bytes} [Wed Sep 15 02:22:38 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:22:39.134337 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6aa92e-1590-4ae6-a948-8b06bda36000 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:22:39.148940 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6aa92e-1590-4ae6-a948-8b06bda36000 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:22:39.154534 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849e8ba-735d-4e4b-a10e-4cdb07aa2803 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:22:39.155278 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849e8ba-735d-4e4b-a10e-4cdb07aa2803 service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:39.155660 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849e8ba-735d-4e4b-a10e-4cdb07aa2803 service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:39.156042 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849e8ba-735d-4e4b-a10e-4cdb07aa2803 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:39.164225 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849e8ba-735d-4e4b-a10e-4cdb07aa2803 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:22:39.165924 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849e8ba-735d-4e4b-a10e-4cdb07aa2803 service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:22:39.175211 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 626/1262] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:22:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:22:41.518633 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88706d-b23b-4213-886e-d55dab2f567f None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:41.519147 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88706d-b23b-4213-886e-d55dab2f567f None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:41.519147 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88706d-b23b-4213-886e-d55dab2f567f None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:41.521059 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 637/1263] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:22:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:41.529398 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cadeab-b36d-47a6-a2cf-d09fdcbf7f80 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:41.529991 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cadeab-b36d-47a6-a2cf-d09fdcbf7f80 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:41.530074 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cadeab-b36d-47a6-a2cf-d09fdcbf7f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:41.551157 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-c8cadeab-b36d-47a6-a2cf-d09fdcbf7f80 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:41.552442 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c8cadeab-b36d-47a6-a2cf-d09fdcbf7f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:41.564286 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 627/1264] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:22:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:22:41.609108 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88706d-b23b-4213-886e-d55dab2f567f None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:22:41.623924 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88706d-b23b-4213-886e-d55dab2f567f None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:22:41.629521 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9cbd2-0ede-43b2-95a9-ca4cc76bc7fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:22:41.630235 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9cbd2-0ede-43b2-95a9-ca4cc76bc7fe service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:41.630595 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9cbd2-0ede-43b2-95a9-ca4cc76bc7fe service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:41.630944 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9cbd2-0ede-43b2-95a9-ca4cc76bc7fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:41.639171 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9cbd2-0ede-43b2-95a9-ca4cc76bc7fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:22:41.640848 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9cbd2-0ede-43b2-95a9-ca4cc76bc7fe service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:22:41.650873 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 638/1265] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:22:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:22:44.111731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b15b6-6999-4b08-8fc7-b7901f504d69 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:44.112235 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b15b6-6999-4b08-8fc7-b7901f504d69 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:44.112316 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b15b6-6999-4b08-8fc7-b7901f504d69 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:44.114086 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 628/1266] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:22:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:44.121965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9af28c-28f9-4199-bbb3-ce268deacf7b None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:44.122413 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9af28c-28f9-4199-bbb3-ce268deacf7b None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:44.122528 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9af28c-28f9-4199-bbb3-ce268deacf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:44.140558 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-7c9af28c-28f9-4199-bbb3-ce268deacf7b None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:44.141761 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-7c9af28c-28f9-4199-bbb3-ce268deacf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:44.149604 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 639/1267] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:22:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:22:44.196595 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492befa-89f2-478f-8f0d-cbc870c1e850 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:44.196987 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492befa-89f2-478f-8f0d-cbc870c1e850 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:44.197267 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492befa-89f2-478f-8f0d-cbc870c1e850 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:44.199001 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 629/1268] 10.222.0.32 () {54 vars in 961 bytes} [Wed Sep 15 02:22:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:44.204741 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cac00-660c-4a7e-ab35-52b420052cab None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:44.205089 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cac00-660c-4a7e-ab35-52b420052cab None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:44.205364 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cac00-660c-4a7e-ab35-52b420052cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:44.222857 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-ed0cac00-660c-4a7e-ab35-52b420052cab None None] MFA Rules not processed for user `797b76e6f16d428198e7f7f05c9c0fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:44.224047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ed0cac00-660c-4a7e-ab35-52b420052cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:44.233540 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 640/1269] 10.222.0.32 () {58 vars in 1059 bytes} [Wed Sep 15 02:22:44 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:22:44.241410 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492befa-89f2-478f-8f0d-cbc870c1e850 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:22:44.255734 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492befa-89f2-478f-8f0d-cbc870c1e850 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:22:44.261655 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949d293-6ae8-4afd-a0e6-c0866914042c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:22:44.262285 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949d293-6ae8-4afd-a0e6-c0866914042c service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:44.262563 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949d293-6ae8-4afd-a0e6-c0866914042c service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:44.262833 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949d293-6ae8-4afd-a0e6-c0866914042c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:44.270534 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949d293-6ae8-4afd-a0e6-c0866914042c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:22:44.272079 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949d293-6ae8-4afd-a0e6-c0866914042c service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:22:44.286285 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 630/1270] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:22:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:22:46.487580 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1850f1-d2ff-4033-a110-c6e1e4279230 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:46.488076 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1850f1-d2ff-4033-a110-c6e1e4279230 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:46.488160 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1850f1-d2ff-4033-a110-c6e1e4279230 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:46.489941 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 641/1271] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:22:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:46.497784 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee73b2-4e6b-4fdc-912b-44e351d7a983 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:46.498212 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee73b2-4e6b-4fdc-912b-44e351d7a983 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:46.498333 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee73b2-4e6b-4fdc-912b-44e351d7a983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:46.516299 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-48ee73b2-4e6b-4fdc-912b-44e351d7a983 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:46.517500 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-48ee73b2-4e6b-4fdc-912b-44e351d7a983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:46.525335 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 631/1272] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:22:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:22:46.570422 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1850f1-d2ff-4033-a110-c6e1e4279230 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:22:46.584932 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1850f1-d2ff-4033-a110-c6e1e4279230 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:22:46.591556 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c4e35-a295-4cfa-ba86-4cbf3fb70c5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:22:46.592406 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c4e35-a295-4cfa-ba86-4cbf3fb70c5a service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:46.592941 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c4e35-a295-4cfa-ba86-4cbf3fb70c5a service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:46.593400 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c4e35-a295-4cfa-ba86-4cbf3fb70c5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:46.602355 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c4e35-a295-4cfa-ba86-4cbf3fb70c5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:22:46.604422 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c4e35-a295-4cfa-ba86-4cbf3fb70c5a service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:22:46.615263 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 642/1273] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:22:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:22:46.712479 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd36dd-6c35-4206-b1a5-b099c24ffcea None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:46.712893 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd36dd-6c35-4206-b1a5-b099c24ffcea None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:46.713241 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd36dd-6c35-4206-b1a5-b099c24ffcea None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:46.715545 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 632/1274] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:22:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:46.723459 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f987f-c52e-4a07-9a0f-5e8e533f58c6 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:46.723745 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f987f-c52e-4a07-9a0f-5e8e533f58c6 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:46.724241 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f987f-c52e-4a07-9a0f-5e8e533f58c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:46.744332 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-8d6f987f-c52e-4a07-9a0f-5e8e533f58c6 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:46.745611 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-8d6f987f-c52e-4a07-9a0f-5e8e533f58c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:46.754197 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 643/1275] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:22:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:22:46.812697 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795a87a-9fbc-427e-9234-f9f660049301 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:46.813091 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795a87a-9fbc-427e-9234-f9f660049301 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:46.813284 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795a87a-9fbc-427e-9234-f9f660049301 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:46.815077 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 633/1276] 10.222.0.32 () {54 vars in 967 bytes} [Wed Sep 15 02:22:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:46.821675 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9cbb6-300c-4c0d-8120-9a1d0d10bd87 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:46.822007 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9cbb6-300c-4c0d-8120-9a1d0d10bd87 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:46.822237 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9cbb6-300c-4c0d-8120-9a1d0d10bd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:46.880678 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-49a9cbb6-300c-4c0d-8120-9a1d0d10bd87 None None] MFA Rules not processed for user `e0c01428860e44fe9d0b15886add165f`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:46.882195 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-49a9cbb6-300c-4c0d-8120-9a1d0d10bd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:46.948321 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 644/1277] 10.222.0.32 () {58 vars in 1065 bytes} [Wed Sep 15 02:22:46 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:22:46.956298 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795a87a-9fbc-427e-9234-f9f660049301 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:22:46.967672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795a87a-9fbc-427e-9234-f9f660049301 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:22:46.971821 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f94ec8-97b0-415f-a004-ad059ab4fc12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:22:46.972534 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f94ec8-97b0-415f-a004-ad059ab4fc12 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:46.972974 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f94ec8-97b0-415f-a004-ad059ab4fc12 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:46.973325 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f94ec8-97b0-415f-a004-ad059ab4fc12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:46.983680 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f94ec8-97b0-415f-a004-ad059ab4fc12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:22:46.985217 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f94ec8-97b0-415f-a004-ad059ab4fc12 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:22:46.995618 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 634/1278] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:22:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:22:48.810425 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017b410-86fc-4e04-b9ac-4c0e8dab36b0 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:48.810895 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017b410-86fc-4e04-b9ac-4c0e8dab36b0 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:48.810991 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017b410-86fc-4e04-b9ac-4c0e8dab36b0 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:48.812801 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 645/1279] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:22:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:48.820349 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af596dfa-5329-430a-8b17-3457e85bf586 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:48.821149 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af596dfa-5329-430a-8b17-3457e85bf586 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:48.821432 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af596dfa-5329-430a-8b17-3457e85bf586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:48.840006 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-af596dfa-5329-430a-8b17-3457e85bf586 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:48.841333 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-af596dfa-5329-430a-8b17-3457e85bf586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:48.849132 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 635/1280] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:22:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:22:48.894847 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017b410-86fc-4e04-b9ac-4c0e8dab36b0 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:22:48.909733 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017b410-86fc-4e04-b9ac-4c0e8dab36b0 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:22:48.915757 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256cacb-f069-4aaf-8a71-614fb7dc4ecf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:22:48.916404 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256cacb-f069-4aaf-8a71-614fb7dc4ecf service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:48.916688 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256cacb-f069-4aaf-8a71-614fb7dc4ecf service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:48.916997 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256cacb-f069-4aaf-8a71-614fb7dc4ecf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:48.925406 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256cacb-f069-4aaf-8a71-614fb7dc4ecf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:22:48.927049 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256cacb-f069-4aaf-8a71-614fb7dc4ecf service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:22:48.936562 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 646/1281] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:22:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:22:51.138235 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73aee7-8943-4c56-911a-6b6823afb494 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:51.139215 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73aee7-8943-4c56-911a-6b6823afb494 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:51.139495 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73aee7-8943-4c56-911a-6b6823afb494 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:51.141423 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 636/1282] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:22:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:51.148606 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde73ad-d842-4233-b3d1-d6992e1f03ae None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:51.149083 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde73ad-d842-4233-b3d1-d6992e1f03ae None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:51.149181 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde73ad-d842-4233-b3d1-d6992e1f03ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:51.166477 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-ebde73ad-d842-4233-b3d1-d6992e1f03ae None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:51.167642 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ebde73ad-d842-4233-b3d1-d6992e1f03ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:51.175700 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 647/1283] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:22:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:22:51.220985 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73aee7-8943-4c56-911a-6b6823afb494 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:22:51.236594 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73aee7-8943-4c56-911a-6b6823afb494 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:22:51.243307 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cb5eda-6c2a-454a-ab2a-b3a3ae3198bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:22:51.244227 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb5eda-6c2a-454a-ab2a-b3a3ae3198bf service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:51.244621 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb5eda-6c2a-454a-ab2a-b3a3ae3198bf service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:51.244923 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cb5eda-6c2a-454a-ab2a-b3a3ae3198bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:51.253374 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb5eda-6c2a-454a-ab2a-b3a3ae3198bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:22:51.255344 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cb5eda-6c2a-454a-ab2a-b3a3ae3198bf service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:22:51.266387 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 637/1284] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:22:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:22:53.452735 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8195b-6a50-4f50-aa12-015a4098ab54 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:53.453301 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8195b-6a50-4f50-aa12-015a4098ab54 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:53.453301 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8195b-6a50-4f50-aa12-015a4098ab54 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:53.455109 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 648/1285] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:22:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:53.463051 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1e332-43b1-4f69-b7f8-1d7117dabdd0 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:53.463508 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1e332-43b1-4f69-b7f8-1d7117dabdd0 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:53.463609 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1e332-43b1-4f69-b7f8-1d7117dabdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:53.482979 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-6cc1e332-43b1-4f69-b7f8-1d7117dabdd0 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:53.484278 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-6cc1e332-43b1-4f69-b7f8-1d7117dabdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:53.492265 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 638/1286] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:22:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:22:53.536319 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8195b-6a50-4f50-aa12-015a4098ab54 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:22:53.551278 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8195b-6a50-4f50-aa12-015a4098ab54 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:22:53.557325 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672668aa-ad21-4bf8-ad55-da6d9352c5ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:22:53.558218 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672668aa-ad21-4bf8-ad55-da6d9352c5ca service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:53.558690 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672668aa-ad21-4bf8-ad55-da6d9352c5ca service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:53.559150 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672668aa-ad21-4bf8-ad55-da6d9352c5ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:53.567999 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672668aa-ad21-4bf8-ad55-da6d9352c5ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:22:53.570350 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672668aa-ad21-4bf8-ad55-da6d9352c5ca service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:22:53.580025 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 649/1287] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:22:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:22:55.741211 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76187c-ad2d-499c-86b9-662dc2afb1a3 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:55.741873 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76187c-ad2d-499c-86b9-662dc2afb1a3 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:55.741873 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76187c-ad2d-499c-86b9-662dc2afb1a3 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:55.743440 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 639/1288] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:22:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:55.750478 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7643c-af98-4fd2-8c8a-655d4695725c None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:55.750969 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7643c-af98-4fd2-8c8a-655d4695725c None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:55.751061 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7643c-af98-4fd2-8c8a-655d4695725c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:55.769751 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-8cd7643c-af98-4fd2-8c8a-655d4695725c None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:55.770937 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-8cd7643c-af98-4fd2-8c8a-655d4695725c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:55.779718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 650/1289] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:22:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:22:55.825243 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76187c-ad2d-499c-86b9-662dc2afb1a3 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:22:55.839917 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76187c-ad2d-499c-86b9-662dc2afb1a3 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:22:55.847417 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba5ae3-513b-45cd-bab1-4303356ca01d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:22:55.848051 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba5ae3-513b-45cd-bab1-4303356ca01d service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:55.849971 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba5ae3-513b-45cd-bab1-4303356ca01d service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:55.850265 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba5ae3-513b-45cd-bab1-4303356ca01d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:55.859388 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba5ae3-513b-45cd-bab1-4303356ca01d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:22:55.862404 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba5ae3-513b-45cd-bab1-4303356ca01d service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:22:55.876365 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 640/1290] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:22:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:22:58.048940 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f5966-e23e-4cd3-8d23-5a56851002d3 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:58.049486 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f5966-e23e-4cd3-8d23-5a56851002d3 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:58.049583 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f5966-e23e-4cd3-8d23-5a56851002d3 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:58.051301 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 651/1291] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:22:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:22:58.061102 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb8dfe-6d65-414c-afb3-a34a85761ec5 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:58.061654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb8dfe-6d65-414c-afb3-a34a85761ec5 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:58.061837 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb8dfe-6d65-414c-afb3-a34a85761ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:58.084057 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-70fb8dfe-6d65-414c-afb3-a34a85761ec5 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:22:58.085691 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-70fb8dfe-6d65-414c-afb3-a34a85761ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:22:58.095928 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 641/1292] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:22:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:22:58.155430 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f5966-e23e-4cd3-8d23-5a56851002d3 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:22:58.174260 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f5966-e23e-4cd3-8d23-5a56851002d3 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:22:58.183601 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd8e5d-64c0-40e9-9339-5c8be45398f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:22:58.184754 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd8e5d-64c0-40e9-9339-5c8be45398f5 service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:22:58.186476 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd8e5d-64c0-40e9-9339-5c8be45398f5 service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:22:58.186849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd8e5d-64c0-40e9-9339-5c8be45398f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:22:58.197929 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd8e5d-64c0-40e9-9339-5c8be45398f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:22:58.200034 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd8e5d-64c0-40e9-9339-5c8be45398f5 service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:22:58.212624 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 652/1293] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:22:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:23:00.362961 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467b1d0-a41b-49c4-9ad4-5fb78deba526 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:00.363656 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467b1d0-a41b-49c4-9ad4-5fb78deba526 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:00.363656 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467b1d0-a41b-49c4-9ad4-5fb78deba526 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:00.365449 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 642/1294] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:23:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:00.373403 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8879bc-c5be-451b-a54f-4b11e0a03237 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:00.373910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8879bc-c5be-451b-a54f-4b11e0a03237 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:00.374375 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8879bc-c5be-451b-a54f-4b11e0a03237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:00.391778 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-3d8879bc-c5be-451b-a54f-4b11e0a03237 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:00.393012 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-3d8879bc-c5be-451b-a54f-4b11e0a03237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:00.402232 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 653/1295] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:23:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:23:00.448816 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467b1d0-a41b-49c4-9ad4-5fb78deba526 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:00.462833 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467b1d0-a41b-49c4-9ad4-5fb78deba526 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:00.468650 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915825de-686f-44fb-8983-e372aaeb050f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:00.469437 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915825de-686f-44fb-8983-e372aaeb050f service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:00.470011 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915825de-686f-44fb-8983-e372aaeb050f service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:00.470357 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915825de-686f-44fb-8983-e372aaeb050f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:00.479700 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915825de-686f-44fb-8983-e372aaeb050f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:00.481437 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915825de-686f-44fb-8983-e372aaeb050f service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:00.490722 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 643/1296] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:23:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:23:02.726983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8246de-dd14-4527-bb77-7a3f7a23a015 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:02.727578 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8246de-dd14-4527-bb77-7a3f7a23a015 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:02.727578 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8246de-dd14-4527-bb77-7a3f7a23a015 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:02.729677 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 654/1297] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:23:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:02.738119 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff174b6-a1fa-452f-864a-6280ad1ccdfd None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:02.738733 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff174b6-a1fa-452f-864a-6280ad1ccdfd None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:02.738733 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff174b6-a1fa-452f-864a-6280ad1ccdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:02.757442 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-3ff174b6-a1fa-452f-864a-6280ad1ccdfd None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:02.758643 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-3ff174b6-a1fa-452f-864a-6280ad1ccdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:02.766652 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 644/1298] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:23:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:23:02.813126 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8246de-dd14-4527-bb77-7a3f7a23a015 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:02.814910 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5282a-9ae9-43f9-95f0-6c8c1913754f None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:02.815202 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5282a-9ae9-43f9-95f0-6c8c1913754f None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:02.815479 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5282a-9ae9-43f9-95f0-6c8c1913754f None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:02.817258 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 645/1299] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:23:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:02.824179 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d623879-ac01-4b3e-96fe-2d071cbb81f9 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:02.824465 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d623879-ac01-4b3e-96fe-2d071cbb81f9 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:02.824743 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d623879-ac01-4b3e-96fe-2d071cbb81f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:02.827794 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8246de-dd14-4527-bb77-7a3f7a23a015 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:02.833282 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb80670-f4a0-4407-95a9-069dff7b6ff1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:02.833915 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb80670-f4a0-4407-95a9-069dff7b6ff1 service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:02.834192 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb80670-f4a0-4407-95a9-069dff7b6ff1 service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:02.834484 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb80670-f4a0-4407-95a9-069dff7b6ff1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:02.842032 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-1d623879-ac01-4b3e-96fe-2d071cbb81f9 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:02.842575 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb80670-f4a0-4407-95a9-069dff7b6ff1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:02.843217 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-1d623879-ac01-4b3e-96fe-2d071cbb81f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:02.844153 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb80670-f4a0-4407-95a9-069dff7b6ff1 service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:02.851599 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 646/1300] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:23:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:23:02.854354 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 655/1301] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:23:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:23:02.910754 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ded59-64d2-4883-a25e-3df2bc3012b6 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:02.911126 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ded59-64d2-4883-a25e-3df2bc3012b6 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:02.911386 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ded59-64d2-4883-a25e-3df2bc3012b6 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:02.913867 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 647/1302] 10.222.0.32 () {54 vars in 966 bytes} [Wed Sep 15 02:23:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:02.919544 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dad5c1-ef98-40bf-b5d0-8fbc460214ab None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:02.919854 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dad5c1-ef98-40bf-b5d0-8fbc460214ab None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:02.920150 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dad5c1-ef98-40bf-b5d0-8fbc460214ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:02.973952 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-95dad5c1-ef98-40bf-b5d0-8fbc460214ab None None] MFA Rules not processed for user `a71d661d14d94fa597aee037599de7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:02.975837 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-95dad5c1-ef98-40bf-b5d0-8fbc460214ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:03.037654 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 656/1303] 10.222.0.32 () {58 vars in 1064 bytes} [Wed Sep 15 02:23:02 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:23:03.046199 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ded59-64d2-4883-a25e-3df2bc3012b6 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:03.056857 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ded59-64d2-4883-a25e-3df2bc3012b6 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:03.060457 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5f2bb4-2ecb-4fd2-af58-0f54948cb1f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d661d14d94fa597aee037599de7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:03.061137 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f2bb4-2ecb-4fd2-af58-0f54948cb1f4 service glance] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:03.061419 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f2bb4-2ecb-4fd2-af58-0f54948cb1f4 service glance] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:03.061692 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5f2bb4-2ecb-4fd2-af58-0f54948cb1f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:03.071320 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f2bb4-2ecb-4fd2-af58-0f54948cb1f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:03.072759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5f2bb4-2ecb-4fd2-af58-0f54948cb1f4 service glance] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:03.082491 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 648/1304] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:23:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:23:03.518178 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405aae03-9054-4d0b-86f3-ad1a20bcbe8e None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:03.518468 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405aae03-9054-4d0b-86f3-ad1a20bcbe8e None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:03.518748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405aae03-9054-4d0b-86f3-ad1a20bcbe8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:03.565674 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-405aae03-9054-4d0b-86f3-ad1a20bcbe8e None None] MFA Rules not processed for user `a93401007dd64d88af5e41ff08679a28`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:03.566780 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-405aae03-9054-4d0b-86f3-ad1a20bcbe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:03.633493 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 657/1305] 10.222.0.32 () {58 vars in 1010 bytes} [Wed Sep 15 02:23:03 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:23:03.677967 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571629d-b0f5-4351-a4a3-22a7097a0a7e None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:03.678750 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571629d-b0f5-4351-a4a3-22a7097a0a7e None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:03.679030 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571629d-b0f5-4351-a4a3-22a7097a0a7e None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:03.680803 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 649/1306] 10.222.0.32 () {54 vars in 942 bytes} [Wed Sep 15 02:23:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:03.687563 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7cd8a-cdd2-4f0a-b007-ba32e93a2d1e None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:03.687849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7cd8a-cdd2-4f0a-b007-ba32e93a2d1e None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:03.688124 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7cd8a-cdd2-4f0a-b007-ba32e93a2d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:03.734635 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-8ff7cd8a-cdd2-4f0a-b007-ba32e93a2d1e None None] MFA Rules not processed for user `ea510f540b2d47dcb19c8715fd247786`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:03.735823 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-8ff7cd8a-cdd2-4f0a-b007-ba32e93a2d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:03.802818 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 658/1307] 10.222.0.32 () {58 vars in 1040 bytes} [Wed Sep 15 02:23:03 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:23:03.813292 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571629d-b0f5-4351-a4a3-22a7097a0a7e None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:03.827003 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571629d-b0f5-4351-a4a3-22a7097a0a7e None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:03.832013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e87100-92d1-4498-acb5-36c50eb6f47a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea510f540b2d47dcb19c8715fd247786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:03.832732 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e87100-92d1-4498-acb5-36c50eb6f47a service swift] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:03.833110 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e87100-92d1-4498-acb5-36c50eb6f47a service swift] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:03.833470 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e87100-92d1-4498-acb5-36c50eb6f47a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:03.841206 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e87100-92d1-4498-acb5-36c50eb6f47a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:03.842768 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e87100-92d1-4498-acb5-36c50eb6f47a service swift] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:03.850549 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 650/1308] 10.222.0.32 () {60 vars in 1385 bytes} [Wed Sep 15 02:23:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 02:23:05.051141 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687696f-409e-41ce-b593-da274c74a52c None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:05.051709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687696f-409e-41ce-b593-da274c74a52c None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:05.051709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687696f-409e-41ce-b593-da274c74a52c None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:05.053661 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 659/1309] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:23:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:05.061266 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77ba90-634b-455c-9c78-7dad1efa9cf2 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:05.061771 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77ba90-634b-455c-9c78-7dad1efa9cf2 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:05.061861 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77ba90-634b-455c-9c78-7dad1efa9cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:05.081025 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-0d77ba90-634b-455c-9c78-7dad1efa9cf2 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:05.082225 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-0d77ba90-634b-455c-9c78-7dad1efa9cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:05.091205 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 651/1310] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:23:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:23:05.136915 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687696f-409e-41ce-b593-da274c74a52c None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:05.152132 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687696f-409e-41ce-b593-da274c74a52c None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:05.159190 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e656af5-92a8-44d8-8f3e-80bc9faf562c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:05.159834 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e656af5-92a8-44d8-8f3e-80bc9faf562c service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:05.160116 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e656af5-92a8-44d8-8f3e-80bc9faf562c service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:05.160390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e656af5-92a8-44d8-8f3e-80bc9faf562c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:05.168996 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e656af5-92a8-44d8-8f3e-80bc9faf562c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:05.170593 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e656af5-92a8-44d8-8f3e-80bc9faf562c service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:05.182060 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 660/1311] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:23:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:23:21.111099 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da339d-133f-4b22-8a2d-dea56a418898 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:21.111705 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da339d-133f-4b22-8a2d-dea56a418898 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:21.111705 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da339d-133f-4b22-8a2d-dea56a418898 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:21.113514 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 652/1312] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:23:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:21.121218 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff09f02-47ee-4c51-ab40-9706d1bcdb99 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:21.121644 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff09f02-47ee-4c51-ab40-9706d1bcdb99 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:21.121746 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff09f02-47ee-4c51-ab40-9706d1bcdb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:21.139302 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-1ff09f02-47ee-4c51-ab40-9706d1bcdb99 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:21.140498 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-1ff09f02-47ee-4c51-ab40-9706d1bcdb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:21.148291 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 661/1313] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:23:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:23:21.172792 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da339d-133f-4b22-8a2d-dea56a418898 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:21.185593 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da339d-133f-4b22-8a2d-dea56a418898 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:21.190216 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf35a1e-fef3-4f5d-b8dc-70d0dd4bca82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:21.190857 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf35a1e-fef3-4f5d-b8dc-70d0dd4bca82 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:21.191138 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf35a1e-fef3-4f5d-b8dc-70d0dd4bca82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:21.191417 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf35a1e-fef3-4f5d-b8dc-70d0dd4bca82 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:21.192158 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf35a1e-fef3-4f5d-b8dc-70d0dd4bca82 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:21.194017 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf35a1e-fef3-4f5d-b8dc-70d0dd4bca82 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:21.212357 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 653/1314] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Sep 15 02:23:21 2021] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:23:23.288958 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ae5bd-3493-40de-ba97-34ca39419f18 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:23.289535 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ae5bd-3493-40de-ba97-34ca39419f18 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:23.289535 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ae5bd-3493-40de-ba97-34ca39419f18 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:23.291308 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 662/1315] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:23:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:23.298306 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01d015-44fe-48d3-ba9b-022ad45ee806 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:23.298729 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01d015-44fe-48d3-ba9b-022ad45ee806 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:23.298859 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01d015-44fe-48d3-ba9b-022ad45ee806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:23.316611 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-3f01d015-44fe-48d3-ba9b-022ad45ee806 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:23.317850 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-3f01d015-44fe-48d3-ba9b-022ad45ee806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:23.325402 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 654/1316] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:23:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:23:23.348484 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ae5bd-3493-40de-ba97-34ca39419f18 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:23.361324 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ae5bd-3493-40de-ba97-34ca39419f18 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:23.366259 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dadc46-ba5a-4147-aa8a-2e83a57acc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:23.367085 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dadc46-ba5a-4147-aa8a-2e83a57acc29 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:23.367363 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dadc46-ba5a-4147-aa8a-2e83a57acc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:23.367633 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dadc46-ba5a-4147-aa8a-2e83a57acc29 admin admin] PATH_INFO: `/v3/projects/1e876cadd760463fbcc85b667340e817` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:23.377781 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dadc46-ba5a-4147-aa8a-2e83a57acc29 admin admin] RBAC: Authorizing `identity:get_project(project_id=1e876cadd760463fbcc85b667340e817)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:23.379809 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dadc46-ba5a-4147-aa8a-2e83a57acc29 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:23.381505 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 663/1317] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:23:23 2021] GET /identity/v3/projects/1e876cadd760463fbcc85b667340e817 => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:23:23.387842 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01d015-44fe-48d3-ba9b-022ad45ee806 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:23.396636 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01d015-44fe-48d3-ba9b-022ad45ee806 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:23.401165 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e56ef4-8c05-4f2d-8edf-06929615c5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:23.401803 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e56ef4-8c05-4f2d-8edf-06929615c5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:23.402086 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e56ef4-8c05-4f2d-8edf-06929615c5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:23.402364 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e56ef4-8c05-4f2d-8edf-06929615c5a0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:23.403116 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e56ef4-8c05-4f2d-8edf-06929615c5a0 admin admin] RBAC: Adding query filter params (scope.project.id=1e876cadd760463fbcc85b667340e817) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:23:23.403422 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e56ef4-8c05-4f2d-8edf-06929615c5a0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:23.405266 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e56ef4-8c05-4f2d-8edf-06929615c5a0 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:23.411479 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 655/1318] 10.222.0.32 () {56 vars in 1232 bytes} [Wed Sep 15 02:23:23 2021] GET /identity/v3/role_assignments?scope.project.id=1e876cadd760463fbcc85b667340e817 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:23:23.417888 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dadc46-ba5a-4147-aa8a-2e83a57acc29 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:23.427926 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dadc46-ba5a-4147-aa8a-2e83a57acc29 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:23.432596 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b490f-5711-4d5a-a194-4932520f75c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:23.433478 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b490f-5711-4d5a-a194-4932520f75c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:23.433760 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b490f-5711-4d5a-a194-4932520f75c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:23.434035 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b490f-5711-4d5a-a194-4932520f75c4 admin admin] PATH_INFO: `/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:23.447737 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b490f-5711-4d5a-a194-4932520f75c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=b44925dbf31f42bcbc4d0b9cb9d7a80e)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:23.449947 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b490f-5711-4d5a-a194-4932520f75c4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:23.451546 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 664/1319] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:23:23 2021] GET /identity/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:23:25.603702 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c281de-cded-46cc-bcae-c63cfb4351db None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:25.604281 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c281de-cded-46cc-bcae-c63cfb4351db None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:25.604281 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c281de-cded-46cc-bcae-c63cfb4351db None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:25.606061 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 656/1320] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:23:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:25.612943 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204faa0-f002-4889-9c10-8caa461b7e10 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:25.613411 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204faa0-f002-4889-9c10-8caa461b7e10 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:25.613535 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204faa0-f002-4889-9c10-8caa461b7e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:25.630930 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-4204faa0-f002-4889-9c10-8caa461b7e10 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:25.632114 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4204faa0-f002-4889-9c10-8caa461b7e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:25.639799 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 665/1321] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:23:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:23:25.663472 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c281de-cded-46cc-bcae-c63cfb4351db None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:25.675520 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c281de-cded-46cc-bcae-c63cfb4351db None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:25.680590 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc5028-54b8-4083-bb48-5c89ea765e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:25.681487 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc5028-54b8-4083-bb48-5c89ea765e4f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:25.681774 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc5028-54b8-4083-bb48-5c89ea765e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:25.682053 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc5028-54b8-4083-bb48-5c89ea765e4f admin admin] PATH_INFO: `/v3/projects/2c09835f6deb405b989b793378de873e` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:25.683233 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc5028-54b8-4083-bb48-5c89ea765e4f admin admin] RBAC: Authorizing `identity:get_project(project_id=2c09835f6deb405b989b793378de873e)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:25.685127 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc5028-54b8-4083-bb48-5c89ea765e4f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:25.686761 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 657/1322] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:23:25 2021] GET /identity/v3/projects/2c09835f6deb405b989b793378de873e => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:23:25.693044 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204faa0-f002-4889-9c10-8caa461b7e10 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:25.701873 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204faa0-f002-4889-9c10-8caa461b7e10 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:25.706380 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f4bfc7-84fa-4fdf-b762-636ac61a2128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:25.708998 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4bfc7-84fa-4fdf-b762-636ac61a2128 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:25.708998 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4bfc7-84fa-4fdf-b762-636ac61a2128 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:25.708998 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4bfc7-84fa-4fdf-b762-636ac61a2128 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:25.708998 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4bfc7-84fa-4fdf-b762-636ac61a2128 admin admin] RBAC: Adding query filter params (scope.project.id=2c09835f6deb405b989b793378de873e) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:23:25.708998 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4bfc7-84fa-4fdf-b762-636ac61a2128 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:25.710462 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f4bfc7-84fa-4fdf-b762-636ac61a2128 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:25.717122 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 666/1323] 10.222.0.32 () {56 vars in 1232 bytes} [Wed Sep 15 02:23:25 2021] GET /identity/v3/role_assignments?scope.project.id=2c09835f6deb405b989b793378de873e => generated 879 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:23:25.723360 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc5028-54b8-4083-bb48-5c89ea765e4f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:25.733548 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc5028-54b8-4083-bb48-5c89ea765e4f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:25.738073 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab420a-4c09-4965-a516-9f8b58c58a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:25.738917 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab420a-4c09-4965-a516-9f8b58c58a2e admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:25.739201 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab420a-4c09-4965-a516-9f8b58c58a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:25.739476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab420a-4c09-4965-a516-9f8b58c58a2e admin admin] PATH_INFO: `/v3/users/a88ff9155434478bafd7ce991d7c4650` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:25.741221 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab420a-4c09-4965-a516-9f8b58c58a2e admin admin] RBAC: Authorizing `identity:get_user(user_id=a88ff9155434478bafd7ce991d7c4650)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:25.742985 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab420a-4c09-4965-a516-9f8b58c58a2e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:25.744537 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 658/1324] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:23:25 2021] GET /identity/v3/users/a88ff9155434478bafd7ce991d7c4650 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:23:27.888377 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4260949-d1dc-4e7b-82bf-738b537f8ab2 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:27.888965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4260949-d1dc-4e7b-82bf-738b537f8ab2 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:27.888965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4260949-d1dc-4e7b-82bf-738b537f8ab2 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:27.890705 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 667/1325] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:23:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:27.897730 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528aa4a-b1a2-4538-a564-78b570d6ff97 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:27.898138 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528aa4a-b1a2-4538-a564-78b570d6ff97 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:27.898290 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528aa4a-b1a2-4538-a564-78b570d6ff97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:27.916183 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-7528aa4a-b1a2-4538-a564-78b570d6ff97 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:27.917398 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7528aa4a-b1a2-4538-a564-78b570d6ff97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:27.925134 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 659/1326] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:23:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:23:27.949030 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4260949-d1dc-4e7b-82bf-738b537f8ab2 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:27.960864 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4260949-d1dc-4e7b-82bf-738b537f8ab2 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:27.965211 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2de88-9ebd-4b45-b0f1-03d854b6af45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:27.966030 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2de88-9ebd-4b45-b0f1-03d854b6af45 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:27.966309 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2de88-9ebd-4b45-b0f1-03d854b6af45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:27.966576 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2de88-9ebd-4b45-b0f1-03d854b6af45 admin admin] PATH_INFO: `/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:27.977964 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2de88-9ebd-4b45-b0f1-03d854b6af45 admin admin] RBAC: Authorizing `identity:get_project(project_id=911c2d8152d7481fad6c6c9125f3d5a0)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:27.979998 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2de88-9ebd-4b45-b0f1-03d854b6af45 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:27.981683 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 668/1327] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:23:27 2021] GET /identity/v3/projects/911c2d8152d7481fad6c6c9125f3d5a0 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:23:27.987925 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528aa4a-b1a2-4538-a564-78b570d6ff97 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:27.997466 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528aa4a-b1a2-4538-a564-78b570d6ff97 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:28.002006 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e73e9-200b-40ff-9090-aa3b953b5fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:28.002692 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e73e9-200b-40ff-9090-aa3b953b5fec admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:28.002970 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e73e9-200b-40ff-9090-aa3b953b5fec admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:28.003242 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e73e9-200b-40ff-9090-aa3b953b5fec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:28.003992 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e73e9-200b-40ff-9090-aa3b953b5fec admin admin] RBAC: Adding query filter params (scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:23:28.004294 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e73e9-200b-40ff-9090-aa3b953b5fec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:28.006167 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e73e9-200b-40ff-9090-aa3b953b5fec admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:28.012568 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 660/1328] 10.222.0.32 () {56 vars in 1232 bytes} [Wed Sep 15 02:23:27 2021] GET /identity/v3/role_assignments?scope.project.id=911c2d8152d7481fad6c6c9125f3d5a0 => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:23:28.018482 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2de88-9ebd-4b45-b0f1-03d854b6af45 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:28.028156 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2de88-9ebd-4b45-b0f1-03d854b6af45 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:28.032624 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb50761-0488-4371-bf83-4fe43f929663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:28.033483 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb50761-0488-4371-bf83-4fe43f929663 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:28.033764 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb50761-0488-4371-bf83-4fe43f929663 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:28.034037 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb50761-0488-4371-bf83-4fe43f929663 admin admin] PATH_INFO: `/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:28.035269 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb50761-0488-4371-bf83-4fe43f929663 admin admin] RBAC: Authorizing `identity:get_user(user_id=b44925dbf31f42bcbc4d0b9cb9d7a80e)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:28.037886 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb50761-0488-4371-bf83-4fe43f929663 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:28.039419 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 669/1329] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:23:28 2021] GET /identity/v3/users/b44925dbf31f42bcbc4d0b9cb9d7a80e => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:23:28.045155 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e73e9-200b-40ff-9090-aa3b953b5fec admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:28.054282 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e73e9-200b-40ff-9090-aa3b953b5fec admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:28.058790 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1895d-c9ff-40b6-8c2e-3e53681356ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:28.059610 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1895d-c9ff-40b6-8c2e-3e53681356ed admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:28.059889 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1895d-c9ff-40b6-8c2e-3e53681356ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:28.060161 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1895d-c9ff-40b6-8c2e-3e53681356ed admin admin] PATH_INFO: `/v3/users/a88ff9155434478bafd7ce991d7c4650` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:28.061354 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1895d-c9ff-40b6-8c2e-3e53681356ed admin admin] RBAC: Authorizing `identity:get_user(user_id=a88ff9155434478bafd7ce991d7c4650)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:28.063104 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1895d-c9ff-40b6-8c2e-3e53681356ed admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:28.064631 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 661/1330] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:23:28 2021] GET /identity/v3/users/a88ff9155434478bafd7ce991d7c4650 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:23:30.264888 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08626327-a816-4a26-80ab-e10e63232019 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:30.265487 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08626327-a816-4a26-80ab-e10e63232019 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:30.265487 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08626327-a816-4a26-80ab-e10e63232019 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:30.267398 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 670/1331] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:23:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:30.274964 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b64bb-7f7b-41d8-a5ea-2afb3ff24df3 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:30.275376 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b64bb-7f7b-41d8-a5ea-2afb3ff24df3 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:30.275528 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b64bb-7f7b-41d8-a5ea-2afb3ff24df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:30.293469 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-195b64bb-7f7b-41d8-a5ea-2afb3ff24df3 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:30.294699 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-195b64bb-7f7b-41d8-a5ea-2afb3ff24df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:30.302503 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 662/1332] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:23:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:23:30.325988 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08626327-a816-4a26-80ab-e10e63232019 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:30.338629 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08626327-a816-4a26-80ab-e10e63232019 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:30.343101 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44c0ae-a77a-4c6c-960b-d0aa94313414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:30.343932 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44c0ae-a77a-4c6c-960b-d0aa94313414 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:30.344212 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44c0ae-a77a-4c6c-960b-d0aa94313414 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:30.344485 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44c0ae-a77a-4c6c-960b-d0aa94313414 admin admin] PATH_INFO: `/v3/projects/93da85153ad4430aa74dd768afee248e` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:30.355165 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44c0ae-a77a-4c6c-960b-d0aa94313414 admin admin] RBAC: Authorizing `identity:get_project(project_id=93da85153ad4430aa74dd768afee248e)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:30.357326 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44c0ae-a77a-4c6c-960b-d0aa94313414 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:30.359460 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 671/1333] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:23:30 2021] GET /identity/v3/projects/93da85153ad4430aa74dd768afee248e => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:23:30.366221 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b64bb-7f7b-41d8-a5ea-2afb3ff24df3 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:30.374887 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b64bb-7f7b-41d8-a5ea-2afb3ff24df3 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:30.379326 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e97c9-cbdd-427c-af09-6178b4f4cd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:30.380522 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e97c9-cbdd-427c-af09-6178b4f4cd70 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:30.380807 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e97c9-cbdd-427c-af09-6178b4f4cd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:30.381103 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e97c9-cbdd-427c-af09-6178b4f4cd70 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:30.381848 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e97c9-cbdd-427c-af09-6178b4f4cd70 admin admin] RBAC: Adding query filter params (scope.project.id=93da85153ad4430aa74dd768afee248e) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:23:30.382147 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e97c9-cbdd-427c-af09-6178b4f4cd70 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:30.383959 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e97c9-cbdd-427c-af09-6178b4f4cd70 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:30.389459 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 663/1334] 10.222.0.32 () {56 vars in 1232 bytes} [Wed Sep 15 02:23:30 2021] GET /identity/v3/role_assignments?scope.project.id=93da85153ad4430aa74dd768afee248e => generated 877 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:23:30.395270 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44c0ae-a77a-4c6c-960b-d0aa94313414 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:30.404756 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44c0ae-a77a-4c6c-960b-d0aa94313414 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:30.409267 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76f235-64ea-42f9-b44e-fd762d30529d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:30.410099 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76f235-64ea-42f9-b44e-fd762d30529d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:30.410377 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76f235-64ea-42f9-b44e-fd762d30529d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:30.410646 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76f235-64ea-42f9-b44e-fd762d30529d admin admin] PATH_INFO: `/v3/users/b67e4cf76f9d41ccb5e6251ae294a529` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:30.423707 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76f235-64ea-42f9-b44e-fd762d30529d admin admin] RBAC: Authorizing `identity:get_user(user_id=b67e4cf76f9d41ccb5e6251ae294a529)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:30.425936 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76f235-64ea-42f9-b44e-fd762d30529d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:30.428152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 672/1335] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:23:30 2021] GET /identity/v3/users/b67e4cf76f9d41ccb5e6251ae294a529 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:23:30.434393 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e97c9-cbdd-427c-af09-6178b4f4cd70 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:30.444388 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e97c9-cbdd-427c-af09-6178b4f4cd70 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:30.448865 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659daed0-6ae0-48e3-9c23-2db5f2bb91e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:30.449731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659daed0-6ae0-48e3-9c23-2db5f2bb91e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:30.450015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659daed0-6ae0-48e3-9c23-2db5f2bb91e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:30.450291 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659daed0-6ae0-48e3-9c23-2db5f2bb91e5 admin admin] PATH_INFO: `/v3/users/4504a4ecbe2b440490effd102f3f1fd0` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:30.464087 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659daed0-6ae0-48e3-9c23-2db5f2bb91e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=4504a4ecbe2b440490effd102f3f1fd0)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:30.466248 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659daed0-6ae0-48e3-9c23-2db5f2bb91e5 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:30.467846 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 664/1336] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:23:30 2021] GET /identity/v3/users/4504a4ecbe2b440490effd102f3f1fd0 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:23:32.668483 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724b9f4-5e0e-434c-bf1b-2ad80f909da5 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:32.669221 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724b9f4-5e0e-434c-bf1b-2ad80f909da5 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:32.669221 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724b9f4-5e0e-434c-bf1b-2ad80f909da5 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:32.670888 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 673/1337] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:23:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:32.678514 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d63eb-090a-4979-8d0f-e2434f9159d0 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:32.678974 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d63eb-090a-4979-8d0f-e2434f9159d0 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:32.679258 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d63eb-090a-4979-8d0f-e2434f9159d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:32.696606 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-de9d63eb-090a-4979-8d0f-e2434f9159d0 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:32.697826 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-de9d63eb-090a-4979-8d0f-e2434f9159d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:32.705705 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 665/1338] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:23:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:23:32.730551 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724b9f4-5e0e-434c-bf1b-2ad80f909da5 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:32.742749 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724b9f4-5e0e-434c-bf1b-2ad80f909da5 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:32.747228 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bd87d-208c-41bf-aac9-72043a9667fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:32.748059 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bd87d-208c-41bf-aac9-72043a9667fc admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:32.748338 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bd87d-208c-41bf-aac9-72043a9667fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:32.748611 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bd87d-208c-41bf-aac9-72043a9667fc admin admin] PATH_INFO: `/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:32.758941 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34bd87d-208c-41bf-aac9-72043a9667fc admin admin] RBAC: Authorizing `identity:get_project(project_id=e95b7aee5cbe45d1ac7e1805bf0d46dd)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:32.761006 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34bd87d-208c-41bf-aac9-72043a9667fc admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:32.762678 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 674/1339] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:23:32 2021] GET /identity/v3/projects/e95b7aee5cbe45d1ac7e1805bf0d46dd => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:23:32.768945 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d63eb-090a-4979-8d0f-e2434f9159d0 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:32.778176 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d63eb-090a-4979-8d0f-e2434f9159d0 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:32.782641 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818eb64-a76a-4f5d-8350-6f298d1cf706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:32.783268 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818eb64-a76a-4f5d-8350-6f298d1cf706 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:32.783546 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818eb64-a76a-4f5d-8350-6f298d1cf706 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:32.783815 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818eb64-a76a-4f5d-8350-6f298d1cf706 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:32.784561 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818eb64-a76a-4f5d-8350-6f298d1cf706 admin admin] RBAC: Adding query filter params (scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:23:32.784863 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818eb64-a76a-4f5d-8350-6f298d1cf706 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:32.787298 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818eb64-a76a-4f5d-8350-6f298d1cf706 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:32.793760 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 666/1340] 10.222.0.32 () {56 vars in 1232 bytes} [Wed Sep 15 02:23:32 2021] GET /identity/v3/role_assignments?scope.project.id=e95b7aee5cbe45d1ac7e1805bf0d46dd => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:23:32.799856 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bd87d-208c-41bf-aac9-72043a9667fc admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:32.809199 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bd87d-208c-41bf-aac9-72043a9667fc admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:32.813692 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec916b98-e4f1-4881-a9f1-c77d0ccefbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:32.814521 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec916b98-e4f1-4881-a9f1-c77d0ccefbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:32.814797 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec916b98-e4f1-4881-a9f1-c77d0ccefbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:32.815070 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec916b98-e4f1-4881-a9f1-c77d0ccefbb9 admin admin] PATH_INFO: `/v3/users/a88ff9155434478bafd7ce991d7c4650` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:32.816237 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec916b98-e4f1-4881-a9f1-c77d0ccefbb9 admin admin] RBAC: Authorizing `identity:get_user(user_id=a88ff9155434478bafd7ce991d7c4650)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:32.818050 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec916b98-e4f1-4881-a9f1-c77d0ccefbb9 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:32.819584 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 675/1341] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:23:32 2021] GET /identity/v3/users/a88ff9155434478bafd7ce991d7c4650 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:23:32.825282 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818eb64-a76a-4f5d-8350-6f298d1cf706 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:32.834803 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818eb64-a76a-4f5d-8350-6f298d1cf706 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:32.839213 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbac589-e5be-46a5-8389-6f50753243b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:32.840029 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbac589-e5be-46a5-8389-6f50753243b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:32.840308 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbac589-e5be-46a5-8389-6f50753243b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:32.840578 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbac589-e5be-46a5-8389-6f50753243b8 admin admin] PATH_INFO: `/v3/users/17730e59d96c42b68e33fbbd4ba213f7` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:32.854309 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbac589-e5be-46a5-8389-6f50753243b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=17730e59d96c42b68e33fbbd4ba213f7)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:32.856369 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbac589-e5be-46a5-8389-6f50753243b8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:32.857962 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 667/1342] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:23:32 2021] GET /identity/v3/users/17730e59d96c42b68e33fbbd4ba213f7 => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:23:35.040175 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7286a-b7c5-4886-b673-0bf7d5c8d252 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:35.040743 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7286a-b7c5-4886-b673-0bf7d5c8d252 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:35.040743 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a7286a-b7c5-4886-b673-0bf7d5c8d252 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:35.042548 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 676/1343] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:23:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:35.049881 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9385a6-e9c4-4569-9971-d2bea45ab9e8 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:35.050300 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9385a6-e9c4-4569-9971-d2bea45ab9e8 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:35.050445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9385a6-e9c4-4569-9971-d2bea45ab9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:35.068618 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-af9385a6-e9c4-4569-9971-d2bea45ab9e8 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:35.069860 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-af9385a6-e9c4-4569-9971-d2bea45ab9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:35.077549 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 668/1344] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:23:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:23:35.101225 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7286a-b7c5-4886-b673-0bf7d5c8d252 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:35.114001 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a7286a-b7c5-4886-b673-0bf7d5c8d252 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:35.118961 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1e0ac-3002-4d86-bab4-04ab68a17acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:35.119841 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1e0ac-3002-4d86-bab4-04ab68a17acc admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:35.120128 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1e0ac-3002-4d86-bab4-04ab68a17acc admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:35.120402 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1e0ac-3002-4d86-bab4-04ab68a17acc admin admin] PATH_INFO: `/v3/projects/f1f9b76f476c48ecbaaa174761abe935` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:35.131572 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1e0ac-3002-4d86-bab4-04ab68a17acc admin admin] RBAC: Authorizing `identity:get_project(project_id=f1f9b76f476c48ecbaaa174761abe935)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:35.133645 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1e0ac-3002-4d86-bab4-04ab68a17acc admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:35.135320 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 677/1345] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:23:35 2021] GET /identity/v3/projects/f1f9b76f476c48ecbaaa174761abe935 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:23:35.141660 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9385a6-e9c4-4569-9971-d2bea45ab9e8 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:35.150632 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9385a6-e9c4-4569-9971-d2bea45ab9e8 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:35.155290 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39166c-9661-4902-97bc-31af91415bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:35.155927 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39166c-9661-4902-97bc-31af91415bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:35.156211 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39166c-9661-4902-97bc-31af91415bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:35.156487 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39166c-9661-4902-97bc-31af91415bf0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:35.157285 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39166c-9661-4902-97bc-31af91415bf0 admin admin] RBAC: Adding query filter params (scope.project.id=f1f9b76f476c48ecbaaa174761abe935) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:23:35.157592 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39166c-9661-4902-97bc-31af91415bf0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:35.159418 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39166c-9661-4902-97bc-31af91415bf0 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:35.165257 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 669/1346] 10.222.0.32 () {56 vars in 1232 bytes} [Wed Sep 15 02:23:35 2021] GET /identity/v3/role_assignments?scope.project.id=f1f9b76f476c48ecbaaa174761abe935 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:23:35.171105 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1e0ac-3002-4d86-bab4-04ab68a17acc admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:35.181104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1e0ac-3002-4d86-bab4-04ab68a17acc admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:35.185697 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdc53f-affa-439e-a6ba-76d028420f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:35.186538 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdc53f-affa-439e-a6ba-76d028420f24 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:35.186823 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdc53f-affa-439e-a6ba-76d028420f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:35.187146 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdc53f-affa-439e-a6ba-76d028420f24 admin admin] PATH_INFO: `/v3/users/ff928b4686cf4c438936a7259af7d9a9` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:35.200575 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdc53f-affa-439e-a6ba-76d028420f24 admin admin] RBAC: Authorizing `identity:get_user(user_id=ff928b4686cf4c438936a7259af7d9a9)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:35.202745 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdc53f-affa-439e-a6ba-76d028420f24 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:35.204361 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 678/1347] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:23:35 2021] GET /identity/v3/users/ff928b4686cf4c438936a7259af7d9a9 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:23:37.327810 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5afefc-73bc-4d86-9494-a17b26447684 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:37.328355 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5afefc-73bc-4d86-9494-a17b26447684 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:37.328355 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5afefc-73bc-4d86-9494-a17b26447684 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:37.330147 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 670/1348] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:23:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:37.337289 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c6696-9797-45a9-97c9-91e3fccae982 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:37.337702 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c6696-9797-45a9-97c9-91e3fccae982 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:37.337845 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c6696-9797-45a9-97c9-91e3fccae982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:37.355079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-5d3c6696-9797-45a9-97c9-91e3fccae982 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:37.356296 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-5d3c6696-9797-45a9-97c9-91e3fccae982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:37.363914 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 679/1349] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:23:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:23:37.388025 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5afefc-73bc-4d86-9494-a17b26447684 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:37.400389 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5afefc-73bc-4d86-9494-a17b26447684 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:37.404897 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d0224-8821-4840-a2f4-a6a6bd0bd7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:37.405732 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d0224-8821-4840-a2f4-a6a6bd0bd7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:37.406011 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d0224-8821-4840-a2f4-a6a6bd0bd7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:37.406282 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d0224-8821-4840-a2f4-a6a6bd0bd7c7 admin admin] PATH_INFO: `/v3/projects/f6ad87048e524602a84d7b868809ef09` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:37.417134 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d0224-8821-4840-a2f4-a6a6bd0bd7c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=f6ad87048e524602a84d7b868809ef09)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:37.419197 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d0224-8821-4840-a2f4-a6a6bd0bd7c7 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:37.420870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 671/1350] 10.222.0.32 () {56 vars in 1208 bytes} [Wed Sep 15 02:23:37 2021] GET /identity/v3/projects/f6ad87048e524602a84d7b868809ef09 => generated 361 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:23:37.428217 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c6696-9797-45a9-97c9-91e3fccae982 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:37.437119 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c6696-9797-45a9-97c9-91e3fccae982 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:37.441609 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5513f2-f487-4516-97d4-47d00f455a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:37.442278 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5513f2-f487-4516-97d4-47d00f455a27 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:37.442561 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5513f2-f487-4516-97d4-47d00f455a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:37.442837 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5513f2-f487-4516-97d4-47d00f455a27 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:37.443597 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5513f2-f487-4516-97d4-47d00f455a27 admin admin] RBAC: Adding query filter params (scope.project.id=f6ad87048e524602a84d7b868809ef09) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:23:37.443912 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5513f2-f487-4516-97d4-47d00f455a27 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:37.445783 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5513f2-f487-4516-97d4-47d00f455a27 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:37.451027 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 680/1351] 10.222.0.32 () {56 vars in 1232 bytes} [Wed Sep 15 02:23:37 2021] GET /identity/v3/role_assignments?scope.project.id=f6ad87048e524602a84d7b868809ef09 => generated 526 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:23:37.456801 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d0224-8821-4840-a2f4-a6a6bd0bd7c7 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:37.466118 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d0224-8821-4840-a2f4-a6a6bd0bd7c7 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:37.470665 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cfc08-a286-4bc5-a580-52fe908f2b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:37.471507 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cfc08-a286-4bc5-a580-52fe908f2b69 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:37.471786 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cfc08-a286-4bc5-a580-52fe908f2b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:37.472056 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cfc08-a286-4bc5-a580-52fe908f2b69 admin admin] PATH_INFO: `/v3/users/452834364e7e426db730e8f3d9f683eb` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:37.485908 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cfc08-a286-4bc5-a580-52fe908f2b69 admin admin] RBAC: Authorizing `identity:get_user(user_id=452834364e7e426db730e8f3d9f683eb)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:37.488009 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cfc08-a286-4bc5-a580-52fe908f2b69 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:37.490314 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 672/1352] 10.222.0.32 () {56 vars in 1199 bytes} [Wed Sep 15 02:23:37 2021] GET /identity/v3/users/452834364e7e426db730e8f3d9f683eb => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:23:42.694165 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdafab-b03d-4d0a-82f2-78cb68737260 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:42.694740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdafab-b03d-4d0a-82f2-78cb68737260 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:42.694740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cdafab-b03d-4d0a-82f2-78cb68737260 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:42.696519 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 681/1353] 10.222.0.32 () {54 vars in 918 bytes} [Wed Sep 15 02:23:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:42.702513 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ff7a6-f783-4faf-a4dc-b44f959a7058 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:42.702984 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ff7a6-f783-4faf-a4dc-b44f959a7058 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:42.703084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ff7a6-f783-4faf-a4dc-b44f959a7058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:42.721533 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-7b9ff7a6-f783-4faf-a4dc-b44f959a7058 None None] MFA Rules not processed for user `9312539f749645d38ed87a0a47e52aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:42.722699 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7b9ff7a6-f783-4faf-a4dc-b44f959a7058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:42.731542 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 673/1354] 10.222.0.32 () {58 vars in 1016 bytes} [Wed Sep 15 02:23:42 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:23:42.746095 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea186abe-69f7-4ced-92cf-2566d68d16b3 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:42.746388 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea186abe-69f7-4ced-92cf-2566d68d16b3 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:42.746691 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea186abe-69f7-4ced-92cf-2566d68d16b3 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:42.748422 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 682/1355] 10.222.0.32 () {54 vars in 918 bytes} [Wed Sep 15 02:23:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:42.753314 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ce877-ddf0-4889-8c5c-5cce5b887666 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:42.753608 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ce877-ddf0-4889-8c5c-5cce5b887666 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:42.753887 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ce877-ddf0-4889-8c5c-5cce5b887666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:42.772082 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-9b6ce877-ddf0-4889-8c5c-5cce5b887666 None None] MFA Rules not processed for user `797b76e6f16d428198e7f7f05c9c0fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:42.773255 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-9b6ce877-ddf0-4889-8c5c-5cce5b887666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:42.782201 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 674/1356] 10.222.0.32 () {58 vars in 1016 bytes} [Wed Sep 15 02:23:42 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:23:45.580247 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5a831-3e0f-4021-bc20-9a9f93592bfd None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:45.580859 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5a831-3e0f-4021-bc20-9a9f93592bfd None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:45.580859 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5a831-3e0f-4021-bc20-9a9f93592bfd None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:45.582638 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 683/1357] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:23:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:45.589653 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a1025-78e6-4d9d-b960-0ba2cf003486 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:45.590066 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a1025-78e6-4d9d-b960-0ba2cf003486 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:45.590202 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a1025-78e6-4d9d-b960-0ba2cf003486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:45.607669 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-fc9a1025-78e6-4d9d-b960-0ba2cf003486 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:45.608824 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-fc9a1025-78e6-4d9d-b960-0ba2cf003486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:45.616993 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 675/1358] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:23:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:23:45.659534 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5a831-3e0f-4021-bc20-9a9f93592bfd None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:45.673797 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5a831-3e0f-4021-bc20-9a9f93592bfd None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:45.679640 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0725e25-1b4c-4e0c-af61-3e2b6e89d627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:45.680264 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0725e25-1b4c-4e0c-af61-3e2b6e89d627 service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:45.680544 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0725e25-1b4c-4e0c-af61-3e2b6e89d627 service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:45.680818 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0725e25-1b4c-4e0c-af61-3e2b6e89d627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:45.688566 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0725e25-1b4c-4e0c-af61-3e2b6e89d627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:45.690181 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0725e25-1b4c-4e0c-af61-3e2b6e89d627 service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:45.699801 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 684/1359] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:23:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:23:47.101795 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9f0c6-8ab0-4544-bd1c-f8dd32951126 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:47.102409 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9f0c6-8ab0-4544-bd1c-f8dd32951126 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:47.102409 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9f0c6-8ab0-4544-bd1c-f8dd32951126 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:47.104129 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 676/1360] 10.222.0.32 () {54 vars in 911 bytes} [Wed Sep 15 02:23:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:47.109709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3079e-bdbd-4558-8af2-a784df61bc95 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:47.110139 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3079e-bdbd-4558-8af2-a784df61bc95 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:47.110291 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3079e-bdbd-4558-8af2-a784df61bc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:47.128110 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-a0c3079e-bdbd-4558-8af2-a784df61bc95 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:47.129930 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-a0c3079e-bdbd-4558-8af2-a784df61bc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:47.137746 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 685/1361] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Sep 15 02:23:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:23:47.288892 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9f0c6-8ab0-4544-bd1c-f8dd32951126 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:47.303453 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9f0c6-8ab0-4544-bd1c-f8dd32951126 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:47.308868 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f620273-8e67-42d9-9780-29c4367a8da9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:47.309521 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f620273-8e67-42d9-9780-29c4367a8da9 service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:47.309807 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f620273-8e67-42d9-9780-29c4367a8da9 service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:47.310081 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f620273-8e67-42d9-9780-29c4367a8da9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:47.317993 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f620273-8e67-42d9-9780-29c4367a8da9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:47.319559 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f620273-8e67-42d9-9780-29c4367a8da9 service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:47.328626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 677/1362] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:23:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:23:48.713529 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aecbe-a942-40dc-8076-c800283d78ac None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:48.714050 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aecbe-a942-40dc-8076-c800283d78ac None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:48.714050 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aecbe-a942-40dc-8076-c800283d78ac None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:48.715790 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 686/1363] 10.222.0.32 () {54 vars in 911 bytes} [Wed Sep 15 02:23:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:23:48.721439 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d95bd4-baf7-4c4b-b990-ec73455512c9 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:48.721858 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d95bd4-baf7-4c4b-b990-ec73455512c9 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:48.722019 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d95bd4-baf7-4c4b-b990-ec73455512c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:48.740758 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-58d95bd4-baf7-4c4b-b990-ec73455512c9 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:48.741967 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-58d95bd4-baf7-4c4b-b990-ec73455512c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:48.749710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 678/1364] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Sep 15 02:23:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:23:48.899965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0aecbe-a942-40dc-8076-c800283d78ac None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:48.914496 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0aecbe-a942-40dc-8076-c800283d78ac None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:48.919845 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453b7ea-8130-46c3-a6f8-02687f0af945 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:48.920474 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453b7ea-8130-46c3-a6f8-02687f0af945 service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:48.920756 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453b7ea-8130-46c3-a6f8-02687f0af945 service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:48.921064 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453b7ea-8130-46c3-a6f8-02687f0af945 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:48.929469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4453b7ea-8130-46c3-a6f8-02687f0af945 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:48.931047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4453b7ea-8130-46c3-a6f8-02687f0af945 service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:48.940324 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 687/1365] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:23:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:23:50.310088 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60105c-d9ad-419d-8b9e-b653a9a66c21 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:50.310671 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60105c-d9ad-419d-8b9e-b653a9a66c21 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:50.310671 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60105c-d9ad-419d-8b9e-b653a9a66c21 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:50.312430 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 679/1366] 10.222.0.32 () {54 vars in 911 bytes} [Wed Sep 15 02:23:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:50.318116 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5b611-0a8a-4c10-93e0-e28fbb0477cd None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:50.318546 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5b611-0a8a-4c10-93e0-e28fbb0477cd None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:50.318665 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5b611-0a8a-4c10-93e0-e28fbb0477cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:50.336046 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-95b5b611-0a8a-4c10-93e0-e28fbb0477cd None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:50.337262 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-95b5b611-0a8a-4c10-93e0-e28fbb0477cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:50.344851 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 688/1367] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Sep 15 02:23:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:23:50.497548 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60105c-d9ad-419d-8b9e-b653a9a66c21 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:50.511439 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60105c-d9ad-419d-8b9e-b653a9a66c21 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:50.516849 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365d7c1-06dc-45a1-8946-a26931264053 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:50.517508 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365d7c1-06dc-45a1-8946-a26931264053 service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:50.517792 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365d7c1-06dc-45a1-8946-a26931264053 service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:50.518069 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365d7c1-06dc-45a1-8946-a26931264053 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:50.526406 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365d7c1-06dc-45a1-8946-a26931264053 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:50.527967 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365d7c1-06dc-45a1-8946-a26931264053 service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:50.537573 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 680/1368] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:23:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:23:51.908825 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb138a65-c897-441d-8bba-60d44aaba434 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:51.909405 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb138a65-c897-441d-8bba-60d44aaba434 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:51.909405 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb138a65-c897-441d-8bba-60d44aaba434 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:51.911223 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 689/1369] 10.222.0.32 () {54 vars in 911 bytes} [Wed Sep 15 02:23:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:51.916670 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5831bb5-6535-4ddc-bbaa-1fe2805417a2 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:51.917098 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5831bb5-6535-4ddc-bbaa-1fe2805417a2 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:51.917286 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5831bb5-6535-4ddc-bbaa-1fe2805417a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:51.934720 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-b5831bb5-6535-4ddc-bbaa-1fe2805417a2 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:51.935902 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b5831bb5-6535-4ddc-bbaa-1fe2805417a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:51.944199 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 681/1370] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Sep 15 02:23:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:23:52.096348 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb138a65-c897-441d-8bba-60d44aaba434 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:52.110450 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb138a65-c897-441d-8bba-60d44aaba434 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:52.116196 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03390e-2b8c-4ed3-90ed-35d7d2bb3172 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:52.116849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03390e-2b8c-4ed3-90ed-35d7d2bb3172 service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:52.117156 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03390e-2b8c-4ed3-90ed-35d7d2bb3172 service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:52.117464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03390e-2b8c-4ed3-90ed-35d7d2bb3172 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:52.125174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03390e-2b8c-4ed3-90ed-35d7d2bb3172 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:52.126732 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03390e-2b8c-4ed3-90ed-35d7d2bb3172 service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:52.136254 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 690/1371] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:23:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:23:53.456725 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bc330-a8b9-4408-a7a5-8f2e397c5734 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:53.457356 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bc330-a8b9-4408-a7a5-8f2e397c5734 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:53.457356 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bc330-a8b9-4408-a7a5-8f2e397c5734 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:53.459121 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 682/1372] 10.222.0.32 () {54 vars in 911 bytes} [Wed Sep 15 02:23:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:53.464603 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c51830-5a01-4974-96a9-0f2e4666a79f None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:53.465061 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c51830-5a01-4974-96a9-0f2e4666a79f None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:53.465263 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c51830-5a01-4974-96a9-0f2e4666a79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:53.483636 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-35c51830-5a01-4974-96a9-0f2e4666a79f None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:53.484824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-35c51830-5a01-4974-96a9-0f2e4666a79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:53.493267 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 691/1373] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Sep 15 02:23:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:23:53.646188 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bc330-a8b9-4408-a7a5-8f2e397c5734 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:53.660111 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bc330-a8b9-4408-a7a5-8f2e397c5734 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:53.665449 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347844f1-ab30-4d65-a97c-06852c616999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:53.666077 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347844f1-ab30-4d65-a97c-06852c616999 service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:53.666356 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347844f1-ab30-4d65-a97c-06852c616999 service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:53.666628 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347844f1-ab30-4d65-a97c-06852c616999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:53.674370 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347844f1-ab30-4d65-a97c-06852c616999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:53.676578 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347844f1-ab30-4d65-a97c-06852c616999 service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:53.685667 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 683/1374] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:23:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:23:55.010084 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463d7e3-c53d-478e-8d4a-76c2195a4950 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:55.010658 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463d7e3-c53d-478e-8d4a-76c2195a4950 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:55.010658 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463d7e3-c53d-478e-8d4a-76c2195a4950 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:55.012406 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 692/1375] 10.222.0.32 () {54 vars in 911 bytes} [Wed Sep 15 02:23:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:55.017998 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdc1e8-bcb4-45c5-84a9-a67680a9ab70 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:55.018441 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdc1e8-bcb4-45c5-84a9-a67680a9ab70 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:55.021751 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdc1e8-bcb4-45c5-84a9-a67680a9ab70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:55.038948 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-d9cdc1e8-bcb4-45c5-84a9-a67680a9ab70 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:55.040133 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-d9cdc1e8-bcb4-45c5-84a9-a67680a9ab70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:55.047872 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 684/1376] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Sep 15 02:23:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:23:55.202458 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463d7e3-c53d-478e-8d4a-76c2195a4950 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:55.216253 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463d7e3-c53d-478e-8d4a-76c2195a4950 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:55.221525 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a644a37-9ab5-4d2c-a5ce-a964b63f1371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:55.222149 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a644a37-9ab5-4d2c-a5ce-a964b63f1371 service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:55.222431 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a644a37-9ab5-4d2c-a5ce-a964b63f1371 service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:55.222708 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a644a37-9ab5-4d2c-a5ce-a964b63f1371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:55.230671 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a644a37-9ab5-4d2c-a5ce-a964b63f1371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:55.232232 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a644a37-9ab5-4d2c-a5ce-a964b63f1371 service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:55.241760 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 693/1377] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:23:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:23:56.548526 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fc29d-01fe-4380-91d1-e2aa113278f2 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:56.549081 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fc29d-01fe-4380-91d1-e2aa113278f2 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:56.549171 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083fc29d-01fe-4380-91d1-e2aa113278f2 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:56.551416 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 685/1378] 10.222.0.32 () {54 vars in 911 bytes} [Wed Sep 15 02:23:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:56.557148 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f731f-7662-432a-b871-5af22b6a2f9e None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:56.557554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f731f-7662-432a-b871-5af22b6a2f9e None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:56.557759 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f731f-7662-432a-b871-5af22b6a2f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:56.575490 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-085f731f-7662-432a-b871-5af22b6a2f9e None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:56.576672 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-085f731f-7662-432a-b871-5af22b6a2f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:56.584462 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 694/1379] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Sep 15 02:23:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:23:56.738485 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fc29d-01fe-4380-91d1-e2aa113278f2 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:56.752208 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083fc29d-01fe-4380-91d1-e2aa113278f2 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:56.758133 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ef30c-4ad5-4309-bf53-ce2f83b33fd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:56.758758 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ef30c-4ad5-4309-bf53-ce2f83b33fd1 service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:56.759036 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ef30c-4ad5-4309-bf53-ce2f83b33fd1 service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:56.759303 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ef30c-4ad5-4309-bf53-ce2f83b33fd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:56.766973 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ef30c-4ad5-4309-bf53-ce2f83b33fd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:56.768544 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ef30c-4ad5-4309-bf53-ce2f83b33fd1 service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:56.777553 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 686/1380] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:23:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:23:58.104209 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9cf94-d149-4cbf-a01d-f84ddbf659ac None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:58.104761 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9cf94-d149-4cbf-a01d-f84ddbf659ac None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:58.104761 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9cf94-d149-4cbf-a01d-f84ddbf659ac None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:58.106582 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 695/1381] 10.222.0.32 () {54 vars in 911 bytes} [Wed Sep 15 02:23:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:23:58.112191 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02271bb-12fe-41c6-8923-e026e7dd8389 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:58.112619 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02271bb-12fe-41c6-8923-e026e7dd8389 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:58.112823 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02271bb-12fe-41c6-8923-e026e7dd8389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:58.130402 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-f02271bb-12fe-41c6-8923-e026e7dd8389 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:23:58.131604 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-f02271bb-12fe-41c6-8923-e026e7dd8389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:23:58.139954 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 687/1382] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Sep 15 02:23:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:23:58.292179 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9cf94-d149-4cbf-a01d-f84ddbf659ac None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:23:58.306077 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9cf94-d149-4cbf-a01d-f84ddbf659ac None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:23:58.311442 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbffeec-edb5-46eb-8518-18eb5f733cab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:23:58.312072 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbffeec-edb5-46eb-8518-18eb5f733cab service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:23:58.312354 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbffeec-edb5-46eb-8518-18eb5f733cab service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:23:58.312630 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbffeec-edb5-46eb-8518-18eb5f733cab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:23:58.320499 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbffeec-edb5-46eb-8518-18eb5f733cab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:23:58.322162 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbffeec-edb5-46eb-8518-18eb5f733cab service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:23:58.331286 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 696/1383] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:23:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:24:00.372124 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddfa34-a646-44a1-b42c-b7a0a5473e7d None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:00.372675 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddfa34-a646-44a1-b42c-b7a0a5473e7d None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:00.372675 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddfa34-a646-44a1-b42c-b7a0a5473e7d None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:00.374459 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 688/1384] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:24:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:24:00.382178 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2557a94-9b7f-4c9b-a96a-58b0975eed7f None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:00.382627 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2557a94-9b7f-4c9b-a96a-58b0975eed7f None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:00.382773 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2557a94-9b7f-4c9b-a96a-58b0975eed7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:00.400114 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-a2557a94-9b7f-4c9b-a96a-58b0975eed7f None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:24:00.401329 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-a2557a94-9b7f-4c9b-a96a-58b0975eed7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:24:00.409499 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 697/1385] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:24:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:24:00.449362 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddfa34-a646-44a1-b42c-b7a0a5473e7d None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:24:00.459731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddfa34-a646-44a1-b42c-b7a0a5473e7d None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:24:00.463217 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c05e92-223b-41d5-af21-7c4f38f58118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:24:00.463839 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c05e92-223b-41d5-af21-7c4f38f58118 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:00.464119 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c05e92-223b-41d5-af21-7c4f38f58118 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:00.464394 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c05e92-223b-41d5-af21-7c4f38f58118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:00.473248 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c05e92-223b-41d5-af21-7c4f38f58118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:24:00.474668 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c05e92-223b-41d5-af21-7c4f38f58118 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:24:00.484174 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 689/1386] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:24:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:24:02.758198 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22dbb1-87ef-41b6-8a4d-15b2ea67ce3c None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:02.758757 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22dbb1-87ef-41b6-8a4d-15b2ea67ce3c None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:02.758757 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22dbb1-87ef-41b6-8a4d-15b2ea67ce3c None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:02.760454 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 698/1387] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:24:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:24:02.767593 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe8296-5f9c-4d78-8091-076c286a1e24 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:02.768026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe8296-5f9c-4d78-8091-076c286a1e24 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:02.768151 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe8296-5f9c-4d78-8091-076c286a1e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:02.786538 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-73fe8296-5f9c-4d78-8091-076c286a1e24 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:24:02.787717 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-73fe8296-5f9c-4d78-8091-076c286a1e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:24:02.795459 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 690/1388] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:24:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:24:02.834227 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22dbb1-87ef-41b6-8a4d-15b2ea67ce3c None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:24:02.844538 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22dbb1-87ef-41b6-8a4d-15b2ea67ce3c None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:24:02.848374 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70242cd8-748e-4b2c-930b-dc6b3d510272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:24:02.849051 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70242cd8-748e-4b2c-930b-dc6b3d510272 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:02.849335 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70242cd8-748e-4b2c-930b-dc6b3d510272 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:02.849610 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70242cd8-748e-4b2c-930b-dc6b3d510272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:02.858564 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70242cd8-748e-4b2c-930b-dc6b3d510272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:24:02.859989 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70242cd8-748e-4b2c-930b-dc6b3d510272 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:24:02.869481 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 699/1389] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:24:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:24:05.309482 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c1294-904e-4028-a946-bdaaa3f9018a None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:05.310064 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c1294-904e-4028-a946-bdaaa3f9018a None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:05.310064 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c1294-904e-4028-a946-bdaaa3f9018a None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:05.311819 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 691/1390] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:24:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:24:05.319017 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8d0f1-056a-424b-96ef-2f1d0830ea97 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:05.319446 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8d0f1-056a-424b-96ef-2f1d0830ea97 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:05.319575 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8d0f1-056a-424b-96ef-2f1d0830ea97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:05.336867 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-8bc8d0f1-056a-424b-96ef-2f1d0830ea97 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:24:05.338090 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-8bc8d0f1-056a-424b-96ef-2f1d0830ea97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:24:05.345870 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 700/1391] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:24:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:24:05.386334 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c1294-904e-4028-a946-bdaaa3f9018a None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:24:05.396662 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c1294-904e-4028-a946-bdaaa3f9018a None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:24:05.400114 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b1749-3d9c-4888-a7b6-90bbcabcf739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:24:05.400737 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b1749-3d9c-4888-a7b6-90bbcabcf739 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:05.401051 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b1749-3d9c-4888-a7b6-90bbcabcf739 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:05.401322 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b1749-3d9c-4888-a7b6-90bbcabcf739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:05.410252 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b1749-3d9c-4888-a7b6-90bbcabcf739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:24:05.411652 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b1749-3d9c-4888-a7b6-90bbcabcf739 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:24:05.420680 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 692/1392] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:24:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:24:07.684561 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8dede-c20e-463a-903b-60ec57b48388 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:07.685153 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8dede-c20e-463a-903b-60ec57b48388 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:07.685153 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e8dede-c20e-463a-903b-60ec57b48388 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:07.686980 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 701/1393] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:24:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:24:07.694529 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbd59e-93bb-4d07-8783-c6734205346f None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:07.694973 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbd59e-93bb-4d07-8783-c6734205346f None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:07.695115 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dbd59e-93bb-4d07-8783-c6734205346f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:07.712856 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-40dbd59e-93bb-4d07-8783-c6734205346f None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:24:07.714058 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-40dbd59e-93bb-4d07-8783-c6734205346f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:24:07.721745 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 693/1394] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:24:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:24:07.761090 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8dede-c20e-463a-903b-60ec57b48388 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:24:07.772268 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e8dede-c20e-463a-903b-60ec57b48388 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:24:07.775859 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c7599-f7bc-41fa-a0ec-02d51b7852d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:24:07.776492 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c7599-f7bc-41fa-a0ec-02d51b7852d5 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:07.776775 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c7599-f7bc-41fa-a0ec-02d51b7852d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:07.777081 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c7599-f7bc-41fa-a0ec-02d51b7852d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:07.785848 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c7599-f7bc-41fa-a0ec-02d51b7852d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:24:07.787304 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c7599-f7bc-41fa-a0ec-02d51b7852d5 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:24:07.796338 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 702/1395] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:24:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:24:09.991070 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158db2f0-d80e-4b1e-8d24-7e2b26889d8b None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:09.991676 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158db2f0-d80e-4b1e-8d24-7e2b26889d8b None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:09.991676 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158db2f0-d80e-4b1e-8d24-7e2b26889d8b None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:09.993433 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 694/1396] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:24:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:24:10.000544 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7858e2-53f6-43e4-8ee8-c25efd218810 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:10.001046 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7858e2-53f6-43e4-8ee8-c25efd218810 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:10.001148 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7858e2-53f6-43e4-8ee8-c25efd218810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:10.018246 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-db7858e2-53f6-43e4-8ee8-c25efd218810 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:24:10.019970 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-db7858e2-53f6-43e4-8ee8-c25efd218810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:24:10.027538 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 703/1397] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:24:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:24:10.066151 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158db2f0-d80e-4b1e-8d24-7e2b26889d8b None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:24:10.076398 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158db2f0-d80e-4b1e-8d24-7e2b26889d8b None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:24:10.079853 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310eb34-ec04-4c19-92fc-3fc4ddce7917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:24:10.080479 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310eb34-ec04-4c19-92fc-3fc4ddce7917 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:10.080765 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310eb34-ec04-4c19-92fc-3fc4ddce7917 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:10.081580 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310eb34-ec04-4c19-92fc-3fc4ddce7917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:10.090092 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310eb34-ec04-4c19-92fc-3fc4ddce7917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:24:10.091507 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310eb34-ec04-4c19-92fc-3fc4ddce7917 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:24:10.101676 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 695/1398] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:24:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:24:12.301162 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0f92e-04f1-4729-a365-78132bc801bc None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:12.301703 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0f92e-04f1-4729-a365-78132bc801bc None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:12.301703 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0f92e-04f1-4729-a365-78132bc801bc None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:12.303453 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 704/1399] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:24:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:24:12.310696 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea83f52-102a-4f34-a4c8-cf64d2d4c473 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:12.311140 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea83f52-102a-4f34-a4c8-cf64d2d4c473 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:12.311251 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea83f52-102a-4f34-a4c8-cf64d2d4c473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:12.328931 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-3ea83f52-102a-4f34-a4c8-cf64d2d4c473 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:24:12.330115 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-3ea83f52-102a-4f34-a4c8-cf64d2d4c473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:24:12.337787 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 696/1400] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:24:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:24:12.375424 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0f92e-04f1-4729-a365-78132bc801bc None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:24:12.386386 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0f92e-04f1-4729-a365-78132bc801bc None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:24:12.389950 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c4387-ace6-49d9-b892-5eaefb8047c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:24:12.390580 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c4387-ace6-49d9-b892-5eaefb8047c5 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:12.390861 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c4387-ace6-49d9-b892-5eaefb8047c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:12.391136 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c4387-ace6-49d9-b892-5eaefb8047c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:12.399740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c4387-ace6-49d9-b892-5eaefb8047c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:24:12.401200 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c4387-ace6-49d9-b892-5eaefb8047c5 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:24:12.410336 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 705/1401] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:24:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:24:14.591913 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aa735-bffb-4c37-b319-5cdd667fa575 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:14.592488 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aa735-bffb-4c37-b319-5cdd667fa575 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:14.592488 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199aa735-bffb-4c37-b319-5cdd667fa575 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:14.594261 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 697/1402] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:24:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:24:14.601520 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d80a9-2394-444c-a088-ceba72b86672 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:14.601949 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d80a9-2394-444c-a088-ceba72b86672 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:14.602079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d80a9-2394-444c-a088-ceba72b86672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:14.620632 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-3c7d80a9-2394-444c-a088-ceba72b86672 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:24:14.621854 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-3c7d80a9-2394-444c-a088-ceba72b86672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:24:14.630107 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 706/1403] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:24:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:24:14.666641 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199aa735-bffb-4c37-b319-5cdd667fa575 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:24:14.677398 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199aa735-bffb-4c37-b319-5cdd667fa575 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:24:14.680827 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceba5bf-655f-4a36-8f24-3b9b8a056a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:24:14.681506 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceba5bf-655f-4a36-8f24-3b9b8a056a65 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:14.681791 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceba5bf-655f-4a36-8f24-3b9b8a056a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:14.682064 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceba5bf-655f-4a36-8f24-3b9b8a056a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:14.691185 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceba5bf-655f-4a36-8f24-3b9b8a056a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:24:14.692592 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceba5bf-655f-4a36-8f24-3b9b8a056a65 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:24:14.701674 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 698/1404] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:24:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:24:16.886523 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf122d0f-aead-4ab4-a4e3-bcaaac6b7053 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:16.887078 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf122d0f-aead-4ab4-a4e3-bcaaac6b7053 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:16.887078 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf122d0f-aead-4ab4-a4e3-bcaaac6b7053 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:16.888893 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 707/1405] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:24:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:24:16.895767 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8c531-90d2-449c-9244-22d8ad022c25 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:16.896227 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8c531-90d2-449c-9244-22d8ad022c25 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:16.896347 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8c531-90d2-449c-9244-22d8ad022c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:16.913514 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-b8e8c531-90d2-449c-9244-22d8ad022c25 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:24:16.914690 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b8e8c531-90d2-449c-9244-22d8ad022c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:24:16.922300 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 699/1406] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:24:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:24:16.960173 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf122d0f-aead-4ab4-a4e3-bcaaac6b7053 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:24:16.970545 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf122d0f-aead-4ab4-a4e3-bcaaac6b7053 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:24:16.974144 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25fd7f-f2c7-4512-aa61-265a14ed4b8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:24:16.974772 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25fd7f-f2c7-4512-aa61-265a14ed4b8a service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:16.975053 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25fd7f-f2c7-4512-aa61-265a14ed4b8a service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:16.975331 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25fd7f-f2c7-4512-aa61-265a14ed4b8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:16.985707 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25fd7f-f2c7-4512-aa61-265a14ed4b8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:24:16.987657 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25fd7f-f2c7-4512-aa61-265a14ed4b8a service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:24:16.996769 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 708/1407] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:24:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:24:19.153448 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe8c29-6270-474a-94c4-4af1e23b9e4a None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:19.154038 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe8c29-6270-474a-94c4-4af1e23b9e4a None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:19.154038 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe8c29-6270-474a-94c4-4af1e23b9e4a None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:19.155806 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 700/1408] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:24:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:24:19.163653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c79be0-e6da-448d-8d50-2200cbd43004 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:19.164258 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c79be0-e6da-448d-8d50-2200cbd43004 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:19.164258 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c79be0-e6da-448d-8d50-2200cbd43004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:19.181591 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-b9c79be0-e6da-448d-8d50-2200cbd43004 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:24:19.182786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b9c79be0-e6da-448d-8d50-2200cbd43004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:24:19.190667 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 709/1409] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:24:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:24:19.229505 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe8c29-6270-474a-94c4-4af1e23b9e4a None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:24:19.239936 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe8c29-6270-474a-94c4-4af1e23b9e4a None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:24:19.243684 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc6538-e5a4-47f0-862e-dadfd97a2df9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:24:19.244327 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc6538-e5a4-47f0-862e-dadfd97a2df9 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:19.244609 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc6538-e5a4-47f0-862e-dadfd97a2df9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:19.244901 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc6538-e5a4-47f0-862e-dadfd97a2df9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:19.253546 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc6538-e5a4-47f0-862e-dadfd97a2df9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:24:19.254946 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc6538-e5a4-47f0-862e-dadfd97a2df9 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:24:19.263953 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 701/1410] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:24:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:24:21.386817 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32629486-a003-4e29-bb83-c45a84a10291 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:21.387398 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32629486-a003-4e29-bb83-c45a84a10291 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:21.387398 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32629486-a003-4e29-bb83-c45a84a10291 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:21.389162 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 710/1411] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:24:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:24:21.396189 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450175e-e688-4c16-b1f7-b496a77430be None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:21.396631 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450175e-e688-4c16-b1f7-b496a77430be None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:21.396739 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450175e-e688-4c16-b1f7-b496a77430be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:21.414220 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-a450175e-e688-4c16-b1f7-b496a77430be None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:24:21.415404 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a450175e-e688-4c16-b1f7-b496a77430be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:24:21.423025 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 702/1412] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:24:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:24:21.459831 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32629486-a003-4e29-bb83-c45a84a10291 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:24:21.470277 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32629486-a003-4e29-bb83-c45a84a10291 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:24:21.473826 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc493cb4-553b-4072-974c-8ba18a1527e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:24:21.474464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc493cb4-553b-4072-974c-8ba18a1527e2 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:21.474747 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc493cb4-553b-4072-974c-8ba18a1527e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:21.475021 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc493cb4-553b-4072-974c-8ba18a1527e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:21.484315 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc493cb4-553b-4072-974c-8ba18a1527e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:24:21.485776 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc493cb4-553b-4072-974c-8ba18a1527e2 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:24:21.495329 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 711/1413] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:24:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:24:37.942486 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020653f-5340-4a3d-985d-e3ea5c68d1ab None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:37.943123 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020653f-5340-4a3d-985d-e3ea5c68d1ab None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:37.943123 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020653f-5340-4a3d-985d-e3ea5c68d1ab None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:37.944815 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 703/1414] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:24:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:24:37.950816 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe2433-3773-4f77-9ee5-8323cbcf61de None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:37.951262 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe2433-3773-4f77-9ee5-8323cbcf61de None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:37.951365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe2433-3773-4f77-9ee5-8323cbcf61de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:37.969306 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-dcbe2433-3773-4f77-9ee5-8323cbcf61de None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:24:37.970490 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-dcbe2433-3773-4f77-9ee5-8323cbcf61de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:24:37.979049 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 712/1415] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:24:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:24:38.026545 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6004f07-dcd3-4e23-867d-f5806234ee1a None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:38.026837 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6004f07-dcd3-4e23-867d-f5806234ee1a None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:38.027118 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6004f07-dcd3-4e23-867d-f5806234ee1a None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:38.028858 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 704/1416] 10.222.0.32 () {54 vars in 966 bytes} [Wed Sep 15 02:24:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:24:38.034438 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc57f9-cab9-446f-99b8-c4b6d112af53 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:38.034729 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc57f9-cab9-446f-99b8-c4b6d112af53 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:38.035009 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc57f9-cab9-446f-99b8-c4b6d112af53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:38.052565 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-16fc57f9-cab9-446f-99b8-c4b6d112af53 None None] MFA Rules not processed for user `a71d661d14d94fa597aee037599de7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:24:38.053756 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-16fc57f9-cab9-446f-99b8-c4b6d112af53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:24:38.059990 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 713/1417] 10.222.0.32 () {58 vars in 1064 bytes} [Wed Sep 15 02:24:38 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:24:38.067333 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6004f07-dcd3-4e23-867d-f5806234ee1a None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:24:38.077518 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6004f07-dcd3-4e23-867d-f5806234ee1a None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:24:38.081519 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434df59-b40b-4900-851f-7ea736a336d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d661d14d94fa597aee037599de7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:24:38.082132 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434df59-b40b-4900-851f-7ea736a336d5 service glance] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:38.082412 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434df59-b40b-4900-851f-7ea736a336d5 service glance] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:38.082686 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434df59-b40b-4900-851f-7ea736a336d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:38.091192 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434df59-b40b-4900-851f-7ea736a336d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:24:38.092605 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434df59-b40b-4900-851f-7ea736a336d5 service glance] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:24:38.102496 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 705/1418] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:24:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:24:40.348991 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bad4ad-3d6d-4409-93c1-3a33e89d60d5 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:40.349587 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bad4ad-3d6d-4409-93c1-3a33e89d60d5 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:40.349587 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bad4ad-3d6d-4409-93c1-3a33e89d60d5 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:40.351630 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 714/1419] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:24:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:24:40.358546 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891c3ce-11bc-43fc-ac31-5a3698b871ff None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:40.358992 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891c3ce-11bc-43fc-ac31-5a3698b871ff None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:40.359098 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891c3ce-11bc-43fc-ac31-5a3698b871ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:40.376559 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-d891c3ce-11bc-43fc-ac31-5a3698b871ff None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:24:40.378379 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-d891c3ce-11bc-43fc-ac31-5a3698b871ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:24:40.385937 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 706/1420] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:24:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:24:40.410421 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bad4ad-3d6d-4409-93c1-3a33e89d60d5 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:24:40.422627 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bad4ad-3d6d-4409-93c1-3a33e89d60d5 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:24:40.427747 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df250df-7fff-4306-8cca-2a9feb377f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:24:40.428387 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df250df-7fff-4306-8cca-2a9feb377f12 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:40.428673 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df250df-7fff-4306-8cca-2a9feb377f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:40.428984 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df250df-7fff-4306-8cca-2a9feb377f12 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:40.429718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df250df-7fff-4306-8cca-2a9feb377f12 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:24:40.431591 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df250df-7fff-4306-8cca-2a9feb377f12 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:24:40.444785 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 715/1421] 10.222.0.32 () {56 vars in 1109 bytes} [Wed Sep 15 02:24:40 2021] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:24:42.595347 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4342955-1613-47f4-a147-538d920634be None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:42.595928 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4342955-1613-47f4-a147-538d920634be None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:42.595928 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4342955-1613-47f4-a147-538d920634be None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:42.597759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 707/1422] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:24:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:24:42.605182 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806d8e5-834a-4e84-b850-39a1cff882dc None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:42.605653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806d8e5-834a-4e84-b850-39a1cff882dc None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:42.605781 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806d8e5-834a-4e84-b850-39a1cff882dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:42.623754 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-b806d8e5-834a-4e84-b850-39a1cff882dc None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:24:42.625041 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b806d8e5-834a-4e84-b850-39a1cff882dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:24:42.633488 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 716/1423] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:24:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:24:42.676788 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4342955-1613-47f4-a147-538d920634be None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:24:42.690719 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4342955-1613-47f4-a147-538d920634be None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:24:42.696070 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c577612-7a38-4553-9ad5-8f2757d64c86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:24:42.696694 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c577612-7a38-4553-9ad5-8f2757d64c86 service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:42.697009 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c577612-7a38-4553-9ad5-8f2757d64c86 service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:42.697286 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c577612-7a38-4553-9ad5-8f2757d64c86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:42.705011 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c577612-7a38-4553-9ad5-8f2757d64c86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:24:42.706586 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c577612-7a38-4553-9ad5-8f2757d64c86 service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:24:42.715631 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 708/1424] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:24:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:24:45.034144 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b363ab-9c00-4627-b1a2-18cf1d4b220a None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:45.034742 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b363ab-9c00-4627-b1a2-18cf1d4b220a None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:45.034949 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b363ab-9c00-4627-b1a2-18cf1d4b220a None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:45.036761 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 717/1425] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:24:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:24:45.044122 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92bf1b-4b90-4c59-a1b2-997ca58dc4a2 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:45.044660 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92bf1b-4b90-4c59-a1b2-997ca58dc4a2 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:45.044967 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92bf1b-4b90-4c59-a1b2-997ca58dc4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:45.062289 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-9a92bf1b-4b90-4c59-a1b2-997ca58dc4a2 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:24:45.063456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-9a92bf1b-4b90-4c59-a1b2-997ca58dc4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:24:45.071696 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 709/1426] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:24:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:24:45.109282 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b363ab-9c00-4627-b1a2-18cf1d4b220a None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:24:45.119835 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b363ab-9c00-4627-b1a2-18cf1d4b220a None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:24:45.123420 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc3c63-40c1-4461-b59c-384b4c399aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:24:45.124054 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc3c63-40c1-4461-b59c-384b4c399aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:45.124332 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc3c63-40c1-4461-b59c-384b4c399aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:45.124605 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc3c63-40c1-4461-b59c-384b4c399aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:45.133721 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc3c63-40c1-4461-b59c-384b4c399aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:24:45.135145 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc3c63-40c1-4461-b59c-384b4c399aa4 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:24:45.144808 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 718/1427] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:24:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:24:47.326820 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98fe29-357f-49a1-bf52-ed0d4beeb5b6 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:47.327404 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98fe29-357f-49a1-bf52-ed0d4beeb5b6 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:47.327404 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98fe29-357f-49a1-bf52-ed0d4beeb5b6 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:47.329161 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 710/1428] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:24:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:24:47.336669 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f117b35-bba9-4948-89de-937a941f4e0d None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:47.337144 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f117b35-bba9-4948-89de-937a941f4e0d None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:47.337249 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f117b35-bba9-4948-89de-937a941f4e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:47.354641 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-2f117b35-bba9-4948-89de-937a941f4e0d None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:24:47.355847 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-2f117b35-bba9-4948-89de-937a941f4e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:24:47.363570 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 719/1429] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:24:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:24:47.402319 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98fe29-357f-49a1-bf52-ed0d4beeb5b6 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:24:47.412475 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98fe29-357f-49a1-bf52-ed0d4beeb5b6 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:24:47.416059 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e058ed5-dacd-4a49-896f-7475ca07b7c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:24:47.416678 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e058ed5-dacd-4a49-896f-7475ca07b7c8 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:47.416995 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e058ed5-dacd-4a49-896f-7475ca07b7c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:47.417266 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e058ed5-dacd-4a49-896f-7475ca07b7c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:47.425762 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e058ed5-dacd-4a49-896f-7475ca07b7c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:24:47.427159 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e058ed5-dacd-4a49-896f-7475ca07b7c8 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:24:47.436083 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 711/1430] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:24:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:24:49.713573 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bcd17-9698-4038-8cd4-31e971dce993 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:49.714150 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bcd17-9698-4038-8cd4-31e971dce993 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:49.714150 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3bcd17-9698-4038-8cd4-31e971dce993 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:49.715945 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 720/1431] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:24:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:24:49.723348 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dd79e-c98b-43aa-b30f-76125a65cb1b None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:49.723818 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dd79e-c98b-43aa-b30f-76125a65cb1b None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:49.723942 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dd79e-c98b-43aa-b30f-76125a65cb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:49.742127 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-c02dd79e-c98b-43aa-b30f-76125a65cb1b None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:24:49.743232 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c02dd79e-c98b-43aa-b30f-76125a65cb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:24:49.750770 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 712/1432] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:24:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:24:49.792294 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bcd17-9698-4038-8cd4-31e971dce993 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:24:49.802975 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3bcd17-9698-4038-8cd4-31e971dce993 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:24:49.806488 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde00878-385e-4f82-96ca-7cfed94ce251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:24:49.807116 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde00878-385e-4f82-96ca-7cfed94ce251 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:49.807400 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde00878-385e-4f82-96ca-7cfed94ce251 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:49.807676 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde00878-385e-4f82-96ca-7cfed94ce251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:49.816255 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde00878-385e-4f82-96ca-7cfed94ce251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:24:49.817699 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde00878-385e-4f82-96ca-7cfed94ce251 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:24:49.826759 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 721/1433] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:24:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:24:52.143304 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b3d8d-3430-46ac-8313-a0dfdfd6bb15 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:52.143885 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b3d8d-3430-46ac-8313-a0dfdfd6bb15 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:52.143885 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b3d8d-3430-46ac-8313-a0dfdfd6bb15 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:52.145644 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 713/1434] 10.222.0.32 () {54 vars in 926 bytes} [Wed Sep 15 02:24:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:24:52.152966 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47856d-4d4e-4286-8483-a9e5a5c55b77 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:52.153369 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47856d-4d4e-4286-8483-a9e5a5c55b77 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:52.153519 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47856d-4d4e-4286-8483-a9e5a5c55b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:52.170511 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-0d47856d-4d4e-4286-8483-a9e5a5c55b77 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:24:52.171687 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-0d47856d-4d4e-4286-8483-a9e5a5c55b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:24:52.179799 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 722/1435] 10.222.0.32 () {58 vars in 1024 bytes} [Wed Sep 15 02:24:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:24:52.219602 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b3d8d-3430-46ac-8313-a0dfdfd6bb15 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:24:52.230209 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b3d8d-3430-46ac-8313-a0dfdfd6bb15 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:24:52.233767 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b9e6f-e4ab-435d-a155-e53187ec8fc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:24:52.234397 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b9e6f-e4ab-435d-a155-e53187ec8fc0 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:24:52.234679 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b9e6f-e4ab-435d-a155-e53187ec8fc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:24:52.234958 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b9e6f-e4ab-435d-a155-e53187ec8fc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:24:52.243954 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b9e6f-e4ab-435d-a155-e53187ec8fc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:24:52.245396 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b9e6f-e4ab-435d-a155-e53187ec8fc0 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:24:52.254940 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 714/1436] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:24:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:25:59.479210 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935df79-5035-4dd5-a35a-61c67a235b53 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:25:59.479643 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935df79-5035-4dd5-a35a-61c67a235b53 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:25:59.479773 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935df79-5035-4dd5-a35a-61c67a235b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:25:59.497354 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-b935df79-5035-4dd5-a35a-61c67a235b53 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:25:59.498555 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b935df79-5035-4dd5-a35a-61c67a235b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:25:59.508469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 723/1437] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:25:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:25:59.517028 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b398c7f-7d44-4ecc-87cf-a4f83049c5cd None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:25:59.517553 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b398c7f-7d44-4ecc-87cf-a4f83049c5cd None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:25:59.517553 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b398c7f-7d44-4ecc-87cf-a4f83049c5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:25:59.534758 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-5b398c7f-7d44-4ecc-87cf-a4f83049c5cd None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:25:59.535918 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-5b398c7f-7d44-4ecc-87cf-a4f83049c5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:25:59.543497 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 715/1438] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:25:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:25:59.548430 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935df79-5035-4dd5-a35a-61c67a235b53 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:25:59.558122 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935df79-5035-4dd5-a35a-61c67a235b53 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:25:59.563496 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7f9e1-f67c-4596-a09b-4f1fe0f10f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:25:59.564143 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7f9e1-f67c-4596-a09b-4f1fe0f10f07 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:25:59.564421 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7f9e1-f67c-4596-a09b-4f1fe0f10f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:25:59.564695 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7f9e1-f67c-4596-a09b-4f1fe0f10f07 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:25:59.565438 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7f9e1-f67c-4596-a09b-4f1fe0f10f07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:25:59.565740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7f9e1-f67c-4596-a09b-4f1fe0f10f07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:25:59.567313 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7f9e1-f67c-4596-a09b-4f1fe0f10f07 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:25:59.578225 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 724/1439] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:25:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:25:59.585887 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b398c7f-7d44-4ecc-87cf-a4f83049c5cd None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:25:59.594544 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b398c7f-7d44-4ecc-87cf-a4f83049c5cd None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:25:59.599009 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f379f44-b21a-48e2-8edf-eb4d2b2be223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:25:59.599637 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f379f44-b21a-48e2-8edf-eb4d2b2be223 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:25:59.600171 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f379f44-b21a-48e2-8edf-eb4d2b2be223 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:25:59.600440 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f379f44-b21a-48e2-8edf-eb4d2b2be223 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:25:59.601153 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f379f44-b21a-48e2-8edf-eb4d2b2be223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:25:59.603039 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f379f44-b21a-48e2-8edf-eb4d2b2be223 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:25:59.637671 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 716/1440] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:25:59 2021] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:25:59.641863 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7f9e1-f67c-4596-a09b-4f1fe0f10f07 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:25:59.651572 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7f9e1-f67c-4596-a09b-4f1fe0f10f07 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:25:59.703935 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c50db-97c2-4821-9ed9-e37935d98dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:25:59.704586 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c50db-97c2-4821-9ed9-e37935d98dbe admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:25:59.704867 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c50db-97c2-4821-9ed9-e37935d98dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:25:59.705172 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c50db-97c2-4821-9ed9-e37935d98dbe admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:25:59.705846 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c50db-97c2-4821-9ed9-e37935d98dbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:25:59.707779 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c50db-97c2-4821-9ed9-e37935d98dbe admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:25:59.727638 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 725/1441] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:25:59 2021] POST /identity/v3/users => generated 289 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:25:59.731745 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f379f44-b21a-48e2-8edf-eb4d2b2be223 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:25:59.741928 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f379f44-b21a-48e2-8edf-eb4d2b2be223 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:25:59.746392 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0d25b-fd73-410e-83c1-136ba67d6889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:25:59.747036 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0d25b-fd73-410e-83c1-136ba67d6889 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:25:59.747314 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0d25b-fd73-410e-83c1-136ba67d6889 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:25:59.747583 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0d25b-fd73-410e-83c1-136ba67d6889 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:25:59.748293 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0d25b-fd73-410e-83c1-136ba67d6889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:25:59.749909 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0d25b-fd73-410e-83c1-136ba67d6889 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:25:59.763077 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 717/1442] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:25:59 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:25:59.766841 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c50db-97c2-4821-9ed9-e37935d98dbe admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:25:59.776343 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c50db-97c2-4821-9ed9-e37935d98dbe admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:25:59.780940 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5b82b-1cf0-405c-a903-f9adbb271b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:25:59.781595 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5b82b-1cf0-405c-a903-f9adbb271b8d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:25:59.781897 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5b82b-1cf0-405c-a903-f9adbb271b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:25:59.782164 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5b82b-1cf0-405c-a903-f9adbb271b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:25:59.782894 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5b82b-1cf0-405c-a903-f9adbb271b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:25:59.784483 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5b82b-1cf0-405c-a903-f9adbb271b8d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:25:59.797890 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 726/1443] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:25:59 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:25:59.801841 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0d25b-fd73-410e-83c1-136ba67d6889 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:25:59.811423 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0d25b-fd73-410e-83c1-136ba67d6889 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:25:59.816569 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fb4e1-0f15-4179-8dec-8736b89d95d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:25:59.817476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fb4e1-0f15-4179-8dec-8736b89d95d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:25:59.817762 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fb4e1-0f15-4179-8dec-8736b89d95d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:25:59.818038 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fb4e1-0f15-4179-8dec-8736b89d95d8 admin admin] PATH_INFO: `/v3/projects/eab5e02294764f7281d6d5f7325507be/users/3d7b5469b749470ca274c188867f4fea/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:25:59.831561 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fb4e1-0f15-4179-8dec-8736b89d95d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab5e02294764f7281d6d5f7325507be, user_id=3d7b5469b749470ca274c188867f4fea, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:25:59.834248 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9fb4e1-0f15-4179-8dec-8736b89d95d8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:25:59.846347 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 718/1444] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:25:59 2021] PUT /identity/v3/projects/eab5e02294764f7281d6d5f7325507be/users/3d7b5469b749470ca274c188867f4fea/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:25:59.858590 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46704b-3bee-4133-8769-14ddb97a4874 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:25:59.858884 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46704b-3bee-4133-8769-14ddb97a4874 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:25:59.859164 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46704b-3bee-4133-8769-14ddb97a4874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:25:59.884842 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-3e46704b-3bee-4133-8769-14ddb97a4874 None None] MFA Rules not processed for user `3d7b5469b749470ca274c188867f4fea`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:25:59.886060 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-3e46704b-3bee-4133-8769-14ddb97a4874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:25:59.950111 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 727/1445] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:25:59 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:25:59.961166 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fb4e1-0f15-4179-8dec-8736b89d95d8 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:26:00.027451 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9fb4e1-0f15-4179-8dec-8736b89d95d8 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:26:00.033295 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f706087-9672-4a9c-82c7-041adfd58cd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:26:00.033918 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f706087-9672-4a9c-82c7-041adfd58cd6 service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:26:00.034195 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f706087-9672-4a9c-82c7-041adfd58cd6 service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:26:00.034464 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f706087-9672-4a9c-82c7-041adfd58cd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:26:00.041792 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f706087-9672-4a9c-82c7-041adfd58cd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:26:00.043348 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f706087-9672-4a9c-82c7-041adfd58cd6 service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:26:00.052381 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 719/1446] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:25:59 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:26:00.118476 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7ed16-32e4-43cc-ba3b-ed30389e7096 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:26:00.118767 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7ed16-32e4-43cc-ba3b-ed30389e7096 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:26:00.119048 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7ed16-32e4-43cc-ba3b-ed30389e7096 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:26:00.120771 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 728/1447] 10.222.0.32 () {52 vars in 829 bytes} [Wed Sep 15 02:26:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:26:00.124211 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f706087-9672-4a9c-82c7-041adfd58cd6 service nova] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:26:00.182548 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f706087-9672-4a9c-82c7-041adfd58cd6 service nova] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:26:00.187015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b42cce-e7ee-43da-a853-9dde35a8aea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:26:00.187867 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b42cce-e7ee-43da-a853-9dde35a8aea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:26:00.188146 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b42cce-e7ee-43da-a853-9dde35a8aea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:26:00.188419 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b42cce-e7ee-43da-a853-9dde35a8aea1 admin admin] PATH_INFO: `/v3/users/3d7b5469b749470ca274c188867f4fea` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:26:00.189551 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b42cce-e7ee-43da-a853-9dde35a8aea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d7b5469b749470ca274c188867f4fea)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:26:00.190544 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING py.warnings [None req-38b42cce-e7ee-43da-a853-9dde35a8aea1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:26:00.190544 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: warnings.warn(msg) Sep 15 02:26:00.190544 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: Sep 15 02:26:00.191749 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b42cce-e7ee-43da-a853-9dde35a8aea1 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:26:00.254584 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-38b42cce-e7ee-43da-a853-9dde35a8aea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d7b5469b749470ca274c188867f4fea'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:26:00.255215 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-38b42cce-e7ee-43da-a853-9dde35a8aea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d7b5469b749470ca274c188867f4fea'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:26:00.264043 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-38b42cce-e7ee-43da-a853-9dde35a8aea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d7b5469b749470ca274c188867f4fea'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:26:00.264831 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-38b42cce-e7ee-43da-a853-9dde35a8aea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d7b5469b749470ca274c188867f4fea'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:26:00.284949 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-38b42cce-e7ee-43da-a853-9dde35a8aea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d7b5469b749470ca274c188867f4fea'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:26:00.301413 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 720/1448] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:26:00 2021] DELETE /identity/v3/users/3d7b5469b749470ca274c188867f4fea => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:26:00.305794 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fa195-8cdb-4fe9-b7b4-26713fc203f6 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:26:00.306079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fa195-8cdb-4fe9-b7b4-26713fc203f6 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:26:00.306354 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fa195-8cdb-4fe9-b7b4-26713fc203f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:26:00.324139 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-812fa195-8cdb-4fe9-b7b4-26713fc203f6 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:26:00.325437 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-812fa195-8cdb-4fe9-b7b4-26713fc203f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:26:00.381209 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 729/1449] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:26:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:26:00.392008 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b42cce-e7ee-43da-a853-9dde35a8aea1 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:26:00.393665 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-38b42cce-e7ee-43da-a853-9dde35a8aea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:26:00.446371 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b42cce-e7ee-43da-a853-9dde35a8aea1 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:26:00.449935 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccac573-3c53-4080-9e60-218cf79253d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:26:00.450567 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccac573-3c53-4080-9e60-218cf79253d5 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:26:00.450846 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccac573-3c53-4080-9e60-218cf79253d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:26:00.451120 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccac573-3c53-4080-9e60-218cf79253d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:26:00.460025 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccac573-3c53-4080-9e60-218cf79253d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:26:00.461469 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccac573-3c53-4080-9e60-218cf79253d5 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:26:00.471245 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 721/1450] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:26:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:26:00.796765 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fa195-8cdb-4fe9-b7b4-26713fc203f6 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:26:00.798228 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-812fa195-8cdb-4fe9-b7b4-26713fc203f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:26:00.809940 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812fa195-8cdb-4fe9-b7b4-26713fc203f6 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:26:00.816399 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8626fbe2-bc08-4b54-8926-e9b439f28ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:26:00.817362 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626fbe2-bc08-4b54-8926-e9b439f28ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:26:00.817613 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626fbe2-bc08-4b54-8926-e9b439f28ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:26:00.817924 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8626fbe2-bc08-4b54-8926-e9b439f28ef9 admin admin] PATH_INFO: `/v3/projects/eab5e02294764f7281d6d5f7325507be` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:26:00.819098 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626fbe2-bc08-4b54-8926-e9b439f28ef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eab5e02294764f7281d6d5f7325507be)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:26:00.820219 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING py.warnings [None req-8626fbe2-bc08-4b54-8926-e9b439f28ef9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:26:00.820219 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: warnings.warn(msg) Sep 15 02:26:00.820219 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: Sep 15 02:26:00.821484 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8626fbe2-bc08-4b54-8926-e9b439f28ef9 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:26:00.886332 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8626fbe2-bc08-4b54-8926-e9b439f28ef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eab5e02294764f7281d6d5f7325507be', 'request_id': 'req-8626fbe2-bc08-4b54-8926-e9b439f28ef9'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:26:00.899664 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8626fbe2-bc08-4b54-8926-e9b439f28ef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eab5e02294764f7281d6d5f7325507be', 'request_id': 'req-8626fbe2-bc08-4b54-8926-e9b439f28ef9'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:26:00.909250 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8626fbe2-bc08-4b54-8926-e9b439f28ef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eab5e02294764f7281d6d5f7325507be', 'request_id': 'req-8626fbe2-bc08-4b54-8926-e9b439f28ef9'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:26:00.919417 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8626fbe2-bc08-4b54-8926-e9b439f28ef9 admin admin] The token cache is being invalidate because project eab5e02294764f7281d6d5f7325507be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:26:00.919701 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8626fbe2-bc08-4b54-8926-e9b439f28ef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:26:00.920336 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8626fbe2-bc08-4b54-8926-e9b439f28ef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:26:00.922063 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 730/1451] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:26:00 2021] DELETE /identity/v3/projects/eab5e02294764f7281d6d5f7325507be => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:27:27.393486 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d89599-ba90-46d8-8b36-8c6b4faf7d1e None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:27.394090 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d89599-ba90-46d8-8b36-8c6b4faf7d1e None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:27.394090 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d89599-ba90-46d8-8b36-8c6b4faf7d1e None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:27.395800 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 722/1452] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 15 02:27:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:27:27.401185 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c839-5e1f-4766-be58-629a81f47e0a None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:27.401597 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c839-5e1f-4766-be58-629a81f47e0a None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:27.401752 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1c839-5e1f-4766-be58-629a81f47e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:27.419878 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-2cd1c839-5e1f-4766-be58-629a81f47e0a None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:27:27.421113 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-2cd1c839-5e1f-4766-be58-629a81f47e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:27:27.476843 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 731/1453] 127.0.0.1 () {58 vars in 999 bytes} [Wed Sep 15 02:27:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:27:27.630209 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d89599-ba90-46d8-8b36-8c6b4faf7d1e None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:27:27.631889 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e6d89599-ba90-46d8-8b36-8c6b4faf7d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:27:27.701702 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d89599-ba90-46d8-8b36-8c6b4faf7d1e None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:27:27.707014 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718796c-04fa-444e-8f3b-c49a119a0386 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:27:27.707645 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718796c-04fa-444e-8f3b-c49a119a0386 service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:27.707926 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718796c-04fa-444e-8f3b-c49a119a0386 service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:27.708202 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718796c-04fa-444e-8f3b-c49a119a0386 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:27.715821 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718796c-04fa-444e-8f3b-c49a119a0386 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:27:27.717417 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718796c-04fa-444e-8f3b-c49a119a0386 service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:27:27.726602 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 723/1454] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:27:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:27:28.005320 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae9366-0f27-4cc5-8bf9-9c4020bfa2b2 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:28.005554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae9366-0f27-4cc5-8bf9-9c4020bfa2b2 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:28.005786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae9366-0f27-4cc5-8bf9-9c4020bfa2b2 None None] PATH_INFO: `/v3` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:28.007109 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 732/1455] 10.222.0.30 () {54 vars in 926 bytes} [Wed Sep 15 02:27:28 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:27:28.014190 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7715c1-51f1-4503-a4de-572fc90e930d None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:28.014547 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7715c1-51f1-4503-a4de-572fc90e930d None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:28.014896 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7715c1-51f1-4503-a4de-572fc90e930d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:28.033152 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-bd7715c1-51f1-4503-a4de-572fc90e930d None None] MFA Rules not processed for user `9312539f749645d38ed87a0a47e52aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:27:28.034347 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-bd7715c1-51f1-4503-a4de-572fc90e930d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:27:28.092933 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 724/1456] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Sep 15 02:27:28 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:27:29.068013 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcabd5-c45d-460b-b637-5faab96bc8f4 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:29.068587 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcabd5-c45d-460b-b637-5faab96bc8f4 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:29.068587 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcabd5-c45d-460b-b637-5faab96bc8f4 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:29.070370 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 733/1457] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 15 02:27:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:27:29.075562 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25c6fd-bb7e-4008-8ea8-df3b811ae001 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:29.076019 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25c6fd-bb7e-4008-8ea8-df3b811ae001 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:29.076129 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25c6fd-bb7e-4008-8ea8-df3b811ae001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:29.096598 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-0b25c6fd-bb7e-4008-8ea8-df3b811ae001 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:27:29.097838 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-0b25c6fd-bb7e-4008-8ea8-df3b811ae001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:27:29.105770 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 725/1458] 127.0.0.1 () {58 vars in 999 bytes} [Wed Sep 15 02:27:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:27:29.257692 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcabd5-c45d-460b-b637-5faab96bc8f4 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:27:29.272419 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcabd5-c45d-460b-b637-5faab96bc8f4 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:27:29.278001 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df5c35-92f3-48a8-ae5a-d9b650e260fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:27:29.278631 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df5c35-92f3-48a8-ae5a-d9b650e260fb service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:29.278918 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df5c35-92f3-48a8-ae5a-d9b650e260fb service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:29.279191 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df5c35-92f3-48a8-ae5a-d9b650e260fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:29.287596 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df5c35-92f3-48a8-ae5a-d9b650e260fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:27:29.289238 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df5c35-92f3-48a8-ae5a-d9b650e260fb service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:27:29.298721 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 734/1459] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:27:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:27:36.758779 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74493aec-611b-4845-ba01-a3e8336e56c0 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:36.759215 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74493aec-611b-4845-ba01-a3e8336e56c0 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:36.759332 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74493aec-611b-4845-ba01-a3e8336e56c0 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:36.761171 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 726/1460] 10.222.0.32 () {54 vars in 960 bytes} [Wed Sep 15 02:27:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:27:36.767038 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86773d1-ecc3-4092-9119-6d88e4cfc051 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:36.767449 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86773d1-ecc3-4092-9119-6d88e4cfc051 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:36.767604 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86773d1-ecc3-4092-9119-6d88e4cfc051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:36.784807 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-d86773d1-ecc3-4092-9119-6d88e4cfc051 None None] MFA Rules not processed for user `9312539f749645d38ed87a0a47e52aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:27:36.786003 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d86773d1-ecc3-4092-9119-6d88e4cfc051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:27:36.794277 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 735/1461] 10.222.0.32 () {58 vars in 1058 bytes} [Wed Sep 15 02:27:36 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:27:36.801832 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74493aec-611b-4845-ba01-a3e8336e56c0 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:27:36.815456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74493aec-611b-4845-ba01-a3e8336e56c0 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:27:36.820300 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2906542-cebe-43bb-ab91-2b745b9d7367 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:27:36.820938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2906542-cebe-43bb-ab91-2b745b9d7367 service placement] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:36.821221 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2906542-cebe-43bb-ab91-2b745b9d7367 service placement] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:36.821493 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2906542-cebe-43bb-ab91-2b745b9d7367 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:36.829955 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2906542-cebe-43bb-ab91-2b745b9d7367 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:27:36.831525 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2906542-cebe-43bb-ab91-2b745b9d7367 service placement] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:27:36.840636 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 727/1462] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:27:36 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:27:41.053701 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601b2e-e982-4b57-b945-56787fa1e389 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:41.054253 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601b2e-e982-4b57-b945-56787fa1e389 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:41.054253 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601b2e-e982-4b57-b945-56787fa1e389 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:41.056032 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 736/1463] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 15 02:27:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:27:41.061303 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd321af-74a5-4516-8158-0c4b95cb8a4b None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:41.061711 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd321af-74a5-4516-8158-0c4b95cb8a4b None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:41.061863 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd321af-74a5-4516-8158-0c4b95cb8a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:41.080665 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-bcd321af-74a5-4516-8158-0c4b95cb8a4b None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:27:41.081907 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-bcd321af-74a5-4516-8158-0c4b95cb8a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:27:41.089593 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 728/1464] 127.0.0.1 () {58 vars in 999 bytes} [Wed Sep 15 02:27:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:27:41.242560 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c601b2e-e982-4b57-b945-56787fa1e389 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:27:41.256855 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c601b2e-e982-4b57-b945-56787fa1e389 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:27:41.262196 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681016ae-789f-497f-8ad7-a113fe272596 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:27:41.262852 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681016ae-789f-497f-8ad7-a113fe272596 service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:41.263132 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681016ae-789f-497f-8ad7-a113fe272596 service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:41.263405 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681016ae-789f-497f-8ad7-a113fe272596 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:41.271807 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681016ae-789f-497f-8ad7-a113fe272596 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:27:41.273428 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681016ae-789f-497f-8ad7-a113fe272596 service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:27:41.282469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 737/1465] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:27:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:27:42.629177 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef172a51-e1e6-4357-b200-55f35ec9ae16 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:42.629660 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef172a51-e1e6-4357-b200-55f35ec9ae16 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:42.629777 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef172a51-e1e6-4357-b200-55f35ec9ae16 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:42.631513 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 729/1466] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 15 02:27:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:27:42.636898 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1122f8-2bc3-4450-b9a5-3100df73ea5d None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:42.637305 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1122f8-2bc3-4450-b9a5-3100df73ea5d None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:42.637464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1122f8-2bc3-4450-b9a5-3100df73ea5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:42.654824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-2a1122f8-2bc3-4450-b9a5-3100df73ea5d None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:27:42.655995 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-2a1122f8-2bc3-4450-b9a5-3100df73ea5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:27:42.664123 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 738/1467] 127.0.0.1 () {58 vars in 999 bytes} [Wed Sep 15 02:27:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:27:42.817144 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef172a51-e1e6-4357-b200-55f35ec9ae16 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:27:42.831648 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef172a51-e1e6-4357-b200-55f35ec9ae16 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:27:42.836992 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3714852-d2c5-4585-bd0d-65e75b6d143d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:27:42.837624 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3714852-d2c5-4585-bd0d-65e75b6d143d service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:42.837907 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3714852-d2c5-4585-bd0d-65e75b6d143d service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:42.838183 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3714852-d2c5-4585-bd0d-65e75b6d143d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:42.846009 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3714852-d2c5-4585-bd0d-65e75b6d143d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:27:42.847560 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3714852-d2c5-4585-bd0d-65e75b6d143d service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:27:42.856809 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 730/1468] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:27:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:27:46.965849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a85c0-43e3-42c4-a155-0a40602cbbab None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:46.966479 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a85c0-43e3-42c4-a155-0a40602cbbab None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:46.966479 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a85c0-43e3-42c4-a155-0a40602cbbab None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:46.968171 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 739/1469] 127.0.0.1 () {54 vars in 916 bytes} [Wed Sep 15 02:27:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:27:46.974816 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb87cbb-e636-4172-bc01-527b80e161f1 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:46.975249 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb87cbb-e636-4172-bc01-527b80e161f1 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:46.975354 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb87cbb-e636-4172-bc01-527b80e161f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:46.992502 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-6eb87cbb-e636-4172-bc01-527b80e161f1 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:27:46.993721 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-6eb87cbb-e636-4172-bc01-527b80e161f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:27:47.001626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 731/1470] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 15 02:27:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:27:47.039217 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a85c0-43e3-42c4-a155-0a40602cbbab None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:27:47.040899 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-c53a85c0-43e3-42c4-a155-0a40602cbbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:27:47.095991 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a85c0-43e3-42c4-a155-0a40602cbbab None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:27:47.099863 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ba02f-bdf7-4271-800d-e9147b1c1f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:27:47.100527 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ba02f-bdf7-4271-800d-e9147b1c1f81 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:47.100813 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ba02f-bdf7-4271-800d-e9147b1c1f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:47.101121 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ba02f-bdf7-4271-800d-e9147b1c1f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:47.109938 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ba02f-bdf7-4271-800d-e9147b1c1f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:27:47.111362 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ba02f-bdf7-4271-800d-e9147b1c1f81 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:27:47.120578 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 740/1471] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:27:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:27:49.313782 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bc8dc-9ff2-4535-9afb-295f23f5da2c None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:49.314376 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bc8dc-9ff2-4535-9afb-295f23f5da2c None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:49.314376 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291bc8dc-9ff2-4535-9afb-295f23f5da2c None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:49.316139 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 732/1472] 127.0.0.1 () {54 vars in 916 bytes} [Wed Sep 15 02:27:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:27:49.323368 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8f398-d3bb-493c-8444-d7657abe9b5a None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:49.323828 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8f398-d3bb-493c-8444-d7657abe9b5a None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:49.323931 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8f398-d3bb-493c-8444-d7657abe9b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:49.341632 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-31a8f398-d3bb-493c-8444-d7657abe9b5a None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:27:49.342817 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-31a8f398-d3bb-493c-8444-d7657abe9b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:27:49.351315 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 741/1473] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 15 02:27:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:27:49.387554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bc8dc-9ff2-4535-9afb-295f23f5da2c None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:27:49.399968 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291bc8dc-9ff2-4535-9afb-295f23f5da2c None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:27:49.403850 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6950f6-2dd8-46e2-9730-1cf1fabcfd7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:27:49.404489 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6950f6-2dd8-46e2-9730-1cf1fabcfd7c service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:49.404773 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6950f6-2dd8-46e2-9730-1cf1fabcfd7c service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:49.405081 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6950f6-2dd8-46e2-9730-1cf1fabcfd7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:49.414900 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6950f6-2dd8-46e2-9730-1cf1fabcfd7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:27:49.416317 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6950f6-2dd8-46e2-9730-1cf1fabcfd7c service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:27:49.426201 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 733/1474] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:27:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:27:53.024152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ca208-751e-42ed-b014-4beb9206acc1 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:53.024760 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ca208-751e-42ed-b014-4beb9206acc1 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:53.024760 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ca208-751e-42ed-b014-4beb9206acc1 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:53.026548 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 742/1475] 127.0.0.1 () {54 vars in 916 bytes} [Wed Sep 15 02:27:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:27:53.034115 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b8a8e-472a-4f09-98a4-c904f12a4daf None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:53.034564 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b8a8e-472a-4f09-98a4-c904f12a4daf None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:53.034710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b8a8e-472a-4f09-98a4-c904f12a4daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:53.052946 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-7e3b8a8e-472a-4f09-98a4-c904f12a4daf None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:27:53.054125 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7e3b8a8e-472a-4f09-98a4-c904f12a4daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:27:53.061773 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 734/1476] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 15 02:27:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:27:53.113010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ca208-751e-42ed-b014-4beb9206acc1 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:27:53.114684 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-785ca208-751e-42ed-b014-4beb9206acc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:27:53.169623 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ca208-751e-42ed-b014-4beb9206acc1 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:27:53.173206 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934e087-ff0f-4d45-9291-20e61731a6f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:27:53.173842 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934e087-ff0f-4d45-9291-20e61731a6f2 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:53.174122 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934e087-ff0f-4d45-9291-20e61731a6f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:53.174398 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934e087-ff0f-4d45-9291-20e61731a6f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:53.182988 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934e087-ff0f-4d45-9291-20e61731a6f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:27:53.184403 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934e087-ff0f-4d45-9291-20e61731a6f2 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:27:53.193933 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 743/1477] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:27:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:27:55.323931 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86518546-9e51-45d8-abb4-11a835fbc3af None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:55.324510 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86518546-9e51-45d8-abb4-11a835fbc3af None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:55.324510 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86518546-9e51-45d8-abb4-11a835fbc3af None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:55.326607 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 735/1478] 127.0.0.1 () {54 vars in 916 bytes} [Wed Sep 15 02:27:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:27:55.333721 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a88c7d-7aab-45dc-84e0-446e672a1c44 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:55.334159 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a88c7d-7aab-45dc-84e0-446e672a1c44 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:55.334255 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a88c7d-7aab-45dc-84e0-446e672a1c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:55.354028 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-75a88c7d-7aab-45dc-84e0-446e672a1c44 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:27:55.355213 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-75a88c7d-7aab-45dc-84e0-446e672a1c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:27:55.363410 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 744/1479] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 15 02:27:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:27:55.411838 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a735b-9034-4cfb-b449-c81d0bbcad7e None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:55.412127 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a735b-9034-4cfb-b449-c81d0bbcad7e None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:55.412410 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a735b-9034-4cfb-b449-c81d0bbcad7e None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:55.414215 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 736/1480] 10.222.0.32 () {54 vars in 967 bytes} [Wed Sep 15 02:27:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:27:55.419439 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efc89b-5e5b-47f6-bd84-a869450dc1e4 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:55.419723 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efc89b-5e5b-47f6-bd84-a869450dc1e4 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:55.419995 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efc89b-5e5b-47f6-bd84-a869450dc1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:55.438289 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-94efc89b-5e5b-47f6-bd84-a869450dc1e4 None None] MFA Rules not processed for user `e0c01428860e44fe9d0b15886add165f`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:27:55.439459 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-94efc89b-5e5b-47f6-bd84-a869450dc1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:27:55.445845 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 745/1481] 10.222.0.32 () {58 vars in 1065 bytes} [Wed Sep 15 02:27:55 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:27:55.453722 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a735b-9034-4cfb-b449-c81d0bbcad7e None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:27:55.463955 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a735b-9034-4cfb-b449-c81d0bbcad7e None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:27:55.467488 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418b548-f55c-409a-bf08-357f16317e8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:27:55.468118 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418b548-f55c-409a-bf08-357f16317e8f service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:27:55.468396 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418b548-f55c-409a-bf08-357f16317e8f service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:27:55.468667 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418b548-f55c-409a-bf08-357f16317e8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:27:55.478296 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418b548-f55c-409a-bf08-357f16317e8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:27:55.479711 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418b548-f55c-409a-bf08-357f16317e8f service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:27:55.489466 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 737/1482] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:27:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:15.949599 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4e33e-1827-48c9-bc67-368b24b367f4 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:15.950254 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4e33e-1827-48c9-bc67-368b24b367f4 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:15.950254 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4e33e-1827-48c9-bc67-368b24b367f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:15.968482 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-73c4e33e-1827-48c9-bc67-368b24b367f4 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:15.970246 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-73c4e33e-1827-48c9-bc67-368b24b367f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:15.983264 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 746/1483] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:15.992392 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a66413-c168-4428-81a1-db9d9574b102 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:15.993348 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a66413-c168-4428-81a1-db9d9574b102 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:15.993857 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a66413-c168-4428-81a1-db9d9574b102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:16.022088 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-a7a66413-c168-4428-81a1-db9d9574b102 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:16.023632 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a7a66413-c168-4428-81a1-db9d9574b102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:16.034318 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 738/1484] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:16.038986 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4e33e-1827-48c9-bc67-368b24b367f4 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:16.053145 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4e33e-1827-48c9-bc67-368b24b367f4 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:16.060943 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336b97c-5663-4e28-bf7f-944d38ed4037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:16.061621 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336b97c-5663-4e28-bf7f-944d38ed4037 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:16.061902 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336b97c-5663-4e28-bf7f-944d38ed4037 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:16.062178 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336b97c-5663-4e28-bf7f-944d38ed4037 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:16.063448 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336b97c-5663-4e28-bf7f-944d38ed4037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:16.063755 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336b97c-5663-4e28-bf7f-944d38ed4037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:16.065422 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336b97c-5663-4e28-bf7f-944d38ed4037 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:16.082738 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 747/1485] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:16.090971 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a66413-c168-4428-81a1-db9d9574b102 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:16.102638 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a66413-c168-4428-81a1-db9d9574b102 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:16.109867 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a87172-490a-4e25-8c72-54a7072c12e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:16.110797 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a87172-490a-4e25-8c72-54a7072c12e0 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:16.111323 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a87172-490a-4e25-8c72-54a7072c12e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:16.111811 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a87172-490a-4e25-8c72-54a7072c12e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:16.112716 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a87172-490a-4e25-8c72-54a7072c12e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:16.114818 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a87172-490a-4e25-8c72-54a7072c12e0 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:16.151433 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 739/1486] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:16 2021] POST /identity/v3/projects => generated 357 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:16.155408 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336b97c-5663-4e28-bf7f-944d38ed4037 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:16.170005 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336b97c-5663-4e28-bf7f-944d38ed4037 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:16.252491 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d4d89-c626-407d-9a7d-333e40e6c187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:16.253117 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d4d89-c626-407d-9a7d-333e40e6c187 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:16.253400 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d4d89-c626-407d-9a7d-333e40e6c187 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:16.253673 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d4d89-c626-407d-9a7d-333e40e6c187 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:16.254362 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d4d89-c626-407d-9a7d-333e40e6c187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:16.256280 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d4d89-c626-407d-9a7d-333e40e6c187 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:16.292140 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 748/1487] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:16 2021] POST /identity/v3/users => generated 279 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:16.296486 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a87172-490a-4e25-8c72-54a7072c12e0 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:16.309795 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a87172-490a-4e25-8c72-54a7072c12e0 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:16.316842 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c70e7-cf3e-4f0f-a09f-87bb45a37143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:16.318057 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c70e7-cf3e-4f0f-a09f-87bb45a37143 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:16.318564 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c70e7-cf3e-4f0f-a09f-87bb45a37143 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:16.319098 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c70e7-cf3e-4f0f-a09f-87bb45a37143 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:16.320040 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c70e7-cf3e-4f0f-a09f-87bb45a37143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:16.322153 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c70e7-cf3e-4f0f-a09f-87bb45a37143 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:16.326740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfce0ba-515a-4179-8b5a-6d09bd7ac5a6 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:16.327040 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfce0ba-515a-4179-8b5a-6d09bd7ac5a6 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:16.327317 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfce0ba-515a-4179-8b5a-6d09bd7ac5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:16.336428 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 740/1488] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:16 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:16.341335 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c70e7-cf3e-4f0f-a09f-87bb45a37143 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:16.354978 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c70e7-cf3e-4f0f-a09f-87bb45a37143 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:16.356908 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-ddfce0ba-515a-4179-8b5a-6d09bd7ac5a6 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:16.357394 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ddfce0ba-515a-4179-8b5a-6d09bd7ac5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:16.365253 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d1759-8ea3-45ad-ac06-db96e3ca12bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:16.366205 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d1759-8ea3-45ad-ac06-db96e3ca12bc admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:16.366701 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d1759-8ea3-45ad-ac06-db96e3ca12bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:16.367191 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d1759-8ea3-45ad-ac06-db96e3ca12bc admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:16.368125 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d1759-8ea3-45ad-ac06-db96e3ca12bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:16.369963 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d1759-8ea3-45ad-ac06-db96e3ca12bc admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:16.370093 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 749/1489] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:29:16.379149 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa1365-c265-490b-841f-fd858828d2a4 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:16.379582 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa1365-c265-490b-841f-fd858828d2a4 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:16.379870 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa1365-c265-490b-841f-fd858828d2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:16.387081 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 741/1490] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:16 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:29:16.392001 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d1759-8ea3-45ad-ac06-db96e3ca12bc admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:16.404978 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-f8aa1365-c265-490b-841f-fd858828d2a4 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:16.405524 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d1759-8ea3-45ad-ac06-db96e3ca12bc admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:16.406128 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f8aa1365-c265-490b-841f-fd858828d2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:16.417017 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bcf3e-7c97-40b1-9115-bc90f1d7f282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:16.418208 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bcf3e-7c97-40b1-9115-bc90f1d7f282 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:16.418709 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bcf3e-7c97-40b1-9115-bc90f1d7f282 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:16.419197 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bcf3e-7c97-40b1-9115-bc90f1d7f282 admin admin] PATH_INFO: `/v3/projects/5db79f3cdc4d45a5aa50e2f6ecdbc717/users/41db5d18376c436b86e5bb2212bf9219/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:16.419385 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 750/1491] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:16.425596 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa1365-c265-490b-841f-fd858828d2a4 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:16.439448 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa1365-c265-490b-841f-fd858828d2a4 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:16.447039 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bcf3e-7c97-40b1-9115-bc90f1d7f282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db79f3cdc4d45a5aa50e2f6ecdbc717, user_id=41db5d18376c436b86e5bb2212bf9219, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:16.447676 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30911dd8-0e3e-4b00-b7c5-5bc09ba1307a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:16.448352 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30911dd8-0e3e-4b00-b7c5-5bc09ba1307a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:16.448634 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30911dd8-0e3e-4b00-b7c5-5bc09ba1307a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:16.448935 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30911dd8-0e3e-4b00-b7c5-5bc09ba1307a admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:16.449667 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30911dd8-0e3e-4b00-b7c5-5bc09ba1307a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:16.449975 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30911dd8-0e3e-4b00-b7c5-5bc09ba1307a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:16.451569 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30911dd8-0e3e-4b00-b7c5-5bc09ba1307a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:16.451881 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bcf3e-7c97-40b1-9115-bc90f1d7f282 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:16.473143 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 751/1492] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:29:16.483255 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30911dd8-0e3e-4b00-b7c5-5bc09ba1307a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:16.494174 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 742/1493] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:16 2021] PUT /identity/v3/projects/5db79f3cdc4d45a5aa50e2f6ecdbc717/users/41db5d18376c436b86e5bb2212bf9219/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:29:16.499731 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30911dd8-0e3e-4b00-b7c5-5bc09ba1307a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:16.511733 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8e58d-58c2-46a8-9e53-4addfeb195b4 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:16.512327 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8e58d-58c2-46a8-9e53-4addfeb195b4 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:16.512818 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8e58d-58c2-46a8-9e53-4addfeb195b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:16.556854 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-fca8e58d-58c2-46a8-9e53-4addfeb195b4 None None] MFA Rules not processed for user `41db5d18376c436b86e5bb2212bf9219`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:16.558567 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-fca8e58d-58c2-46a8-9e53-4addfeb195b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:16.619711 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec0b18-e00f-4d39-8ea3-af095b62972a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:16.620398 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec0b18-e00f-4d39-8ea3-af095b62972a admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:16.620682 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec0b18-e00f-4d39-8ea3-af095b62972a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:16.620983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec0b18-e00f-4d39-8ea3-af095b62972a admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:16.621678 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec0b18-e00f-4d39-8ea3-af095b62972a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:16.623856 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec0b18-e00f-4d39-8ea3-af095b62972a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:16.675950 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 743/1494] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:16 2021] POST /identity/v3/auth/tokens => generated 3377 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:16.686815 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 752/1495] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:16 2021] POST /identity/v3/projects => generated 389 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:16.687841 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec0b18-e00f-4d39-8ea3-af095b62972a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:16.689587 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67984deb-3b05-4413-a4f1-79df14eac26a None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:16.689876 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67984deb-3b05-4413-a4f1-79df14eac26a None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:16.690608 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67984deb-3b05-4413-a4f1-79df14eac26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:16.730450 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-67984deb-3b05-4413-a4f1-79df14eac26a None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:16.731664 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-67984deb-3b05-4413-a4f1-79df14eac26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:16.810788 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec0b18-e00f-4d39-8ea3-af095b62972a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:16.815853 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d6c97-3c91-43eb-84b3-4431ac4b795b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:16.816520 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d6c97-3c91-43eb-84b3-4431ac4b795b admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:16.816807 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d6c97-3c91-43eb-84b3-4431ac4b795b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:16.817137 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d6c97-3c91-43eb-84b3-4431ac4b795b admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:16.817978 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d6c97-3c91-43eb-84b3-4431ac4b795b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:16.819905 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d6c97-3c91-43eb-84b3-4431ac4b795b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:16.833769 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 744/1496] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:16.835622 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67984deb-3b05-4413-a4f1-79df14eac26a None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:16.848475 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67984deb-3b05-4413-a4f1-79df14eac26a None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:16.856690 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd97fb4-6993-4df3-97a1-0fc433b35165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:16.857567 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 753/1497] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:16 2021] POST /identity/v3/projects => generated 355 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:16.857925 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd97fb4-6993-4df3-97a1-0fc433b35165 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:16.858429 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd97fb4-6993-4df3-97a1-0fc433b35165 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:16.858856 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd97fb4-6993-4df3-97a1-0fc433b35165 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:16.859175 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63155f3b-4b02-4461-ba0b-c9eaefc7fb63 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:16.859670 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63155f3b-4b02-4461-ba0b-c9eaefc7fb63 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:16.860483 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63155f3b-4b02-4461-ba0b-c9eaefc7fb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:16.860979 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd97fb4-6993-4df3-97a1-0fc433b35165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:16.863150 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd97fb4-6993-4df3-97a1-0fc433b35165 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:16.879240 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-63155f3b-4b02-4461-ba0b-c9eaefc7fb63 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:16.880456 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-63155f3b-4b02-4461-ba0b-c9eaefc7fb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:16.889980 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 745/1498] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:16 2021] POST /identity/v3/users => generated 295 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:16.889980 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5c273-0743-419d-bf16-3c0e0baaf2ff None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:16.889980 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5c273-0743-419d-bf16-3c0e0baaf2ff None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:16.889980 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5c273-0743-419d-bf16-3c0e0baaf2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:16.910518 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-6be5c273-0743-419d-bf16-3c0e0baaf2ff None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:16.911717 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-6be5c273-0743-419d-bf16-3c0e0baaf2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:16.941731 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 754/1499] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:16.943256 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9b2b1-3671-42e0-bfe7-b4a0fff63752 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:16.943548 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9b2b1-3671-42e0-bfe7-b4a0fff63752 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:16.943829 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9b2b1-3671-42e0-bfe7-b4a0fff63752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:16.960991 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-96f9b2b1-3671-42e0-bfe7-b4a0fff63752 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:16.962186 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-96f9b2b1-3671-42e0-bfe7-b4a0fff63752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:16.968857 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 746/1500] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:16.970710 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 755/1501] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:16.971856 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae525a-41bd-44b1-9282-d9b427c3b945 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:16.972095 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5724c-83bb-4783-a1ae-88158bbb6d6a None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:16.972211 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae525a-41bd-44b1-9282-d9b427c3b945 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:16.972380 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5724c-83bb-4783-a1ae-88158bbb6d6a None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:16.972504 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae525a-41bd-44b1-9282-d9b427c3b945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:16.972760 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5724c-83bb-4783-a1ae-88158bbb6d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:16.991379 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-0ad5724c-83bb-4783-a1ae-88158bbb6d6a None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:16.992558 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-0ad5724c-83bb-4783-a1ae-88158bbb6d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:16.993246 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-51ae525a-41bd-44b1-9282-d9b427c3b945 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:16.994402 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-51ae525a-41bd-44b1-9282-d9b427c3b945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:17.000365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 756/1502] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:17.001130 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5724c-83bb-4783-a1ae-88158bbb6d6a None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.005599 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 747/1503] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:17.005599 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae525a-41bd-44b1-9282-d9b427c3b945 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.010253 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5724c-83bb-4783-a1ae-88158bbb6d6a None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.014786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82f7dd-0119-40f3-981e-6efbb52ff717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.015430 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82f7dd-0119-40f3-981e-6efbb52ff717 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.015712 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82f7dd-0119-40f3-981e-6efbb52ff717 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.015979 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae525a-41bd-44b1-9282-d9b427c3b945 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.016096 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82f7dd-0119-40f3-981e-6efbb52ff717 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.016674 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82f7dd-0119-40f3-981e-6efbb52ff717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.018651 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82f7dd-0119-40f3-981e-6efbb52ff717 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.020545 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01b3de-0505-4bc0-a0fa-940e33e0ab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.021254 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01b3de-0505-4bc0-a0fa-940e33e0ab1c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.021533 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01b3de-0505-4bc0-a0fa-940e33e0ab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.021803 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01b3de-0505-4bc0-a0fa-940e33e0ab1c admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.022517 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01b3de-0505-4bc0-a0fa-940e33e0ab1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.024076 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01b3de-0505-4bc0-a0fa-940e33e0ab1c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.034325 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 748/1504] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:17 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:17.035542 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938d4c4-d67f-4e7b-a54b-a6c110905b20 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.035833 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938d4c4-d67f-4e7b-a54b-a6c110905b20 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.036105 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938d4c4-d67f-4e7b-a54b-a6c110905b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.039032 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 757/1505] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:17 2021] POST /identity/v3/users => generated 284 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:17.040433 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad99f6-3e26-429b-b180-e063bfb82d7e None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.040715 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad99f6-3e26-429b-b180-e063bfb82d7e None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.041045 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad99f6-3e26-429b-b180-e063bfb82d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.055407 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-b938d4c4-d67f-4e7b-a54b-a6c110905b20 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:17.056595 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b938d4c4-d67f-4e7b-a54b-a6c110905b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:17.058313 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-c3ad99f6-3e26-429b-b180-e063bfb82d7e None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:17.059487 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-c3ad99f6-3e26-429b-b180-e063bfb82d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:17.064442 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 749/1506] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:17.065686 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f43ede-27e8-4259-872f-e4ad307649e9 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.065970 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f43ede-27e8-4259-872f-e4ad307649e9 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.066248 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f43ede-27e8-4259-872f-e4ad307649e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.073396 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 758/1507] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:17.073396 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f0abe-bed6-4d7b-a4b9-858136210f35 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.073396 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f0abe-bed6-4d7b-a4b9-858136210f35 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.073396 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f0abe-bed6-4d7b-a4b9-858136210f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.088656 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-30f43ede-27e8-4259-872f-e4ad307649e9 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:17.089673 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-7b9f0abe-bed6-4d7b-a4b9-858136210f35 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:17.089887 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-30f43ede-27e8-4259-872f-e4ad307649e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:17.090808 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-7b9f0abe-bed6-4d7b-a4b9-858136210f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:17.098440 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 750/1508] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:17.099277 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f43ede-27e8-4259-872f-e4ad307649e9 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.099551 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 759/1509] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:17.100806 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7836e-a5a5-4ae3-ae34-084e2f578ec1 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.101128 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7836e-a5a5-4ae3-ae34-084e2f578ec1 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.101402 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7836e-a5a5-4ae3-ae34-084e2f578ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.109468 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f43ede-27e8-4259-872f-e4ad307649e9 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.114079 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220ab90-c4f4-49d9-9006-64a78c414dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.114715 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220ab90-c4f4-49d9-9006-64a78c414dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.114997 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220ab90-c4f4-49d9-9006-64a78c414dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.115275 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220ab90-c4f4-49d9-9006-64a78c414dd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.115987 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220ab90-c4f4-49d9-9006-64a78c414dd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:17.116292 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220ab90-c4f4-49d9-9006-64a78c414dd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.117904 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220ab90-c4f4-49d9-9006-64a78c414dd3 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.118521 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-23f7836e-a5a5-4ae3-ae34-084e2f578ec1 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:17.119672 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-23f7836e-a5a5-4ae3-ae34-084e2f578ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:17.127402 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 760/1510] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:17.128152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7836e-a5a5-4ae3-ae34-084e2f578ec1 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.129648 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 751/1511] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:17.130362 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220ab90-c4f4-49d9-9006-64a78c414dd3 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.140245 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220ab90-c4f4-49d9-9006-64a78c414dd3 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.141481 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7836e-a5a5-4ae3-ae34-084e2f578ec1 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.145317 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0395a-9ed7-424c-bdda-9ed62b9c44dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.146283 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488540f-27f6-4b22-960a-584c0de89f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.146428 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0395a-9ed7-424c-bdda-9ed62b9c44dc admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.146753 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0395a-9ed7-424c-bdda-9ed62b9c44dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.146936 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488540f-27f6-4b22-960a-584c0de89f40 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.147219 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488540f-27f6-4b22-960a-584c0de89f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.147322 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0395a-9ed7-424c-bdda-9ed62b9c44dc admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.147496 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488540f-27f6-4b22-960a-584c0de89f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.148222 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488540f-27f6-4b22-960a-584c0de89f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.148579 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0395a-9ed7-424c-bdda-9ed62b9c44dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.149859 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488540f-27f6-4b22-960a-584c0de89f40 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.151452 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0395a-9ed7-424c-bdda-9ed62b9c44dc admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.160667 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 761/1512] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:17 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:17.162018 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09b6a3-0c4a-43db-93af-52a4c2775b11 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.162317 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09b6a3-0c4a-43db-93af-52a4c2775b11 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.162705 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09b6a3-0c4a-43db-93af-52a4c2775b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.166109 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 752/1513] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:17 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:17.166109 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0395a-9ed7-424c-bdda-9ed62b9c44dc admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.173298 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0395a-9ed7-424c-bdda-9ed62b9c44dc admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.178025 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1816de1-e673-437b-b5aa-745c2dbdb491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.178653 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1816de1-e673-437b-b5aa-745c2dbdb491 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.178937 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1816de1-e673-437b-b5aa-745c2dbdb491 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.179219 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1816de1-e673-437b-b5aa-745c2dbdb491 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.179922 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1816de1-e673-437b-b5aa-745c2dbdb491 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:17.180029 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-bc09b6a3-0c4a-43db-93af-52a4c2775b11 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:17.180230 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1816de1-e673-437b-b5aa-745c2dbdb491 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.181181 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-bc09b6a3-0c4a-43db-93af-52a4c2775b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:17.181834 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1816de1-e673-437b-b5aa-745c2dbdb491 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.189246 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 762/1514] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:17.189865 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09b6a3-0c4a-43db-93af-52a4c2775b11 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.200736 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 753/1515] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:17.200736 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1816de1-e673-437b-b5aa-745c2dbdb491 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.201013 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09b6a3-0c4a-43db-93af-52a4c2775b11 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.204676 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17407902-c1d4-4af5-a867-beb1a122dcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.205344 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17407902-c1d4-4af5-a867-beb1a122dcce admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.205630 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17407902-c1d4-4af5-a867-beb1a122dcce admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.205910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17407902-c1d4-4af5-a867-beb1a122dcce admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.206639 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17407902-c1d4-4af5-a867-beb1a122dcce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:17.206966 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17407902-c1d4-4af5-a867-beb1a122dcce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.208953 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17407902-c1d4-4af5-a867-beb1a122dcce admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.211190 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1816de1-e673-437b-b5aa-745c2dbdb491 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.215741 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a8395-89f7-4b33-8d40-d5dd15a97125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.216371 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a8395-89f7-4b33-8d40-d5dd15a97125 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.216653 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a8395-89f7-4b33-8d40-d5dd15a97125 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.216948 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a8395-89f7-4b33-8d40-d5dd15a97125 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.217655 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a8395-89f7-4b33-8d40-d5dd15a97125 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:17.217965 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a8395-89f7-4b33-8d40-d5dd15a97125 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.220184 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a8395-89f7-4b33-8d40-d5dd15a97125 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.220803 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 763/1516] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:17.221896 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17407902-c1d4-4af5-a867-beb1a122dcce admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.232250 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 754/1517] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:17.233173 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a8395-89f7-4b33-8d40-d5dd15a97125 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.237161 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17407902-c1d4-4af5-a867-beb1a122dcce admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.242119 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fb2b2-82f6-4357-a62a-a1a7eb67750b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.242340 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a8395-89f7-4b33-8d40-d5dd15a97125 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.242760 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fb2b2-82f6-4357-a62a-a1a7eb67750b admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.243040 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fb2b2-82f6-4357-a62a-a1a7eb67750b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.243317 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fb2b2-82f6-4357-a62a-a1a7eb67750b admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.244177 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fb2b2-82f6-4357-a62a-a1a7eb67750b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:17.244484 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fb2b2-82f6-4357-a62a-a1a7eb67750b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.246112 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fb2b2-82f6-4357-a62a-a1a7eb67750b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.246928 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8aa04-882c-4737-8697-44d8b27607dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.247554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8aa04-882c-4737-8697-44d8b27607dc admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.247839 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8aa04-882c-4737-8697-44d8b27607dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.248112 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8aa04-882c-4737-8697-44d8b27607dc admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.248782 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8aa04-882c-4737-8697-44d8b27607dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.250705 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8aa04-882c-4737-8697-44d8b27607dc admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.257831 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 764/1518] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:17.264953 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fb2b2-82f6-4357-a62a-a1a7eb67750b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.269268 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fb2b2-82f6-4357-a62a-a1a7eb67750b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.273834 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bf6bf-252d-4276-8e9e-dd496801b244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.274691 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bf6bf-252d-4276-8e9e-dd496801b244 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.274967 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bf6bf-252d-4276-8e9e-dd496801b244 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.275255 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bf6bf-252d-4276-8e9e-dd496801b244 admin admin] PATH_INFO: `/v3/projects/cc2ce4399ef144efb17b4474c8f97969/users/1a349783f06c414db888ac4f02a6e878/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.275987 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 755/1519] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:17 2021] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:17.276921 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8aa04-882c-4737-8697-44d8b27607dc admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.290965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6bf6bf-252d-4276-8e9e-dd496801b244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2ce4399ef144efb17b4474c8f97969, user_id=1a349783f06c414db888ac4f02a6e878, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.293687 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6bf6bf-252d-4276-8e9e-dd496801b244 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.306465 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 765/1520] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:17 2021] PUT /identity/v3/projects/cc2ce4399ef144efb17b4474c8f97969/users/1a349783f06c414db888ac4f02a6e878/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:17.309687 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bf6bf-252d-4276-8e9e-dd496801b244 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.335729 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8aa04-882c-4737-8697-44d8b27607dc admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.367624 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bf6bf-252d-4276-8e9e-dd496801b244 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.372240 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb93bd6-bf44-4fea-9d6e-6cd865a0677a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.372919 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb93bd6-bf44-4fea-9d6e-6cd865a0677a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.373205 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb93bd6-bf44-4fea-9d6e-6cd865a0677a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.373481 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb93bd6-bf44-4fea-9d6e-6cd865a0677a admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.374200 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb93bd6-bf44-4fea-9d6e-6cd865a0677a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:17.374508 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb93bd6-bf44-4fea-9d6e-6cd865a0677a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.376738 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb93bd6-bf44-4fea-9d6e-6cd865a0677a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.387571 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 766/1521] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:17.389292 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884388cc-06b5-43de-a6a4-0ba747eec102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.389935 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb93bd6-bf44-4fea-9d6e-6cd865a0677a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.390177 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884388cc-06b5-43de-a6a4-0ba747eec102 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.390460 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884388cc-06b5-43de-a6a4-0ba747eec102 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.390779 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884388cc-06b5-43de-a6a4-0ba747eec102 admin admin] PATH_INFO: `/v3/projects/08c65bfd5afb4f67b0fbaca2a747788a/users/8baf7b93626e441881e8015e90fb30c8/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.399467 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb93bd6-bf44-4fea-9d6e-6cd865a0677a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.404096 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13a15b-7ac6-4430-b3e7-17e7289c567d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.404697 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884388cc-06b5-43de-a6a4-0ba747eec102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c65bfd5afb4f67b0fbaca2a747788a, user_id=8baf7b93626e441881e8015e90fb30c8, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.404813 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13a15b-7ac6-4430-b3e7-17e7289c567d admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.405038 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13a15b-7ac6-4430-b3e7-17e7289c567d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.405319 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13a15b-7ac6-4430-b3e7-17e7289c567d admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.405992 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13a15b-7ac6-4430-b3e7-17e7289c567d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.407923 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884388cc-06b5-43de-a6a4-0ba747eec102 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.408337 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13a15b-7ac6-4430-b3e7-17e7289c567d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.423565 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 756/1522] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:17 2021] PUT /identity/v3/projects/08c65bfd5afb4f67b0fbaca2a747788a/users/8baf7b93626e441881e8015e90fb30c8/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:17.423565 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884388cc-06b5-43de-a6a4-0ba747eec102 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.435300 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 767/1523] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:17 2021] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:17.436104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13a15b-7ac6-4430-b3e7-17e7289c567d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.484244 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884388cc-06b5-43de-a6a4-0ba747eec102 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.494938 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13a15b-7ac6-4430-b3e7-17e7289c567d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.499564 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb0d53-83dd-42f3-9be0-4de8ed841cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.500263 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb0d53-83dd-42f3-9be0-4de8ed841cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.500545 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb0d53-83dd-42f3-9be0-4de8ed841cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.500822 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb0d53-83dd-42f3-9be0-4de8ed841cd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.501551 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb0d53-83dd-42f3-9be0-4de8ed841cd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.503462 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb0d53-83dd-42f3-9be0-4de8ed841cd7 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.528396 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 768/1524] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:17 2021] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:17.529363 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb0d53-83dd-42f3-9be0-4de8ed841cd7 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.538186 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0922f-7586-4fdb-adbf-cb75faadc80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.538843 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0922f-7586-4fdb-adbf-cb75faadc80b admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.539123 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0922f-7586-4fdb-adbf-cb75faadc80b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.539393 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0922f-7586-4fdb-adbf-cb75faadc80b admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.540066 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0922f-7586-4fdb-adbf-cb75faadc80b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.541985 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0922f-7586-4fdb-adbf-cb75faadc80b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.566738 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 757/1525] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:17 2021] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:17.566738 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0922f-7586-4fdb-adbf-cb75faadc80b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.589482 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb0d53-83dd-42f3-9be0-4de8ed841cd7 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.629768 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0922f-7586-4fdb-adbf-cb75faadc80b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.634488 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf1ff0-cce7-4341-b7c0-6d064954e0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.635149 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf1ff0-cce7-4341-b7c0-6d064954e0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.635432 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf1ff0-cce7-4341-b7c0-6d064954e0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.635707 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf1ff0-cce7-4341-b7c0-6d064954e0e4 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.636384 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf1ff0-cce7-4341-b7c0-6d064954e0e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.638318 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf1ff0-cce7-4341-b7c0-6d064954e0e4 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.643822 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11e75c-66c8-45af-8869-d15a49047e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.644551 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11e75c-66c8-45af-8869-d15a49047e9e admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.644838 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11e75c-66c8-45af-8869-d15a49047e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.645170 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11e75c-66c8-45af-8869-d15a49047e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.645852 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11e75c-66c8-45af-8869-d15a49047e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.647763 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11e75c-66c8-45af-8869-d15a49047e9e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.658027 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 758/1526] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:17 2021] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:17.659282 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686576-8627-4cc7-a1f0-b1725db86645 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.659570 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686576-8627-4cc7-a1f0-b1725db86645 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.659844 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686576-8627-4cc7-a1f0-b1725db86645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.678344 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 769/1527] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:17 2021] POST /identity/v3/projects => generated 391 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:17.678344 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11e75c-66c8-45af-8869-d15a49047e9e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.678613 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-d6686576-8627-4cc7-a1f0-b1725db86645 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:17.678613 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-d6686576-8627-4cc7-a1f0-b1725db86645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:17.733725 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 759/1528] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:17.735179 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6686576-8627-4cc7-a1f0-b1725db86645 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.738353 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11e75c-66c8-45af-8869-d15a49047e9e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.743108 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9e8ef-2bb4-406c-a3ef-122796bcac1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.743908 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9e8ef-2bb4-406c-a3ef-122796bcac1a admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.744042 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6686576-8627-4cc7-a1f0-b1725db86645 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.744324 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9e8ef-2bb4-406c-a3ef-122796bcac1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.744695 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9e8ef-2bb4-406c-a3ef-122796bcac1a admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.745570 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9e8ef-2bb4-406c-a3ef-122796bcac1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.747660 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9e8ef-2bb4-406c-a3ef-122796bcac1a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.748548 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1912933-32e4-4b2f-858a-6cf1ca715e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.749227 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1912933-32e4-4b2f-858a-6cf1ca715e89 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.749506 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1912933-32e4-4b2f-858a-6cf1ca715e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.749777 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1912933-32e4-4b2f-858a-6cf1ca715e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.750494 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1912933-32e4-4b2f-858a-6cf1ca715e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.752045 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1912933-32e4-4b2f-858a-6cf1ca715e89 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.761593 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 760/1529] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:17 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:17.763575 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1912933-32e4-4b2f-858a-6cf1ca715e89 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.772720 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1912933-32e4-4b2f-858a-6cf1ca715e89 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.776020 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 770/1530] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:17 2021] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:17.776020 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9e8ef-2bb4-406c-a3ef-122796bcac1a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.828735 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747f7c7-d331-4e77-86b1-083ef5ab3c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.829524 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747f7c7-d331-4e77-86b1-083ef5ab3c0b admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.829811 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747f7c7-d331-4e77-86b1-083ef5ab3c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.830084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747f7c7-d331-4e77-86b1-083ef5ab3c0b admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.830766 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747f7c7-d331-4e77-86b1-083ef5ab3c0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.832395 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9e8ef-2bb4-406c-a3ef-122796bcac1a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.832665 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747f7c7-d331-4e77-86b1-083ef5ab3c0b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.837050 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c08c5-a7d0-490f-a81c-f15387a1e80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.837709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c08c5-a7d0-490f-a81c-f15387a1e80b admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.837991 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c08c5-a7d0-490f-a81c-f15387a1e80b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.838267 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c08c5-a7d0-490f-a81c-f15387a1e80b admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.838938 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c08c5-a7d0-490f-a81c-f15387a1e80b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.840906 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c08c5-a7d0-490f-a81c-f15387a1e80b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.853205 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 761/1531] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:17 2021] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:17.853918 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747f7c7-d331-4e77-86b1-083ef5ab3c0b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.861232 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 771/1532] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:17 2021] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:17.862056 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c08c5-a7d0-490f-a81c-f15387a1e80b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.863856 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747f7c7-d331-4e77-86b1-083ef5ab3c0b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.868788 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11df39-7f15-41d6-ae84-f0cac9c522fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.869458 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11df39-7f15-41d6-ae84-f0cac9c522fd admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.869737 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11df39-7f15-41d6-ae84-f0cac9c522fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.870007 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11df39-7f15-41d6-ae84-f0cac9c522fd admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.870680 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11df39-7f15-41d6-ae84-f0cac9c522fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.871153 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c08c5-a7d0-490f-a81c-f15387a1e80b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.872577 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11df39-7f15-41d6-ae84-f0cac9c522fd admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.876002 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ca05f-2c78-429e-9916-ad42efc9b46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.876634 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ca05f-2c78-429e-9916-ad42efc9b46e admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.876948 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ca05f-2c78-429e-9916-ad42efc9b46e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.877228 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ca05f-2c78-429e-9916-ad42efc9b46e admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.877936 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ca05f-2c78-429e-9916-ad42efc9b46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.879500 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ca05f-2c78-429e-9916-ad42efc9b46e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.889829 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 772/1533] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:17 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:17.890608 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ca05f-2c78-429e-9916-ad42efc9b46e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.893376 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 762/1534] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:17 2021] POST /identity/v3/users => generated 283 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:17.894463 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11df39-7f15-41d6-ae84-f0cac9c522fd admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.900519 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ca05f-2c78-429e-9916-ad42efc9b46e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.905176 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c7aa5-6f34-44d2-ae97-88320dedc301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.905814 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c7aa5-6f34-44d2-ae97-88320dedc301 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.906093 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c7aa5-6f34-44d2-ae97-88320dedc301 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.906414 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c7aa5-6f34-44d2-ae97-88320dedc301 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.907586 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c7aa5-6f34-44d2-ae97-88320dedc301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.909498 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c7aa5-6f34-44d2-ae97-88320dedc301 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.928704 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 773/1535] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:17 2021] POST /identity/v3/users => generated 296 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:17.929647 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c7aa5-6f34-44d2-ae97-88320dedc301 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.938558 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c7aa5-6f34-44d2-ae97-88320dedc301 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.943207 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93b74f-ae8c-48de-b5aa-47ca850caca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.944052 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93b74f-ae8c-48de-b5aa-47ca850caca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.944327 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93b74f-ae8c-48de-b5aa-47ca850caca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.944602 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93b74f-ae8c-48de-b5aa-47ca850caca4 admin admin] PATH_INFO: `/v3/projects/08c65bfd5afb4f67b0fbaca2a747788a/users/8baf7b93626e441881e8015e90fb30c8/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.946586 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93b74f-ae8c-48de-b5aa-47ca850caca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c65bfd5afb4f67b0fbaca2a747788a, user_id=8baf7b93626e441881e8015e90fb30c8, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.947992 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11df39-7f15-41d6-ae84-f0cac9c522fd admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:17.949193 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93b74f-ae8c-48de-b5aa-47ca850caca4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.951661 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62402a-f3e8-4db0-ae5f-69b2bf5dad3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:17.952310 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62402a-f3e8-4db0-ae5f-69b2bf5dad3b service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:17.952589 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62402a-f3e8-4db0-ae5f-69b2bf5dad3b service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:17.952867 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62402a-f3e8-4db0-ae5f-69b2bf5dad3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:17.970356 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 774/1536] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:17 2021] PUT /identity/v3/projects/08c65bfd5afb4f67b0fbaca2a747788a/users/8baf7b93626e441881e8015e90fb30c8/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:17.970356 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93b74f-ae8c-48de-b5aa-47ca850caca4 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.971011 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62402a-f3e8-4db0-ae5f-69b2bf5dad3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:17.971011 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62402a-f3e8-4db0-ae5f-69b2bf5dad3b service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:17.974523 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 763/1537] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:17.975325 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62402a-f3e8-4db0-ae5f-69b2bf5dad3b service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:17.984140 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62402a-f3e8-4db0-ae5f-69b2bf5dad3b service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:18.022457 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93b74f-ae8c-48de-b5aa-47ca850caca4 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:18.029257 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466aab6-eaad-4cad-bd14-09ca7d228fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:18.029919 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466aab6-eaad-4cad-bd14-09ca7d228fcf admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.030205 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466aab6-eaad-4cad-bd14-09ca7d228fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.030525 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466aab6-eaad-4cad-bd14-09ca7d228fcf admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.031196 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466aab6-eaad-4cad-bd14-09ca7d228fcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:18.033888 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466aab6-eaad-4cad-bd14-09ca7d228fcf admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:18.040630 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014ba87-3691-4807-b82e-ceb6278da665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:18.041433 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014ba87-3691-4807-b82e-ceb6278da665 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.041706 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014ba87-3691-4807-b82e-ceb6278da665 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.041982 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014ba87-3691-4807-b82e-ceb6278da665 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.042771 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014ba87-3691-4807-b82e-ceb6278da665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:18.044411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014ba87-3691-4807-b82e-ceb6278da665 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:18.055065 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 764/1538] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:17 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:18.056133 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 775/1539] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:17 2021] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:18.056804 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014ba87-3691-4807-b82e-ceb6278da665 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:18.057095 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466aab6-eaad-4cad-bd14-09ca7d228fcf admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:18.067812 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466aab6-eaad-4cad-bd14-09ca7d228fcf admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:18.068739 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014ba87-3691-4807-b82e-ceb6278da665 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:18.073754 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39780513-ee16-4d51-a3c8-d0efa46472d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:18.074492 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39780513-ee16-4d51-a3c8-d0efa46472d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.074623 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fb02b-fcf8-42f9-bc71-9ddbf45aad19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:18.074905 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39780513-ee16-4d51-a3c8-d0efa46472d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.075245 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39780513-ee16-4d51-a3c8-d0efa46472d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.075452 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fb02b-fcf8-42f9-bc71-9ddbf45aad19 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.076069 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fb02b-fcf8-42f9-bc71-9ddbf45aad19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.076210 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fb02b-fcf8-42f9-bc71-9ddbf45aad19 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.076339 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39780513-ee16-4d51-a3c8-d0efa46472d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:18.077262 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fb02b-fcf8-42f9-bc71-9ddbf45aad19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:18.078121 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39780513-ee16-4d51-a3c8-d0efa46472d3 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:18.079821 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fb02b-fcf8-42f9-bc71-9ddbf45aad19 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:18.089417 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 776/1540] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:18 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:18.090559 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39780513-ee16-4d51-a3c8-d0efa46472d3 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:18.098229 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 765/1541] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:18 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:18.098229 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fb02b-fcf8-42f9-bc71-9ddbf45aad19 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:18.101697 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39780513-ee16-4d51-a3c8-d0efa46472d3 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:18.107067 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05bca27-6c69-41c1-b08d-0d72071ba1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:18.107729 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bca27-6c69-41c1-b08d-0d72071ba1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.108003 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bca27-6c69-41c1-b08d-0d72071ba1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.108273 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05bca27-6c69-41c1-b08d-0d72071ba1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.109032 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05bca27-6c69-41c1-b08d-0d72071ba1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:18.109538 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fb02b-fcf8-42f9-bc71-9ddbf45aad19 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:18.110635 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05bca27-6c69-41c1-b08d-0d72071ba1c0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:18.116772 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ddda3-9894-4d66-9520-b88608e4550d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:18.117862 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ddda3-9894-4d66-9520-b88608e4550d admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.118366 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ddda3-9894-4d66-9520-b88608e4550d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.118909 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ddda3-9894-4d66-9520-b88608e4550d admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.119842 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ddda3-9894-4d66-9520-b88608e4550d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:18.121390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 777/1542] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:18 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:18.122718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99048406-ee10-4236-935b-6ec74d15db1e None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.122934 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99048406-ee10-4236-935b-6ec74d15db1e None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.123208 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99048406-ee10-4236-935b-6ec74d15db1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.125646 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ddda3-9894-4d66-9520-b88608e4550d admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:18.143050 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 766/1543] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:18 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:18.143050 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ddda3-9894-4d66-9520-b88608e4550d admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:18.153658 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-99048406-ee10-4236-935b-6ec74d15db1e None None] MFA Rules not processed for user `8baf7b93626e441881e8015e90fb30c8`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:18.154949 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-99048406-ee10-4236-935b-6ec74d15db1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:18.155372 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ddda3-9894-4d66-9520-b88608e4550d admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:18.166044 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149b41d-3a4d-40f1-9d23-b593aafbbe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:18.167223 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149b41d-3a4d-40f1-9d23-b593aafbbe3a admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.168826 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149b41d-3a4d-40f1-9d23-b593aafbbe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.169747 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149b41d-3a4d-40f1-9d23-b593aafbbe3a admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.170569 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149b41d-3a4d-40f1-9d23-b593aafbbe3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:18.172605 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149b41d-3a4d-40f1-9d23-b593aafbbe3a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:18.185514 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 767/1544] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:18 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:18.187053 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149b41d-3a4d-40f1-9d23-b593aafbbe3a admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:18.204932 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149b41d-3a4d-40f1-9d23-b593aafbbe3a admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:18.210933 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6dfc7-3aba-4db7-8033-f7eaf855146a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:18.211580 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6dfc7-3aba-4db7-8033-f7eaf855146a admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.211865 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6dfc7-3aba-4db7-8033-f7eaf855146a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.212169 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6dfc7-3aba-4db7-8033-f7eaf855146a admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.212861 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6dfc7-3aba-4db7-8033-f7eaf855146a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:18.214522 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6dfc7-3aba-4db7-8033-f7eaf855146a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:18.224973 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 768/1545] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:18 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:18.225633 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6dfc7-3aba-4db7-8033-f7eaf855146a admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:18.235155 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6dfc7-3aba-4db7-8033-f7eaf855146a admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:18.235560 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 778/1546] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:18 2021] POST /identity/v3/auth/tokens => generated 3442 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:18.236383 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99048406-ee10-4236-935b-6ec74d15db1e None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:18.247273 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99048406-ee10-4236-935b-6ec74d15db1e None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:18.250703 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14061f9-59f2-4f39-8b6d-c0e31bb8e3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:18.251705 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14061f9-59f2-4f39-8b6d-c0e31bb8e3ed admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.251705 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14061f9-59f2-4f39-8b6d-c0e31bb8e3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.251950 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14061f9-59f2-4f39-8b6d-c0e31bb8e3ed admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.252638 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14061f9-59f2-4f39-8b6d-c0e31bb8e3ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:18.254253 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14061f9-59f2-4f39-8b6d-c0e31bb8e3ed admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:18.254371 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be9a3f-4ceb-4156-ac5f-5d439af60e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:18.255278 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be9a3f-4ceb-4156-ac5f-5d439af60e9d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.255653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be9a3f-4ceb-4156-ac5f-5d439af60e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.256048 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be9a3f-4ceb-4156-ac5f-5d439af60e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.256815 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be9a3f-4ceb-4156-ac5f-5d439af60e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:18.258587 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be9a3f-4ceb-4156-ac5f-5d439af60e9d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:18.265243 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 769/1547] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:18 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:18.266562 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14061f9-59f2-4f39-8b6d-c0e31bb8e3ed admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:18.276446 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14061f9-59f2-4f39-8b6d-c0e31bb8e3ed admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:18.281928 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 779/1548] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:18 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:18.281928 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be9a3f-4ceb-4156-ac5f-5d439af60e9d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:18.284536 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1f113-f559-4029-8cba-c440e0e626e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:18.287927 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1f113-f559-4029-8cba-c440e0e626e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.288290 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1f113-f559-4029-8cba-c440e0e626e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.288643 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1f113-f559-4029-8cba-c440e0e626e9 admin admin] PATH_INFO: `/v3/projects/1d2218879665430c9a1371516339fdd7/users/83435d81142f4e83bd88290e4d404ad3/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.293328 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be9a3f-4ceb-4156-ac5f-5d439af60e9d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:18.300166 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c258cd-187c-49ea-b675-789412c6d0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:18.301079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c258cd-187c-49ea-b675-789412c6d0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.301433 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c258cd-187c-49ea-b675-789412c6d0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.301928 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c258cd-187c-49ea-b675-789412c6d0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.302900 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c258cd-187c-49ea-b675-789412c6d0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:18.304654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1f113-f559-4029-8cba-c440e0e626e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d2218879665430c9a1371516339fdd7, user_id=83435d81142f4e83bd88290e4d404ad3, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:18.305031 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c258cd-187c-49ea-b675-789412c6d0f5 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:18.307524 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1f113-f559-4029-8cba-c440e0e626e9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:18.318848 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 780/1549] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:18 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:18.319832 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c258cd-187c-49ea-b675-789412c6d0f5 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:18.323498 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 770/1550] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:18 2021] PUT /identity/v3/projects/1d2218879665430c9a1371516339fdd7/users/83435d81142f4e83bd88290e4d404ad3/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:18.324576 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1f113-f559-4029-8cba-c440e0e626e9 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:18.343732 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c258cd-187c-49ea-b675-789412c6d0f5 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:18.400682 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1f113-f559-4029-8cba-c440e0e626e9 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:18.407807 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdb265-5c69-4dde-8a8f-da9e69c0a79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:18.408710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdb265-5c69-4dde-8a8f-da9e69c0a79b admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.409096 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdb265-5c69-4dde-8a8f-da9e69c0a79b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.409579 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdb265-5c69-4dde-8a8f-da9e69c0a79b admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.410255 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4446bcf-55d4-4142-8392-0724c549c46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:18.410766 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fdb265-5c69-4dde-8a8f-da9e69c0a79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:18.411329 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4446bcf-55d4-4142-8392-0724c549c46c admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.411677 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4446bcf-55d4-4142-8392-0724c549c46c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.413190 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4446bcf-55d4-4142-8392-0724c549c46c admin admin] PATH_INFO: `/v3/projects/4f739b6af4b5422783af4089b8c7b16f/users/b0b7aae305a145bb84b9e3624a41d7d4/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.413325 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fdb265-5c69-4dde-8a8f-da9e69c0a79b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:18.426124 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 771/1551] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:18 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:18.426869 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdb265-5c69-4dde-8a8f-da9e69c0a79b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:18.431663 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4446bcf-55d4-4142-8392-0724c549c46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f739b6af4b5422783af4089b8c7b16f, user_id=b0b7aae305a145bb84b9e3624a41d7d4, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:18.434540 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4446bcf-55d4-4142-8392-0724c549c46c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:18.450015 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 781/1552] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:18 2021] PUT /identity/v3/projects/4f739b6af4b5422783af4089b8c7b16f/users/b0b7aae305a145bb84b9e3624a41d7d4/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:18.450684 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4446bcf-55d4-4142-8392-0724c549c46c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:18.489648 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdb265-5c69-4dde-8a8f-da9e69c0a79b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:18.525901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4446bcf-55d4-4142-8392-0724c549c46c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:18.530696 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0a0fa-c7cb-408c-978d-fe73e4df6831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:18.531849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0a0fa-c7cb-408c-978d-fe73e4df6831 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.531974 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0a0fa-c7cb-408c-978d-fe73e4df6831 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.532140 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0a0fa-c7cb-408c-978d-fe73e4df6831 admin admin] PATH_INFO: `/v3/projects/f3647835f3bd4798bc799b8bd529565e/users/f08c8b064bdd445eb63298271d435b2e/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.540501 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91802533-68e5-428f-90a3-f286519619b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:18.541325 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91802533-68e5-428f-90a3-f286519619b0 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.541711 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91802533-68e5-428f-90a3-f286519619b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.542085 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91802533-68e5-428f-90a3-f286519619b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.546585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0a0fa-c7cb-408c-978d-fe73e4df6831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3647835f3bd4798bc799b8bd529565e, user_id=f08c8b064bdd445eb63298271d435b2e, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:18.549896 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0a0fa-c7cb-408c-978d-fe73e4df6831 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:18.564684 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 782/1553] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:18 2021] PUT /identity/v3/projects/f3647835f3bd4798bc799b8bd529565e/users/f08c8b064bdd445eb63298271d435b2e/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:18.565983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0a0fa-c7cb-408c-978d-fe73e4df6831 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:18.627211 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91802533-68e5-428f-90a3-f286519619b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:18.629528 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91802533-68e5-428f-90a3-f286519619b0 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:18.633066 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0a0fa-c7cb-408c-978d-fe73e4df6831 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:18.638419 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a53529-b18f-43fb-bae4-76f7270adf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:18.640649 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 772/1554] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:18 2021] GET /identity/v3/auth/tokens => generated 3442 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:18.642105 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a53529-b18f-43fb-bae4-76f7270adf39 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.642427 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a53529-b18f-43fb-bae4-76f7270adf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.642745 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a53529-b18f-43fb-bae4-76f7270adf39 admin admin] PATH_INFO: `/v3/projects/ef41634e76ef4d37bbd575ed8ecf1651/users/6a6413e9e01e4402b76f297f4754199c/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.643892 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91802533-68e5-428f-90a3-f286519619b0 service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:18.658444 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91802533-68e5-428f-90a3-f286519619b0 service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:18.665518 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58590b-4edc-4370-ba20-62c6b03de62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:18.666595 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58590b-4edc-4370-ba20-62c6b03de62f admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.666979 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58590b-4edc-4370-ba20-62c6b03de62f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.667362 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58590b-4edc-4370-ba20-62c6b03de62f admin admin] PATH_INFO: `/v3/projects/b5a6cceb24aa44478bc4e8452b794c34/users/a704df4e1ba0458c8f84f62330ff342e/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.670957 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a53529-b18f-43fb-bae4-76f7270adf39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef41634e76ef4d37bbd575ed8ecf1651, user_id=6a6413e9e01e4402b76f297f4754199c, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:18.675184 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a53529-b18f-43fb-bae4-76f7270adf39 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:18.689920 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58590b-4edc-4370-ba20-62c6b03de62f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a6cceb24aa44478bc4e8452b794c34, user_id=a704df4e1ba0458c8f84f62330ff342e, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:18.693130 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58590b-4edc-4370-ba20-62c6b03de62f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:18.704134 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 783/1555] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:18 2021] PUT /identity/v3/projects/ef41634e76ef4d37bbd575ed8ecf1651/users/6a6413e9e01e4402b76f297f4754199c/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:18.705883 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee5e06-dd20-44cb-b12f-33cf242c4795 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.706800 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee5e06-dd20-44cb-b12f-33cf242c4795 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.707156 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee5e06-dd20-44cb-b12f-33cf242c4795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.714935 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 773/1556] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:18 2021] PUT /identity/v3/projects/b5a6cceb24aa44478bc4e8452b794c34/users/a704df4e1ba0458c8f84f62330ff342e/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:18.714935 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58590b-4edc-4370-ba20-62c6b03de62f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:18.738890 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-31ee5e06-dd20-44cb-b12f-33cf242c4795 None None] MFA Rules not processed for user `83435d81142f4e83bd88290e4d404ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:18.740168 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-31ee5e06-dd20-44cb-b12f-33cf242c4795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:18.805550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58590b-4edc-4370-ba20-62c6b03de62f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:18.811175 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272acff-3cd0-4010-a3b2-b7f56fcbfac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:18.812288 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272acff-3cd0-4010-a3b2-b7f56fcbfac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.813235 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272acff-3cd0-4010-a3b2-b7f56fcbfac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.813614 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272acff-3cd0-4010-a3b2-b7f56fcbfac9 admin admin] PATH_INFO: `/v3/projects/f634e393e601455c96812d85c6a13f2d/users/640c37bc86e3416e887e7ea266396986/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.823958 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 784/1557] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:18 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:18.826322 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90005-93f6-43e4-be95-8413c2d89fd1 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.826667 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90005-93f6-43e4-be95-8413c2d89fd1 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.827002 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90005-93f6-43e4-be95-8413c2d89fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.832444 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272acff-3cd0-4010-a3b2-b7f56fcbfac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f634e393e601455c96812d85c6a13f2d, user_id=640c37bc86e3416e887e7ea266396986, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:18.835800 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272acff-3cd0-4010-a3b2-b7f56fcbfac9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:18.847695 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-97d90005-93f6-43e4-be95-8413c2d89fd1 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:18.849164 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-97d90005-93f6-43e4-be95-8413c2d89fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:18.854411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 774/1558] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:18 2021] PUT /identity/v3/projects/f634e393e601455c96812d85c6a13f2d/users/640c37bc86e3416e887e7ea266396986/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:18.855814 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99953785-2d53-413d-ba5b-c07be75ac1ca None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.856107 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99953785-2d53-413d-ba5b-c07be75ac1ca None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.856387 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99953785-2d53-413d-ba5b-c07be75ac1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.893716 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-99953785-2d53-413d-ba5b-c07be75ac1ca None None] MFA Rules not processed for user `f08c8b064bdd445eb63298271d435b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:18.894803 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-99953785-2d53-413d-ba5b-c07be75ac1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:18.947749 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 785/1559] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:18.949116 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c3fbc-7107-4cc2-aa8f-359bad2de3f4 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.949403 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c3fbc-7107-4cc2-aa8f-359bad2de3f4 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.949679 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c3fbc-7107-4cc2-aa8f-359bad2de3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.978053 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 775/1560] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:18 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:18.979475 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4aba19-0953-41fb-a09a-ebde2f0ea980 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:18.979882 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4aba19-0953-41fb-a09a-ebde2f0ea980 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:18.980218 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4aba19-0953-41fb-a09a-ebde2f0ea980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:18.983170 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-4e1c3fbc-7107-4cc2-aa8f-359bad2de3f4 None None] MFA Rules not processed for user `6a6413e9e01e4402b76f297f4754199c`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:18.984363 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4e1c3fbc-7107-4cc2-aa8f-359bad2de3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:19.001079 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-2f4aba19-0953-41fb-a09a-ebde2f0ea980 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:19.002387 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-2f4aba19-0953-41fb-a09a-ebde2f0ea980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:19.014373 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 776/1561] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:19.015619 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4aba19-0953-41fb-a09a-ebde2f0ea980 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:19.066001 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 786/1562] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:18 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:19.066792 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c3fbc-7107-4cc2-aa8f-359bad2de3f4 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:19.079822 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c3fbc-7107-4cc2-aa8f-359bad2de3f4 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:19.086236 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf20627-4dc8-40d1-b449-9f51d4e68e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:19.086997 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf20627-4dc8-40d1-b449-9f51d4e68e09 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:19.087348 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf20627-4dc8-40d1-b449-9f51d4e68e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:19.087852 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf20627-4dc8-40d1-b449-9f51d4e68e09 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:19.089060 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf20627-4dc8-40d1-b449-9f51d4e68e09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:19.091952 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf20627-4dc8-40d1-b449-9f51d4e68e09 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:19.105313 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4aba19-0953-41fb-a09a-ebde2f0ea980 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:19.110093 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40a342-426a-4c84-ad5e-32c89e8c924d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:19.110806 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40a342-426a-4c84-ad5e-32c89e8c924d service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:19.111094 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40a342-426a-4c84-ad5e-32c89e8c924d service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:19.111368 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40a342-426a-4c84-ad5e-32c89e8c924d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:19.127636 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 787/1563] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:19 2021] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:19.132075 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089042ca-f33c-46b1-b166-9722aebfa040 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:19.132367 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089042ca-f33c-46b1-b166-9722aebfa040 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:19.132696 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089042ca-f33c-46b1-b166-9722aebfa040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:19.163727 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-089042ca-f33c-46b1-b166-9722aebfa040 None None] MFA Rules not processed for user `640c37bc86e3416e887e7ea266396986`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:19.165213 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-089042ca-f33c-46b1-b166-9722aebfa040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:19.201114 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40a342-426a-4c84-ad5e-32c89e8c924d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:19.202597 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40a342-426a-4c84-ad5e-32c89e8c924d service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:19.213550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 777/1564] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:19 2021] GET /identity/v3/auth/tokens => generated 3377 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:19.214856 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40a342-426a-4c84-ad5e-32c89e8c924d service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:19.246795 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 788/1565] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:19 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:19.248411 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089042ca-f33c-46b1-b166-9722aebfa040 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:19.299314 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40a342-426a-4c84-ad5e-32c89e8c924d service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:19.308599 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089042ca-f33c-46b1-b166-9722aebfa040 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:19.313056 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d7229-7a8b-434d-9b5a-a597f1a1c4dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:19.313800 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d7229-7a8b-434d-9b5a-a597f1a1c4dd service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:19.314154 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d7229-7a8b-434d-9b5a-a597f1a1c4dd service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:19.314591 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d7229-7a8b-434d-9b5a-a597f1a1c4dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:19.368193 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c03086-bbac-4698-bbe6-bfa349e1ed83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:19.368907 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c03086-bbac-4698-bbe6-bfa349e1ed83 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:19.369208 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c03086-bbac-4698-bbe6-bfa349e1ed83 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:19.369481 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c03086-bbac-4698-bbe6-bfa349e1ed83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:19.404755 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d7229-7a8b-434d-9b5a-a597f1a1c4dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:19.409654 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d7229-7a8b-434d-9b5a-a597f1a1c4dd service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:19.424025 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 789/1566] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:19 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:19.424759 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d7229-7a8b-434d-9b5a-a597f1a1c4dd service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:19.435929 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d7229-7a8b-434d-9b5a-a597f1a1c4dd service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:19.449248 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9063827-543f-478a-8f7e-6aeb0de69b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:19.450056 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9063827-543f-478a-8f7e-6aeb0de69b06 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:19.450445 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9063827-543f-478a-8f7e-6aeb0de69b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:19.450838 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9063827-543f-478a-8f7e-6aeb0de69b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:19.477447 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c03086-bbac-4698-bbe6-bfa349e1ed83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:19.480493 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c03086-bbac-4698-bbe6-bfa349e1ed83 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:19.514228 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 778/1567] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:19.518362 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eeb92e-3f7e-42b9-a462-6646e11a14dc None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:19.520436 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eeb92e-3f7e-42b9-a462-6646e11a14dc None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:19.520792 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eeb92e-3f7e-42b9-a462-6646e11a14dc None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:19.523914 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 779/1568] 10.222.0.32 () {54 vars in 961 bytes} [Wed Sep 15 02:29:19 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:29:19.527204 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eeb92e-3f7e-42b9-a462-6646e11a14dc None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:19.568108 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eeb92e-3f7e-42b9-a462-6646e11a14dc None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:19.578051 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bce8b4-7cf7-4f86-9ba5-d3c930cb2f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:19.579405 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bce8b4-7cf7-4f86-9ba5-d3c930cb2f33 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:19.579690 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bce8b4-7cf7-4f86-9ba5-d3c930cb2f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:19.579963 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bce8b4-7cf7-4f86-9ba5-d3c930cb2f33 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:19.580653 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bce8b4-7cf7-4f86-9ba5-d3c930cb2f33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:19.582619 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bce8b4-7cf7-4f86-9ba5-d3c930cb2f33 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:19.603643 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9063827-543f-478a-8f7e-6aeb0de69b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:19.605127 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9063827-543f-478a-8f7e-6aeb0de69b06 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:19.623770 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 780/1569] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:19 2021] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:19.624602 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bce8b4-7cf7-4f86-9ba5-d3c930cb2f33 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:19.626916 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 790/1570] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:19.632773 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3249a-055a-480b-8b72-97d47546a25a None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:19.633185 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3249a-055a-480b-8b72-97d47546a25a None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:19.633406 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3249a-055a-480b-8b72-97d47546a25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:19.644212 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bce8b4-7cf7-4f86-9ba5-d3c930cb2f33 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:19.660005 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ebc7e-bb57-4789-9159-28a0404bd21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:19.660910 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ebc7e-bb57-4789-9159-28a0404bd21a admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:19.661528 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ebc7e-bb57-4789-9159-28a0404bd21a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:19.662006 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ebc7e-bb57-4789-9159-28a0404bd21a admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:19.662707 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-69a3249a-055a-480b-8b72-97d47546a25a None None] MFA Rules not processed for user `797b76e6f16d428198e7f7f05c9c0fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:19.663281 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ebc7e-bb57-4789-9159-28a0404bd21a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:19.664218 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-69a3249a-055a-480b-8b72-97d47546a25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:19.666942 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ebc7e-bb57-4789-9159-28a0404bd21a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:19.737067 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 781/1571] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:19 2021] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:19.737623 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ebc7e-bb57-4789-9159-28a0404bd21a admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:19.863148 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 791/1572] 10.222.0.32 () {58 vars in 1059 bytes} [Wed Sep 15 02:29:19 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:19.865242 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3249a-055a-480b-8b72-97d47546a25a None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:19.905501 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3249a-055a-480b-8b72-97d47546a25a None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:19.967072 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ebc7e-bb57-4789-9159-28a0404bd21a admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:19.977198 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ab487-4ea3-406f-97cc-78f52f24ed33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:19.982093 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ab487-4ea3-406f-97cc-78f52f24ed33 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:19.982480 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ab487-4ea3-406f-97cc-78f52f24ed33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:19.983159 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ab487-4ea3-406f-97cc-78f52f24ed33 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:19.983836 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ab487-4ea3-406f-97cc-78f52f24ed33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:19.994930 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ab487-4ea3-406f-97cc-78f52f24ed33 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:20.012945 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 782/1573] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:19 2021] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:20.012945 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ab487-4ea3-406f-97cc-78f52f24ed33 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:20.108627 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9dba2-789f-4555-9777-12faf10cb724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:20.110511 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9dba2-789f-4555-9777-12faf10cb724 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:20.114109 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9dba2-789f-4555-9777-12faf10cb724 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:20.114634 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9dba2-789f-4555-9777-12faf10cb724 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:20.115768 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9dba2-789f-4555-9777-12faf10cb724 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:20.120043 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9dba2-789f-4555-9777-12faf10cb724 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:20.135749 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ab487-4ea3-406f-97cc-78f52f24ed33 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:20.144418 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e398c5e-a4a7-4725-bf25-85c661598b1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:20.145310 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e398c5e-a4a7-4725-bf25-85c661598b1b service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:20.145626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e398c5e-a4a7-4725-bf25-85c661598b1b service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:20.146013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e398c5e-a4a7-4725-bf25-85c661598b1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:20.164296 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 792/1574] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:19 2021] POST /identity/v3/users => generated 297 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:20.167384 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9dba2-789f-4555-9777-12faf10cb724 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:20.189574 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9dba2-789f-4555-9777-12faf10cb724 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:20.236295 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e398c5e-a4a7-4725-bf25-85c661598b1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:20.238903 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e398c5e-a4a7-4725-bf25-85c661598b1b service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:20.243418 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed384a-6abe-47da-b9f0-a5c58863682e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:20.255300 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed384a-6abe-47da-b9f0-a5c58863682e admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:20.255484 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed384a-6abe-47da-b9f0-a5c58863682e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:20.255727 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed384a-6abe-47da-b9f0-a5c58863682e admin admin] PATH_INFO: `/v3/projects/690dd7df489e41f5b4a6f35779de5391/users/43c4342d2fa9465399559da620b2ca53/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:20.264394 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 783/1575] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:20 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:20.265310 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e398c5e-a4a7-4725-bf25-85c661598b1b service nova] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:20.278738 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e398c5e-a4a7-4725-bf25-85c661598b1b service nova] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:20.284019 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a3b51-c30d-4081-a824-dab6f4b0dfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:20.284908 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a3b51-c30d-4081-a824-dab6f4b0dfce admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:20.285027 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a3b51-c30d-4081-a824-dab6f4b0dfce admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:20.285257 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a3b51-c30d-4081-a824-dab6f4b0dfce admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:20.286241 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a3b51-c30d-4081-a824-dab6f4b0dfce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:20.287837 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a3b51-c30d-4081-a824-dab6f4b0dfce admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:20.299496 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 784/1576] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:20 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:20.310078 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a3b51-c30d-4081-a824-dab6f4b0dfce admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:20.327779 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a3b51-c30d-4081-a824-dab6f4b0dfce admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:20.336537 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f8806-5310-4324-96f9-e464b9b49834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:20.337390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed384a-6abe-47da-b9f0-a5c58863682e admin admin] RBAC: Authorizing `identity:create_grant(project_id=690dd7df489e41f5b4a6f35779de5391, user_id=43c4342d2fa9465399559da620b2ca53, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:20.337786 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f8806-5310-4324-96f9-e464b9b49834 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:20.338175 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f8806-5310-4324-96f9-e464b9b49834 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:20.338591 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f8806-5310-4324-96f9-e464b9b49834 admin admin] PATH_INFO: `/v3/projects/b957e240040b4569aaed9a55258e5ef8/users/299fbcb44ae04fa381bc40ceebe41567/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:20.353581 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed384a-6abe-47da-b9f0-a5c58863682e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:20.378310 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f8806-5310-4324-96f9-e464b9b49834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b957e240040b4569aaed9a55258e5ef8, user_id=299fbcb44ae04fa381bc40ceebe41567, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:20.381403 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f8806-5310-4324-96f9-e464b9b49834 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:20.384141 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 793/1577] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:20 2021] PUT /identity/v3/projects/690dd7df489e41f5b4a6f35779de5391/users/43c4342d2fa9465399559da620b2ca53/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:20.388069 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed384a-6abe-47da-b9f0-a5c58863682e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:20.410024 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 785/1578] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:20 2021] PUT /identity/v3/projects/b957e240040b4569aaed9a55258e5ef8/users/299fbcb44ae04fa381bc40ceebe41567/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:20.416298 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f8806-5310-4324-96f9-e464b9b49834 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:20.539216 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed384a-6abe-47da-b9f0-a5c58863682e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:20.553848 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa213cb3-fe80-4c6c-abfb-44686c913a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:20.555732 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa213cb3-fe80-4c6c-abfb-44686c913a8e admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:20.556030 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa213cb3-fe80-4c6c-abfb-44686c913a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:20.559630 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa213cb3-fe80-4c6c-abfb-44686c913a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:20.562273 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f8806-5310-4324-96f9-e464b9b49834 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:20.562929 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa213cb3-fe80-4c6c-abfb-44686c913a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:20.565920 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa213cb3-fe80-4c6c-abfb-44686c913a8e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:20.576171 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54d4d1-56db-44fb-82af-625c76ee146d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:20.576865 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54d4d1-56db-44fb-82af-625c76ee146d admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:20.577171 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54d4d1-56db-44fb-82af-625c76ee146d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:20.577450 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54d4d1-56db-44fb-82af-625c76ee146d admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:20.581074 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54d4d1-56db-44fb-82af-625c76ee146d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:20.582711 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54d4d1-56db-44fb-82af-625c76ee146d admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:20.600361 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 794/1579] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:20 2021] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:29:20.604191 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa213cb3-fe80-4c6c-abfb-44686c913a8e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:20.611057 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 786/1580] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:20 2021] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:20.613784 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54d4d1-56db-44fb-82af-625c76ee146d admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:20.619985 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa213cb3-fe80-4c6c-abfb-44686c913a8e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:20.649584 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b3827-78eb-4f8e-a36c-2853369ff5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:20.651747 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b3827-78eb-4f8e-a36c-2853369ff5da admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:20.653357 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54d4d1-56db-44fb-82af-625c76ee146d admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:20.654140 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b3827-78eb-4f8e-a36c-2853369ff5da admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:20.654438 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b3827-78eb-4f8e-a36c-2853369ff5da admin admin] PATH_INFO: `/v3/projects/690dd7df489e41f5b4a6f35779de5391/users/43c4342d2fa9465399559da620b2ca53/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:20.659993 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b3827-78eb-4f8e-a36c-2853369ff5da admin admin] RBAC: Authorizing `identity:create_grant(project_id=690dd7df489e41f5b4a6f35779de5391, user_id=43c4342d2fa9465399559da620b2ca53, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:20.664983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b3827-78eb-4f8e-a36c-2853369ff5da admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:20.678712 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f0745-fa75-4891-9d64-5dcb76c3b257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:20.679625 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f0745-fa75-4891-9d64-5dcb76c3b257 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:20.679907 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f0745-fa75-4891-9d64-5dcb76c3b257 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:20.680182 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f0745-fa75-4891-9d64-5dcb76c3b257 admin admin] PATH_INFO: `/v3/projects/b957e240040b4569aaed9a55258e5ef8/users/299fbcb44ae04fa381bc40ceebe41567/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:20.694434 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f0745-fa75-4891-9d64-5dcb76c3b257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b957e240040b4569aaed9a55258e5ef8, user_id=299fbcb44ae04fa381bc40ceebe41567, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:20.704003 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f0745-fa75-4891-9d64-5dcb76c3b257 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:20.719356 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 795/1581] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:20 2021] PUT /identity/v3/projects/690dd7df489e41f5b4a6f35779de5391/users/43c4342d2fa9465399559da620b2ca53/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:20.732023 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad998223-55b9-44a0-892a-39bb79d949b6 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:20.732507 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad998223-55b9-44a0-892a-39bb79d949b6 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:20.732831 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad998223-55b9-44a0-892a-39bb79d949b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:20.751078 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 787/1582] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:20 2021] PUT /identity/v3/projects/b957e240040b4569aaed9a55258e5ef8/users/299fbcb44ae04fa381bc40ceebe41567/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:20.762930 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16d16f-14b8-444a-bacd-24c0b428c68e None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:20.763383 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16d16f-14b8-444a-bacd-24c0b428c68e None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:20.763672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16d16f-14b8-444a-bacd-24c0b428c68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:20.842075 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-ad998223-55b9-44a0-892a-39bb79d949b6 None None] MFA Rules not processed for user `43c4342d2fa9465399559da620b2ca53`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:20.842752 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-8b16d16f-14b8-444a-bacd-24c0b428c68e None None] MFA Rules not processed for user `299fbcb44ae04fa381bc40ceebe41567`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:20.843869 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ad998223-55b9-44a0-892a-39bb79d949b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:20.846873 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8b16d16f-14b8-444a-bacd-24c0b428c68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:21.022842 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 796/1583] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:20 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:21.039443 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28270ef-1a48-4723-947c-82c906ec8645 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:21.039727 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28270ef-1a48-4723-947c-82c906ec8645 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:21.040003 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28270ef-1a48-4723-947c-82c906ec8645 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:21.042783 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 797/1584] 10.222.0.32 () {54 vars in 912 bytes} [Wed Sep 15 02:29:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:29:21.043392 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28270ef-1a48-4723-947c-82c906ec8645 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:21.052026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 788/1585] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:20 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:29:21.053660 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16d16f-14b8-444a-bacd-24c0b428c68e None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:21.168224 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28270ef-1a48-4723-947c-82c906ec8645 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:21.181642 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c17af-081a-4aed-8b15-a0ac53e61934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:21.182308 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c17af-081a-4aed-8b15-a0ac53e61934 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:21.182588 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c17af-081a-4aed-8b15-a0ac53e61934 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:21.182862 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c17af-081a-4aed-8b15-a0ac53e61934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:21.190725 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16d16f-14b8-444a-bacd-24c0b428c68e None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:21.200870 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c17af-081a-4aed-8b15-a0ac53e61934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:21.201430 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aadbecc-86b5-4194-acc9-c6738254fd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:21.202604 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadbecc-86b5-4194-acc9-c6738254fd20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:21.203000 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadbecc-86b5-4194-acc9-c6738254fd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:21.204273 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aadbecc-86b5-4194-acc9-c6738254fd20 admin admin] PATH_INFO: `/v3/users/640c37bc86e3416e887e7ea266396986` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:21.205335 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c17af-081a-4aed-8b15-a0ac53e61934 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:21.206358 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aadbecc-86b5-4194-acc9-c6738254fd20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=640c37bc86e3416e887e7ea266396986)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:21.211251 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aadbecc-86b5-4194-acc9-c6738254fd20 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:21.233733 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 798/1586] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:21 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:21.239501 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41c05c-a520-4e6a-a184-12e90e8cbc7c None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:21.239825 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41c05c-a520-4e6a-a184-12e90e8cbc7c None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:21.240109 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41c05c-a520-4e6a-a184-12e90e8cbc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:21.289722 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-9a41c05c-a520-4e6a-a184-12e90e8cbc7c None None] MFA Rules not processed for user `797b76e6f16d428198e7f7f05c9c0fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:21.293774 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-9a41c05c-a520-4e6a-a184-12e90e8cbc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:21.310826 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8aadbecc-86b5-4194-acc9-c6738254fd20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '640c37bc86e3416e887e7ea266396986'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:21.311731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8aadbecc-86b5-4194-acc9-c6738254fd20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '640c37bc86e3416e887e7ea266396986'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:21.330617 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8aadbecc-86b5-4194-acc9-c6738254fd20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '640c37bc86e3416e887e7ea266396986'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:21.331281 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8aadbecc-86b5-4194-acc9-c6738254fd20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '640c37bc86e3416e887e7ea266396986'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:21.353654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8aadbecc-86b5-4194-acc9-c6738254fd20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '640c37bc86e3416e887e7ea266396986'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:21.378040 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 789/1587] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:21 2021] DELETE /identity/v3/users/640c37bc86e3416e887e7ea266396986 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:21.383262 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10526790-3ead-427a-90d7-a55a355687ed None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:21.383823 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10526790-3ead-427a-90d7-a55a355687ed None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:21.384572 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10526790-3ead-427a-90d7-a55a355687ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:21.461540 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 799/1588] 10.222.0.32 () {58 vars in 1010 bytes} [Wed Sep 15 02:29:21 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:21.491673 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41c05c-a520-4e6a-a184-12e90e8cbc7c None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:21.493752 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-9a41c05c-a520-4e6a-a184-12e90e8cbc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:21.496405 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-10526790-3ead-427a-90d7-a55a355687ed None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:21.499373 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-10526790-3ead-427a-90d7-a55a355687ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:21.514061 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41c05c-a520-4e6a-a184-12e90e8cbc7c None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:21.629303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e4cae-8f5b-4e06-afcd-bdeefd897831 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:21.630295 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e4cae-8f5b-4e06-afcd-bdeefd897831 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:21.631065 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e4cae-8f5b-4e06-afcd-bdeefd897831 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:21.631351 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e4cae-8f5b-4e06-afcd-bdeefd897831 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:21.655095 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 790/1589] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:21.656766 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5393894-d766-4ad5-a47e-3ee252fc0f19 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:21.657089 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5393894-d766-4ad5-a47e-3ee252fc0f19 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:21.657365 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5393894-d766-4ad5-a47e-3ee252fc0f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:21.730551 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-f5393894-d766-4ad5-a47e-3ee252fc0f19 None None] MFA Rules not processed for user `b0b7aae305a145bb84b9e3624a41d7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:21.731767 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-f5393894-d766-4ad5-a47e-3ee252fc0f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:21.772863 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e4cae-8f5b-4e06-afcd-bdeefd897831 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:21.776526 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e4cae-8f5b-4e06-afcd-bdeefd897831 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:21.819013 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 800/1590] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:21 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:29:21.829943 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e4cae-8f5b-4e06-afcd-bdeefd897831 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:21.833456 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f48e4cae-8f5b-4e06-afcd-bdeefd897831 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:21.870926 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 791/1591] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:21 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:21.871894 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5393894-d766-4ad5-a47e-3ee252fc0f19 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:21.876563 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-f5393894-d766-4ad5-a47e-3ee252fc0f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:21.902375 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5393894-d766-4ad5-a47e-3ee252fc0f19 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:21.914237 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c26d99-0fb5-4213-a1f2-064ce1e21619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:21.914921 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c26d99-0fb5-4213-a1f2-064ce1e21619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:21.915252 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c26d99-0fb5-4213-a1f2-064ce1e21619 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:21.915448 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c26d99-0fb5-4213-a1f2-064ce1e21619 admin admin] PATH_INFO: `/v3/users/83435d81142f4e83bd88290e4d404ad3` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:21.918689 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c26d99-0fb5-4213-a1f2-064ce1e21619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83435d81142f4e83bd88290e4d404ad3)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:21.922726 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c26d99-0fb5-4213-a1f2-064ce1e21619 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:21.946894 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e4cae-8f5b-4e06-afcd-bdeefd897831 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:21.951417 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cefd8-22cd-42aa-80d2-225f6f4ed888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:21.952329 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cefd8-22cd-42aa-80d2-225f6f4ed888 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:21.952840 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cefd8-22cd-42aa-80d2-225f6f4ed888 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:21.953439 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cefd8-22cd-42aa-80d2-225f6f4ed888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:21.964034 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139cefd8-22cd-42aa-80d2-225f6f4ed888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:21.965638 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139cefd8-22cd-42aa-80d2-225f6f4ed888 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:21.980357 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 801/1592] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:21.982991 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2e821-1684-4e8f-85ec-60a90de85d31 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:21.983478 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2e821-1684-4e8f-85ec-60a90de85d31 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:21.983981 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2e821-1684-4e8f-85ec-60a90de85d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:22.019390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-c8a2e821-1684-4e8f-85ec-60a90de85d31 None None] MFA Rules not processed for user `b0b7aae305a145bb84b9e3624a41d7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:22.021347 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-c8a2e821-1684-4e8f-85ec-60a90de85d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:22.022545 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-03c26d99-0fb5-4213-a1f2-064ce1e21619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83435d81142f4e83bd88290e4d404ad3'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:22.024360 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-03c26d99-0fb5-4213-a1f2-064ce1e21619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83435d81142f4e83bd88290e4d404ad3'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:22.035805 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-03c26d99-0fb5-4213-a1f2-064ce1e21619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83435d81142f4e83bd88290e4d404ad3'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:22.036615 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-03c26d99-0fb5-4213-a1f2-064ce1e21619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83435d81142f4e83bd88290e4d404ad3'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:22.060677 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-03c26d99-0fb5-4213-a1f2-064ce1e21619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83435d81142f4e83bd88290e4d404ad3'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:22.074714 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 802/1593] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:21 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:22.094520 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d61f0-9701-4cdf-8787-4885d4377992 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:22.095032 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d61f0-9701-4cdf-8787-4885d4377992 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:22.095470 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d61f0-9701-4cdf-8787-4885d4377992 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:22.097677 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 803/1594] 10.222.0.32 () {54 vars in 961 bytes} [Wed Sep 15 02:29:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 02:29:22.106904 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 792/1595] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:21 2021] DELETE /identity/v3/users/83435d81142f4e83bd88290e4d404ad3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:22.108217 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddcec6-590a-48fd-8663-3d3878f249f7 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:22.108509 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddcec6-590a-48fd-8663-3d3878f249f7 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:22.108787 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddcec6-590a-48fd-8663-3d3878f249f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:22.111980 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019ccba-a882-4df3-91b5-faceb9ad8ea3 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:22.112561 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019ccba-a882-4df3-91b5-faceb9ad8ea3 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:22.113084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019ccba-a882-4df3-91b5-faceb9ad8ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:22.135238 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-b019ccba-a882-4df3-91b5-faceb9ad8ea3 None None] MFA Rules not processed for user `797b76e6f16d428198e7f7f05c9c0fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:22.136595 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b019ccba-a882-4df3-91b5-faceb9ad8ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:22.169231 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-70ddcec6-590a-48fd-8663-3d3878f249f7 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:22.173019 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-70ddcec6-590a-48fd-8663-3d3878f249f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:22.301460 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 793/1596] 10.222.0.32 () {58 vars in 1059 bytes} [Wed Sep 15 02:29:22 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:29:22.302876 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019ccba-a882-4df3-91b5-faceb9ad8ea3 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:22.321518 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019ccba-a882-4df3-91b5-faceb9ad8ea3 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:22.330419 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f498c47-c704-4ab9-bf9a-a172c474a9db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:22.331196 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f498c47-c704-4ab9-bf9a-a172c474a9db service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:22.331900 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f498c47-c704-4ab9-bf9a-a172c474a9db service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:22.332420 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f498c47-c704-4ab9-bf9a-a172c474a9db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:22.334644 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7f498c47-c704-4ab9-bf9a-a172c474a9db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:22.391506 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 804/1597] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:29:22.412943 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddcec6-590a-48fd-8663-3d3878f249f7 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:22.414558 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-70ddcec6-590a-48fd-8663-3d3878f249f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:22.495433 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f498c47-c704-4ab9-bf9a-a172c474a9db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:22.507475 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f498c47-c704-4ab9-bf9a-a172c474a9db service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:22.568815 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 794/1598] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:22 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:22.661600 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddcec6-590a-48fd-8663-3d3878f249f7 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:22.683543 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da159b07-16df-4af1-8223-705862e5a65c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:22.684396 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da159b07-16df-4af1-8223-705862e5a65c service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:22.684682 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da159b07-16df-4af1-8223-705862e5a65c service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:22.684975 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da159b07-16df-4af1-8223-705862e5a65c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:22.724698 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da159b07-16df-4af1-8223-705862e5a65c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:22.734294 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da159b07-16df-4af1-8223-705862e5a65c service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:22.785760 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 805/1599] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:29:23.224325 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cf7d9-fd63-45ef-be67-dc114f19c4fe None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:23.225154 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cf7d9-fd63-45ef-be67-dc114f19c4fe None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:23.225785 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cf7d9-fd63-45ef-be67-dc114f19c4fe None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:23.227950 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 795/1600] 10.222.0.32 () {54 vars in 912 bytes} [Wed Sep 15 02:29:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:29:23.235490 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7a3bc-6223-40f6-a026-a7f5516f5e38 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:23.236396 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7a3bc-6223-40f6-a026-a7f5516f5e38 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:23.236913 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7a3bc-6223-40f6-a026-a7f5516f5e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:23.276071 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-d4e7a3bc-6223-40f6-a026-a7f5516f5e38 None None] MFA Rules not processed for user `797b76e6f16d428198e7f7f05c9c0fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:23.278465 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d4e7a3bc-6223-40f6-a026-a7f5516f5e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:23.316394 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 806/1601] 10.222.0.32 () {58 vars in 1010 bytes} [Wed Sep 15 02:29:23 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:23.333834 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cf7d9-fd63-45ef-be67-dc114f19c4fe None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:23.336615 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-425cf7d9-fd63-45ef-be67-dc114f19c4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:23.407954 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7a3bc-6223-40f6-a026-a7f5516f5e38 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:23.410054 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d4e7a3bc-6223-40f6-a026-a7f5516f5e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:23.457419 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7a3bc-6223-40f6-a026-a7f5516f5e38 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:23.478707 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c93ceb-0f7f-480e-890d-c0c75c15fe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:23.479166 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c93ceb-0f7f-480e-890d-c0c75c15fe4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:23.479621 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c93ceb-0f7f-480e-890d-c0c75c15fe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:23.479745 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c93ceb-0f7f-480e-890d-c0c75c15fe4a admin admin] PATH_INFO: `/v3/projects/f634e393e601455c96812d85c6a13f2d` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:23.481824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c93ceb-0f7f-480e-890d-c0c75c15fe4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f634e393e601455c96812d85c6a13f2d)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:23.484935 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c93ceb-0f7f-480e-890d-c0c75c15fe4a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:23.527583 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cf7d9-fd63-45ef-be67-dc114f19c4fe None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:23.534097 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e31b99-11be-402e-a688-34eb2d0c8b33 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d661d14d94fa597aee037599de7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:23.534769 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e31b99-11be-402e-a688-34eb2d0c8b33 service glance] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:23.535050 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e31b99-11be-402e-a688-34eb2d0c8b33 service glance] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:23.535324 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e31b99-11be-402e-a688-34eb2d0c8b33 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:23.555556 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e31b99-11be-402e-a688-34eb2d0c8b33 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:23.557981 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e31b99-11be-402e-a688-34eb2d0c8b33 service glance] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:23.585608 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 796/1602] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:23 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:23.608429 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-03c93ceb-0f7f-480e-890d-c0c75c15fe4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f634e393e601455c96812d85c6a13f2d', 'request_id': 'req-03c93ceb-0f7f-480e-890d-c0c75c15fe4a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:23.620666 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-03c93ceb-0f7f-480e-890d-c0c75c15fe4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f634e393e601455c96812d85c6a13f2d', 'request_id': 'req-03c93ceb-0f7f-480e-890d-c0c75c15fe4a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:23.660599 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-03c93ceb-0f7f-480e-890d-c0c75c15fe4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f634e393e601455c96812d85c6a13f2d', 'request_id': 'req-03c93ceb-0f7f-480e-890d-c0c75c15fe4a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:23.672071 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-03c93ceb-0f7f-480e-890d-c0c75c15fe4a admin admin] The token cache is being invalidate because project f634e393e601455c96812d85c6a13f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:23.673271 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-03c93ceb-0f7f-480e-890d-c0c75c15fe4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:23.674133 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-03c93ceb-0f7f-480e-890d-c0c75c15fe4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:23.675920 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 807/1603] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:23 2021] DELETE /identity/v3/projects/f634e393e601455c96812d85c6a13f2d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:23.679881 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e31b99-11be-402e-a688-34eb2d0c8b33 service glance] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:23.691613 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e31b99-11be-402e-a688-34eb2d0c8b33 service glance] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:23.864617 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f083c-9152-445f-b200-4147d7283641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:23.865645 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f083c-9152-445f-b200-4147d7283641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:23.866184 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f083c-9152-445f-b200-4147d7283641 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:23.866776 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f083c-9152-445f-b200-4147d7283641 admin admin] PATH_INFO: `/v3/users/299fbcb44ae04fa381bc40ceebe41567` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:23.869025 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f083c-9152-445f-b200-4147d7283641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=299fbcb44ae04fa381bc40ceebe41567)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:23.874255 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f083c-9152-445f-b200-4147d7283641 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:23.987554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a44f083c-9152-445f-b200-4147d7283641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '299fbcb44ae04fa381bc40ceebe41567'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:23.988491 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a44f083c-9152-445f-b200-4147d7283641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '299fbcb44ae04fa381bc40ceebe41567'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:24.001948 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a44f083c-9152-445f-b200-4147d7283641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '299fbcb44ae04fa381bc40ceebe41567'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:24.002582 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a44f083c-9152-445f-b200-4147d7283641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '299fbcb44ae04fa381bc40ceebe41567'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:24.061058 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a44f083c-9152-445f-b200-4147d7283641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '299fbcb44ae04fa381bc40ceebe41567'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:24.089368 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 797/1604] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:23 2021] DELETE /identity/v3/users/299fbcb44ae04fa381bc40ceebe41567 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:24.154081 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8c5f0-592e-4660-8e99-6e1bac1988a8 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:24.154422 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8c5f0-592e-4660-8e99-6e1bac1988a8 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:24.154799 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8c5f0-592e-4660-8e99-6e1bac1988a8 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:24.158322 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 808/1605] 10.222.0.32 () {54 vars in 912 bytes} [Wed Sep 15 02:29:24 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:29:24.165339 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105b27f-80e6-41da-bdcc-8840141932de None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:24.165818 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105b27f-80e6-41da-bdcc-8840141932de None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:24.166097 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105b27f-80e6-41da-bdcc-8840141932de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:24.257186 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8c5f0-592e-4660-8e99-6e1bac1988a8 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:24.259485 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b5d8c5f0-592e-4660-8e99-6e1bac1988a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:24.396133 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-e105b27f-80e6-41da-bdcc-8840141932de None None] MFA Rules not processed for user `91566418241b40ab840e1c3bf9e096c9`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:24.397355 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e105b27f-80e6-41da-bdcc-8840141932de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:24.518256 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8c5f0-592e-4660-8e99-6e1bac1988a8 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:24.528539 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 798/1606] 10.222.0.32 () {58 vars in 1010 bytes} [Wed Sep 15 02:29:24 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:24.535253 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768b3d4-578a-4aef-83dc-2f92e0fff14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:24.536404 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768b3d4-578a-4aef-83dc-2f92e0fff14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:24.537067 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768b3d4-578a-4aef-83dc-2f92e0fff14f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:24.537632 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768b3d4-578a-4aef-83dc-2f92e0fff14f admin admin] PATH_INFO: `/v3/projects/1d2218879665430c9a1371516339fdd7` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:24.539030 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768b3d4-578a-4aef-83dc-2f92e0fff14f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d2218879665430c9a1371516339fdd7)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:24.541008 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768b3d4-578a-4aef-83dc-2f92e0fff14f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:24.585372 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105b27f-80e6-41da-bdcc-8840141932de None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:24.586980 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e105b27f-80e6-41da-bdcc-8840141932de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:24.608536 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105b27f-80e6-41da-bdcc-8840141932de None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:24.616502 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a768b3d4-578a-4aef-83dc-2f92e0fff14f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d2218879665430c9a1371516339fdd7', 'request_id': 'req-a768b3d4-578a-4aef-83dc-2f92e0fff14f'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:24.625594 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a768b3d4-578a-4aef-83dc-2f92e0fff14f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d2218879665430c9a1371516339fdd7', 'request_id': 'req-a768b3d4-578a-4aef-83dc-2f92e0fff14f'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:24.638572 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a768b3d4-578a-4aef-83dc-2f92e0fff14f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d2218879665430c9a1371516339fdd7', 'request_id': 'req-a768b3d4-578a-4aef-83dc-2f92e0fff14f'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:24.655845 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a768b3d4-578a-4aef-83dc-2f92e0fff14f admin admin] The token cache is being invalidate because project 1d2218879665430c9a1371516339fdd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:24.657138 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a768b3d4-578a-4aef-83dc-2f92e0fff14f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:24.660511 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a768b3d4-578a-4aef-83dc-2f92e0fff14f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:24.668674 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 809/1607] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:24 2021] DELETE /identity/v3/projects/1d2218879665430c9a1371516339fdd7 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:24.669947 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768b3d4-578a-4aef-83dc-2f92e0fff14f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:24.673638 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-a768b3d4-578a-4aef-83dc-2f92e0fff14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:24.743870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1e9f9-c9c9-4375-b36e-44c594844653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:24.744558 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1e9f9-c9c9-4375-b36e-44c594844653 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:24.744840 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1e9f9-c9c9-4375-b36e-44c594844653 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:24.745140 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1e9f9-c9c9-4375-b36e-44c594844653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:24.752000 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-0bb1e9f9-c9c9-4375-b36e-44c594844653 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:24.781197 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1e9f9-c9c9-4375-b36e-44c594844653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:24.787514 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1e9f9-c9c9-4375-b36e-44c594844653 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:24.790016 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768b3d4-578a-4aef-83dc-2f92e0fff14f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:24.822358 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0eec38-0716-41f9-a8f8-0c8481f37bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:24.824724 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0eec38-0716-41f9-a8f8-0c8481f37bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:24.824859 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 799/1608] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:24 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:24.825174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0eec38-0716-41f9-a8f8-0c8481f37bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:24.827630 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0eec38-0716-41f9-a8f8-0c8481f37bf7 admin admin] PATH_INFO: `/v3/users/43c4342d2fa9465399559da620b2ca53` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:24.829411 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0eec38-0716-41f9-a8f8-0c8481f37bf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c4342d2fa9465399559da620b2ca53)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:24.830451 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: WARNING py.warnings [None req-4b0eec38-0716-41f9-a8f8-0c8481f37bf7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:29:24.830451 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: warnings.warn(msg) Sep 15 02:29:24.830451 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: Sep 15 02:29:24.831686 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0eec38-0716-41f9-a8f8-0c8481f37bf7 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:24.937100 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-4b0eec38-0716-41f9-a8f8-0c8481f37bf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c4342d2fa9465399559da620b2ca53'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:24.995245 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-4b0eec38-0716-41f9-a8f8-0c8481f37bf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c4342d2fa9465399559da620b2ca53'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:24.996375 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-4b0eec38-0716-41f9-a8f8-0c8481f37bf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c4342d2fa9465399559da620b2ca53'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:25.014847 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-4b0eec38-0716-41f9-a8f8-0c8481f37bf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c4342d2fa9465399559da620b2ca53'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:25.034559 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-4b0eec38-0716-41f9-a8f8-0c8481f37bf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c4342d2fa9465399559da620b2ca53'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:25.056390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 810/1609] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:24 2021] DELETE /identity/v3/users/43c4342d2fa9465399559da620b2ca53 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:25.167864 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1e9f9-c9c9-4375-b36e-44c594844653 service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:25.173966 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-0bb1e9f9-c9c9-4375-b36e-44c594844653 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:25.243805 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1e9f9-c9c9-4375-b36e-44c594844653 service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:25.344638 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b025183-b437-4c2d-a543-4846e9300fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:25.345695 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b025183-b437-4c2d-a543-4846e9300fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:25.346475 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b025183-b437-4c2d-a543-4846e9300fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:25.346874 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b025183-b437-4c2d-a543-4846e9300fcd admin admin] PATH_INFO: `/v3/projects/b957e240040b4569aaed9a55258e5ef8` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:25.349973 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b025183-b437-4c2d-a543-4846e9300fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b957e240040b4569aaed9a55258e5ef8)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:25.351302 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING py.warnings [None req-1b025183-b437-4c2d-a543-4846e9300fcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 02:29:25.351302 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: warnings.warn(msg) Sep 15 02:29:25.351302 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: Sep 15 02:29:25.355437 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b025183-b437-4c2d-a543-4846e9300fcd admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:25.457017 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1b025183-b437-4c2d-a543-4846e9300fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b957e240040b4569aaed9a55258e5ef8', 'request_id': 'req-1b025183-b437-4c2d-a543-4846e9300fcd'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:25.461827 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0eec38-0716-41f9-a8f8-0c8481f37bf7 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:25.463405 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4b0eec38-0716-41f9-a8f8-0c8481f37bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:25.493982 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1b025183-b437-4c2d-a543-4846e9300fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b957e240040b4569aaed9a55258e5ef8', 'request_id': 'req-1b025183-b437-4c2d-a543-4846e9300fcd'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:25.518458 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1b025183-b437-4c2d-a543-4846e9300fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b957e240040b4569aaed9a55258e5ef8', 'request_id': 'req-1b025183-b437-4c2d-a543-4846e9300fcd'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:25.526353 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0eec38-0716-41f9-a8f8-0c8481f37bf7 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:25.562776 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1b025183-b437-4c2d-a543-4846e9300fcd admin admin] The token cache is being invalidate because project b957e240040b4569aaed9a55258e5ef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:25.563200 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1b025183-b437-4c2d-a543-4846e9300fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:25.565615 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1b025183-b437-4c2d-a543-4846e9300fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:25.568247 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 800/1610] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:25 2021] DELETE /identity/v3/projects/b957e240040b4569aaed9a55258e5ef8 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:25.574030 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17038101-5fec-42e0-a3c0-6f7f653ff159 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:25.574594 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17038101-5fec-42e0-a3c0-6f7f653ff159 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:25.575106 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17038101-5fec-42e0-a3c0-6f7f653ff159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:25.613570 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-17038101-5fec-42e0-a3c0-6f7f653ff159 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:25.614975 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-17038101-5fec-42e0-a3c0-6f7f653ff159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:25.781086 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 801/1611] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:25.790044 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee601e0d-106b-4dbb-86c1-a70304cf6044 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:25.790672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee601e0d-106b-4dbb-86c1-a70304cf6044 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:25.791192 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee601e0d-106b-4dbb-86c1-a70304cf6044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:25.792554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f88a3e-9dc6-4dcf-aafa-46cdd67038d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:25.793480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f88a3e-9dc6-4dcf-aafa-46cdd67038d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:25.793756 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f88a3e-9dc6-4dcf-aafa-46cdd67038d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:25.794027 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f88a3e-9dc6-4dcf-aafa-46cdd67038d8 admin admin] PATH_INFO: `/v3/users/6a6413e9e01e4402b76f297f4754199c` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:25.800038 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f88a3e-9dc6-4dcf-aafa-46cdd67038d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a6413e9e01e4402b76f297f4754199c)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:25.813752 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f88a3e-9dc6-4dcf-aafa-46cdd67038d8 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:25.832616 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-ee601e0d-106b-4dbb-86c1-a70304cf6044 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:25.834037 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-ee601e0d-106b-4dbb-86c1-a70304cf6044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:25.860460 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 802/1612] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:25.864207 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee601e0d-106b-4dbb-86c1-a70304cf6044 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:25.877944 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee601e0d-106b-4dbb-86c1-a70304cf6044 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:25.901447 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786007d-18a9-403d-b463-c941cc841cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:25.902524 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786007d-18a9-403d-b463-c941cc841cde admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:25.903021 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786007d-18a9-403d-b463-c941cc841cde admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:25.903483 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786007d-18a9-403d-b463-c941cc841cde admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:25.904469 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786007d-18a9-403d-b463-c941cc841cde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:25.905111 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786007d-18a9-403d-b463-c941cc841cde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:25.907115 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786007d-18a9-403d-b463-c941cc841cde admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:25.937855 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 803/1613] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:29:25.941682 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786007d-18a9-403d-b463-c941cc841cde admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:25.961203 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786007d-18a9-403d-b463-c941cc841cde admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:25.972464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-f8f88a3e-9dc6-4dcf-aafa-46cdd67038d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a6413e9e01e4402b76f297f4754199c'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:25.974960 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf3d54-b126-4ed9-859f-6f33ff8b1aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:25.976119 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf3d54-b126-4ed9-859f-6f33ff8b1aba admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:25.976615 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf3d54-b126-4ed9-859f-6f33ff8b1aba admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:25.977396 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf3d54-b126-4ed9-859f-6f33ff8b1aba admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:25.978533 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf3d54-b126-4ed9-859f-6f33ff8b1aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:25.980858 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf3d54-b126-4ed9-859f-6f33ff8b1aba admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:26.013712 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-f8f88a3e-9dc6-4dcf-aafa-46cdd67038d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a6413e9e01e4402b76f297f4754199c'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:26.024487 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-f8f88a3e-9dc6-4dcf-aafa-46cdd67038d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a6413e9e01e4402b76f297f4754199c'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:26.048039 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-f8f88a3e-9dc6-4dcf-aafa-46cdd67038d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a6413e9e01e4402b76f297f4754199c'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:26.055872 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 804/1614] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:25 2021] POST /identity/v3/projects => generated 363 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:26.057096 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf3d54-b126-4ed9-859f-6f33ff8b1aba admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:26.061133 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-dbaf3d54-b126-4ed9-859f-6f33ff8b1aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:26.081679 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-f8f88a3e-9dc6-4dcf-aafa-46cdd67038d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a6413e9e01e4402b76f297f4754199c'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:26.122448 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 811/1615] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:25 2021] DELETE /identity/v3/users/6a6413e9e01e4402b76f297f4754199c => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:26.127964 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2c8ca-a5f7-4ed9-91e5-3d808a9a4c92 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:26.128258 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2c8ca-a5f7-4ed9-91e5-3d808a9a4c92 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:26.128539 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2c8ca-a5f7-4ed9-91e5-3d808a9a4c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:26.192711 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-2ba2c8ca-a5f7-4ed9-91e5-3d808a9a4c92 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:26.195289 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-2ba2c8ca-a5f7-4ed9-91e5-3d808a9a4c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:26.259806 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf3d54-b126-4ed9-859f-6f33ff8b1aba admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:26.356480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 812/1616] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:26.357582 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2c8ca-a5f7-4ed9-91e5-3d808a9a4c92 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:26.361407 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-2ba2c8ca-a5f7-4ed9-91e5-3d808a9a4c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:26.384173 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c881477-96be-44a1-8eb8-2e8b0ee441d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:26.385029 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c881477-96be-44a1-8eb8-2e8b0ee441d0 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:26.385603 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c881477-96be-44a1-8eb8-2e8b0ee441d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:26.391432 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c881477-96be-44a1-8eb8-2e8b0ee441d0 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:26.394872 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c881477-96be-44a1-8eb8-2e8b0ee441d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:26.397305 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c881477-96be-44a1-8eb8-2e8b0ee441d0 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:26.440963 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 805/1617] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:26 2021] POST /identity/v3/users => generated 282 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:26.442670 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c881477-96be-44a1-8eb8-2e8b0ee441d0 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:26.444932 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-4c881477-96be-44a1-8eb8-2e8b0ee441d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:26.458949 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c881477-96be-44a1-8eb8-2e8b0ee441d0 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:26.467281 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4334bf9-8e40-4996-bbb9-fecb9da8d788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:26.468478 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4334bf9-8e40-4996-bbb9-fecb9da8d788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:26.469553 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4334bf9-8e40-4996-bbb9-fecb9da8d788 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:26.470083 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4334bf9-8e40-4996-bbb9-fecb9da8d788 admin admin] PATH_INFO: `/v3/projects/690dd7df489e41f5b4a6f35779de5391` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:26.471812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4334bf9-8e40-4996-bbb9-fecb9da8d788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=690dd7df489e41f5b4a6f35779de5391)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:26.474115 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4334bf9-8e40-4996-bbb9-fecb9da8d788 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:26.526197 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2c8ca-a5f7-4ed9-91e5-3d808a9a4c92 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:26.541467 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-d4334bf9-8e40-4996-bbb9-fecb9da8d788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '690dd7df489e41f5b4a6f35779de5391', 'request_id': 'req-d4334bf9-8e40-4996-bbb9-fecb9da8d788'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:26.554223 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-d4334bf9-8e40-4996-bbb9-fecb9da8d788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '690dd7df489e41f5b4a6f35779de5391', 'request_id': 'req-d4334bf9-8e40-4996-bbb9-fecb9da8d788'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:26.563315 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-d4334bf9-8e40-4996-bbb9-fecb9da8d788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '690dd7df489e41f5b4a6f35779de5391', 'request_id': 'req-d4334bf9-8e40-4996-bbb9-fecb9da8d788'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:26.580508 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-d4334bf9-8e40-4996-bbb9-fecb9da8d788 admin admin] The token cache is being invalidate because project 690dd7df489e41f5b4a6f35779de5391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:26.581063 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-d4334bf9-8e40-4996-bbb9-fecb9da8d788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:26.585458 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-d4334bf9-8e40-4996-bbb9-fecb9da8d788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:26.588212 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 806/1618] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:26 2021] DELETE /identity/v3/projects/690dd7df489e41f5b4a6f35779de5391 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:26.592523 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7271f6-cd12-4a2b-b8b0-0d4094f01977 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:26.592523 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7271f6-cd12-4a2b-b8b0-0d4094f01977 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:26.592523 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7271f6-cd12-4a2b-b8b0-0d4094f01977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:26.645398 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-de7271f6-cd12-4a2b-b8b0-0d4094f01977 None None] MFA Rules not processed for user `1a349783f06c414db888ac4f02a6e878`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:26.646707 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-de7271f6-cd12-4a2b-b8b0-0d4094f01977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:26.682252 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9888a1b-fde8-417e-9b7d-18604c42eed1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:26.682923 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9888a1b-fde8-417e-9b7d-18604c42eed1 service placement] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:26.683207 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9888a1b-fde8-417e-9b7d-18604c42eed1 service placement] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:26.683486 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9888a1b-fde8-417e-9b7d-18604c42eed1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:26.688226 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b9888a1b-fde8-417e-9b7d-18604c42eed1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:26.720791 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9888a1b-fde8-417e-9b7d-18604c42eed1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:26.722803 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9888a1b-fde8-417e-9b7d-18604c42eed1 service placement] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:26.753291 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 807/1619] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:26 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:26.753981 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7271f6-cd12-4a2b-b8b0-0d4094f01977 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:26.758579 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-de7271f6-cd12-4a2b-b8b0-0d4094f01977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:26.782203 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 813/1620] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:26 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:26.783089 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9888a1b-fde8-417e-9b7d-18604c42eed1 service placement] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:26.787332 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b9888a1b-fde8-417e-9b7d-18604c42eed1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:26.836494 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7271f6-cd12-4a2b-b8b0-0d4094f01977 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:26.845165 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c1d4b-e753-4bda-88c5-c849ac3c27bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:26.845927 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c1d4b-e753-4bda-88c5-c849ac3c27bf service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:26.846748 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c1d4b-e753-4bda-88c5-c849ac3c27bf service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:26.847102 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c1d4b-e753-4bda-88c5-c849ac3c27bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:26.849250 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-f00c1d4b-e753-4bda-88c5-c849ac3c27bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:26.926026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c1d4b-e753-4bda-88c5-c849ac3c27bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:26.927808 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c1d4b-e753-4bda-88c5-c849ac3c27bf service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:26.947226 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 808/1621] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:26.948799 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d92948-03f2-46f4-ae49-51c4c5b1ff26 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:26.949176 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d92948-03f2-46f4-ae49-51c4c5b1ff26 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:26.949519 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d92948-03f2-46f4-ae49-51c4c5b1ff26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:26.985523 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9888a1b-fde8-417e-9b7d-18604c42eed1 service placement] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:26.989665 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-d1d92948-03f2-46f4-ae49-51c4c5b1ff26 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:26.991293 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-d1d92948-03f2-46f4-ae49-51c4c5b1ff26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:26.996751 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde48538-b0e9-4004-9d6e-828d8e4e8b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:26.997801 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde48538-b0e9-4004-9d6e-828d8e4e8b11 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:26.998239 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde48538-b0e9-4004-9d6e-828d8e4e8b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:26.998709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde48538-b0e9-4004-9d6e-828d8e4e8b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:26.999605 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde48538-b0e9-4004-9d6e-828d8e4e8b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:27.003117 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde48538-b0e9-4004-9d6e-828d8e4e8b11 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:27.024918 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 814/1622] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:26 2021] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:27.026380 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde48538-b0e9-4004-9d6e-828d8e4e8b11 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:27.026718 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 809/1623] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:27.031676 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d92948-03f2-46f4-ae49-51c4c5b1ff26 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:27.037141 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-bde48538-b0e9-4004-9d6e-828d8e4e8b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:27.062812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d92948-03f2-46f4-ae49-51c4c5b1ff26 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:27.087119 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd5b3b-5c96-4d26-b6ef-66f6d8df8aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:27.087924 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd5b3b-5c96-4d26-b6ef-66f6d8df8aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:27.090922 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd5b3b-5c96-4d26-b6ef-66f6d8df8aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:27.092910 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd5b3b-5c96-4d26-b6ef-66f6d8df8aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:27.094821 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd5b3b-5c96-4d26-b6ef-66f6d8df8aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:27.102066 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd5b3b-5c96-4d26-b6ef-66f6d8df8aa4 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:27.153446 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 810/1624] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:27 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:27.157841 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd595c-ae88-4a8a-8233-2a1cab51a987 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:27.158031 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd595c-ae88-4a8a-8233-2a1cab51a987 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:27.158141 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd595c-ae88-4a8a-8233-2a1cab51a987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:27.198878 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-81bd595c-ae88-4a8a-8233-2a1cab51a987 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:27.202301 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-81bd595c-ae88-4a8a-8233-2a1cab51a987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:27.227918 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 811/1625] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:27.227918 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd595c-ae88-4a8a-8233-2a1cab51a987 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:27.240104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde48538-b0e9-4004-9d6e-828d8e4e8b11 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:27.254972 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ecea3-1133-4a62-ab2f-e70cef413b5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:27.255638 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ecea3-1133-4a62-ab2f-e70cef413b5d service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:27.256073 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ecea3-1133-4a62-ab2f-e70cef413b5d service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:27.256786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ecea3-1133-4a62-ab2f-e70cef413b5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:27.258397 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd595c-ae88-4a8a-8233-2a1cab51a987 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:27.269102 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ecea3-1133-4a62-ab2f-e70cef413b5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:27.271079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ecea3-1133-4a62-ab2f-e70cef413b5d service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:27.284444 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 815/1626] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:27 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:27.285464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ecea3-1133-4a62-ab2f-e70cef413b5d service nova] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:27.288299 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1eb8d9-d51a-477d-afb9-355792d135de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:27.289339 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1eb8d9-d51a-477d-afb9-355792d135de admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:27.289499 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1eb8d9-d51a-477d-afb9-355792d135de admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:27.289778 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1eb8d9-d51a-477d-afb9-355792d135de admin admin] PATH_INFO: `/v3/projects/97a79aeecd514dd89cec00cdd77eeb58/users/1e474ecc19c741baa6f48388bf442b39/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:27.300173 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ecea3-1133-4a62-ab2f-e70cef413b5d service nova] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:27.311206 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696b8f7-3c3f-4d73-8034-50fe65a1cb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:27.314480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696b8f7-3c3f-4d73-8034-50fe65a1cb5f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:27.314774 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696b8f7-3c3f-4d73-8034-50fe65a1cb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:27.316189 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696b8f7-3c3f-4d73-8034-50fe65a1cb5f admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:27.317478 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696b8f7-3c3f-4d73-8034-50fe65a1cb5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:27.317687 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696b8f7-3c3f-4d73-8034-50fe65a1cb5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:27.320667 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696b8f7-3c3f-4d73-8034-50fe65a1cb5f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:27.338811 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1eb8d9-d51a-477d-afb9-355792d135de admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a79aeecd514dd89cec00cdd77eeb58, user_id=1e474ecc19c741baa6f48388bf442b39, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:27.345065 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1eb8d9-d51a-477d-afb9-355792d135de admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:27.380739 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 812/1627] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:27 2021] PUT /identity/v3/projects/97a79aeecd514dd89cec00cdd77eeb58/users/1e474ecc19c741baa6f48388bf442b39/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:27.394360 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe608bd-878e-4f01-affd-47e160b79dd2 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:27.394668 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe608bd-878e-4f01-affd-47e160b79dd2 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:27.395009 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe608bd-878e-4f01-affd-47e160b79dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:27.422393 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 816/1628] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:27.424031 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696b8f7-3c3f-4d73-8034-50fe65a1cb5f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:27.454397 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696b8f7-3c3f-4d73-8034-50fe65a1cb5f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:27.461583 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-abe608bd-878e-4f01-affd-47e160b79dd2 None None] MFA Rules not processed for user `1e474ecc19c741baa6f48388bf442b39`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:27.481628 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-abe608bd-878e-4f01-affd-47e160b79dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:27.605655 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a0f73-5a2b-4d02-aa3c-ff95ebc4f420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:27.606399 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a0f73-5a2b-4d02-aa3c-ff95ebc4f420 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:27.607188 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a0f73-5a2b-4d02-aa3c-ff95ebc4f420 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:27.607536 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a0f73-5a2b-4d02-aa3c-ff95ebc4f420 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:27.608364 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a0f73-5a2b-4d02-aa3c-ff95ebc4f420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:27.619654 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a0f73-5a2b-4d02-aa3c-ff95ebc4f420 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:27.683045 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 817/1629] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:27 2021] POST /identity/v3/projects => generated 363 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:27.684101 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 813/1630] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:27 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:27.684251 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a0f73-5a2b-4d02-aa3c-ff95ebc4f420 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:27.689482 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-e43a0f73-5a2b-4d02-aa3c-ff95ebc4f420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:27.690431 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe608bd-878e-4f01-affd-47e160b79dd2 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:27.724935 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe608bd-878e-4f01-affd-47e160b79dd2 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:27.787891 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a0f73-5a2b-4d02-aa3c-ff95ebc4f420 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:27.794014 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c45011-0fa6-4ba6-9894-839823b911b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:27.795491 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c45011-0fa6-4ba6-9894-839823b911b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:27.796078 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c45011-0fa6-4ba6-9894-839823b911b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:27.796619 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c45011-0fa6-4ba6-9894-839823b911b4 admin admin] PATH_INFO: `/v3/projects/ef41634e76ef4d37bbd575ed8ecf1651` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:27.798563 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c45011-0fa6-4ba6-9894-839823b911b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef41634e76ef4d37bbd575ed8ecf1651)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:27.810699 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c45011-0fa6-4ba6-9894-839823b911b4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:27.919850 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-58c45011-0fa6-4ba6-9894-839823b911b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef41634e76ef4d37bbd575ed8ecf1651', 'request_id': 'req-58c45011-0fa6-4ba6-9894-839823b911b4'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:27.922541 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b9754-50ef-486d-bcbc-88ec83499e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:27.924017 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b9754-50ef-486d-bcbc-88ec83499e16 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:27.925184 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b9754-50ef-486d-bcbc-88ec83499e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:27.925473 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b9754-50ef-486d-bcbc-88ec83499e16 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:27.928535 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b9754-50ef-486d-bcbc-88ec83499e16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:27.931949 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b9754-50ef-486d-bcbc-88ec83499e16 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:27.934706 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-58c45011-0fa6-4ba6-9894-839823b911b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef41634e76ef4d37bbd575ed8ecf1651', 'request_id': 'req-58c45011-0fa6-4ba6-9894-839823b911b4'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:27.958864 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-58c45011-0fa6-4ba6-9894-839823b911b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef41634e76ef4d37bbd575ed8ecf1651', 'request_id': 'req-58c45011-0fa6-4ba6-9894-839823b911b4'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:27.987425 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-58c45011-0fa6-4ba6-9894-839823b911b4 admin admin] The token cache is being invalidate because project ef41634e76ef4d37bbd575ed8ecf1651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:27.987855 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-58c45011-0fa6-4ba6-9894-839823b911b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:27.989821 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-58c45011-0fa6-4ba6-9894-839823b911b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:27.993199 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 818/1631] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:27 2021] DELETE /identity/v3/projects/ef41634e76ef4d37bbd575ed8ecf1651 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:27.994787 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c45011-0fa6-4ba6-9894-839823b911b4 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:28.000674 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-58c45011-0fa6-4ba6-9894-839823b911b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:28.047783 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 814/1632] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:27 2021] POST /identity/v3/users => generated 282 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:28.048998 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7988b37-c7a7-4c1d-8dd4-502b25205d55 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:28.052403 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7988b37-c7a7-4c1d-8dd4-502b25205d55 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:28.052913 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7988b37-c7a7-4c1d-8dd4-502b25205d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:28.115511 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-c7988b37-c7a7-4c1d-8dd4-502b25205d55 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:28.117954 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c7988b37-c7a7-4c1d-8dd4-502b25205d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:28.213971 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c45011-0fa6-4ba6-9894-839823b911b4 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:28.234776 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a26cb8-8e8b-4136-bc02-e59095ede7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:28.235475 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a26cb8-8e8b-4136-bc02-e59095ede7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:28.235760 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a26cb8-8e8b-4136-bc02-e59095ede7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:28.236043 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a26cb8-8e8b-4136-bc02-e59095ede7e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:28.245282 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a26cb8-8e8b-4136-bc02-e59095ede7e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:28.247469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a26cb8-8e8b-4136-bc02-e59095ede7e1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:28.330295 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 819/1633] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:27 2021] POST /identity/v3/projects => generated 365 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:28.331256 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a26cb8-8e8b-4136-bc02-e59095ede7e1 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:28.334415 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-c0a26cb8-8e8b-4136-bc02-e59095ede7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:28.334633 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 815/1634] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:28.336808 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7988b37-c7a7-4c1d-8dd4-502b25205d55 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:28.350324 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7988b37-c7a7-4c1d-8dd4-502b25205d55 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:28.435468 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e921ed-d97c-4561-a272-3d32cb177302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:28.436166 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e921ed-d97c-4561-a272-3d32cb177302 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:28.436459 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e921ed-d97c-4561-a272-3d32cb177302 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:28.436799 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e921ed-d97c-4561-a272-3d32cb177302 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:28.438360 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e921ed-d97c-4561-a272-3d32cb177302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:28.440746 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e921ed-d97c-4561-a272-3d32cb177302 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:28.470539 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 816/1635] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:28 2021] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:28.472481 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cd724-b742-4e49-90cf-f7956dda2035 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:28.472813 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cd724-b742-4e49-90cf-f7956dda2035 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:28.473168 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cd724-b742-4e49-90cf-f7956dda2035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:28.528641 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-6c0cd724-b742-4e49-90cf-f7956dda2035 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:28.528641 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-6c0cd724-b742-4e49-90cf-f7956dda2035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:28.528641 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 817/1636] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:28.528641 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cd724-b742-4e49-90cf-f7956dda2035 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:28.539005 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cd724-b742-4e49-90cf-f7956dda2035 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:28.544688 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d1608-9093-4ef8-8078-04bdd212323b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:28.545219 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d1608-9093-4ef8-8078-04bdd212323b admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:28.545506 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d1608-9093-4ef8-8078-04bdd212323b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:28.545780 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d1608-9093-4ef8-8078-04bdd212323b admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:28.547287 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d1608-9093-4ef8-8078-04bdd212323b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:28.548958 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d1608-9093-4ef8-8078-04bdd212323b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:28.558993 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a26cb8-8e8b-4136-bc02-e59095ede7e1 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:28.560620 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 818/1637] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:28 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:28.561514 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d1608-9093-4ef8-8078-04bdd212323b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:28.580500 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fc6a6-4f2f-4d39-adb0-acb02ab9ea27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:28.581274 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fc6a6-4f2f-4d39-adb0-acb02ab9ea27 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:28.581563 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fc6a6-4f2f-4d39-adb0-acb02ab9ea27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:28.582243 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d1608-9093-4ef8-8078-04bdd212323b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:28.582445 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fc6a6-4f2f-4d39-adb0-acb02ab9ea27 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:28.583193 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fc6a6-4f2f-4d39-adb0-acb02ab9ea27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:28.584816 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fc6a6-4f2f-4d39-adb0-acb02ab9ea27 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:28.588959 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c282faa-0ccf-4df7-8203-d3965739ca15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:28.589833 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c282faa-0ccf-4df7-8203-d3965739ca15 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:28.590284 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c282faa-0ccf-4df7-8203-d3965739ca15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:28.590781 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c282faa-0ccf-4df7-8203-d3965739ca15 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:28.591783 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c282faa-0ccf-4df7-8203-d3965739ca15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:28.592268 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c282faa-0ccf-4df7-8203-d3965739ca15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:28.594160 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c282faa-0ccf-4df7-8203-d3965739ca15 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:28.604358 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 820/1638] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:28 2021] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:28.605300 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fc6a6-4f2f-4d39-adb0-acb02ab9ea27 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:28.612124 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 819/1639] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:28.613188 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c282faa-0ccf-4df7-8203-d3965739ca15 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:28.627872 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c282faa-0ccf-4df7-8203-d3965739ca15 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:28.631392 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fc6a6-4f2f-4d39-adb0-acb02ab9ea27 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:28.645578 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268aeae3-ab88-4bb9-a69c-5c7699226b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:28.646916 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268aeae3-ab88-4bb9-a69c-5c7699226b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:28.646916 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268aeae3-ab88-4bb9-a69c-5c7699226b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:28.647160 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268aeae3-ab88-4bb9-a69c-5c7699226b16 admin admin] PATH_INFO: `/v3/projects/f56d6d6aa832425da0dedbfcf5a478d9/users/7a14210424754291988688e7e6746033/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:28.652138 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c187e56-4f53-48b2-8de0-c8af669f9b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:28.654871 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c187e56-4f53-48b2-8de0-c8af669f9b81 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:28.655228 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c187e56-4f53-48b2-8de0-c8af669f9b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:28.655511 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c187e56-4f53-48b2-8de0-c8af669f9b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:28.661992 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c187e56-4f53-48b2-8de0-c8af669f9b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:28.663635 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c187e56-4f53-48b2-8de0-c8af669f9b81 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:28.685302 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268aeae3-ab88-4bb9-a69c-5c7699226b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56d6d6aa832425da0dedbfcf5a478d9, user_id=7a14210424754291988688e7e6746033, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:28.685557 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 820/1640] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:28 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:28.688870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c187e56-4f53-48b2-8de0-c8af669f9b81 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:28.693184 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268aeae3-ab88-4bb9-a69c-5c7699226b16 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:28.697858 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c187e56-4f53-48b2-8de0-c8af669f9b81 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:28.705142 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da0cc9-46af-4ec0-924c-200efb74f67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:28.705496 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da0cc9-46af-4ec0-924c-200efb74f67a admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:28.705831 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da0cc9-46af-4ec0-924c-200efb74f67a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:28.706112 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da0cc9-46af-4ec0-924c-200efb74f67a admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:28.706815 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da0cc9-46af-4ec0-924c-200efb74f67a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:28.709217 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da0cc9-46af-4ec0-924c-200efb74f67a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:28.740156 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 821/1641] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:28 2021] PUT /identity/v3/projects/f56d6d6aa832425da0dedbfcf5a478d9/users/7a14210424754291988688e7e6746033/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:28.741369 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268aeae3-ab88-4bb9-a69c-5c7699226b16 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:28.789409 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 821/1642] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:28 2021] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:28.789409 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da0cc9-46af-4ec0-924c-200efb74f67a admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:28.897002 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268aeae3-ab88-4bb9-a69c-5c7699226b16 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:28.969343 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da0cc9-46af-4ec0-924c-200efb74f67a admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:28.981752 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cb781-0292-4249-8b02-6978120ae5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:28.983220 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cb781-0292-4249-8b02-6978120ae5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:28.983505 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cb781-0292-4249-8b02-6978120ae5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:28.987120 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cb781-0292-4249-8b02-6978120ae5e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:28.988118 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cb781-0292-4249-8b02-6978120ae5e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:28.992570 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cb781-0292-4249-8b02-6978120ae5e3 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:29.016771 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 822/1643] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:28 2021] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:29.019446 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cb781-0292-4249-8b02-6978120ae5e3 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:29.041847 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6ea03-862f-4f20-a966-64a23eb096f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:29.042751 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6ea03-862f-4f20-a966-64a23eb096f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:29.043032 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6ea03-862f-4f20-a966-64a23eb096f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:29.043312 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6ea03-862f-4f20-a966-64a23eb096f5 admin admin] PATH_INFO: `/v3/projects/3841a841e151488abc6fd684c93713d9/users/62ce691ab7284c3db7d6306c62248e31/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:29.049750 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cb781-0292-4249-8b02-6978120ae5e3 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:29.081499 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b7d46-36f0-418d-b033-b4e9abb82bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:29.082667 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b7d46-36f0-418d-b033-b4e9abb82bef admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:29.085370 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b7d46-36f0-418d-b033-b4e9abb82bef admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:29.086629 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b7d46-36f0-418d-b033-b4e9abb82bef admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:29.089892 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b7d46-36f0-418d-b033-b4e9abb82bef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:29.095299 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b7d46-36f0-418d-b033-b4e9abb82bef admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:29.109721 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6ea03-862f-4f20-a966-64a23eb096f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3841a841e151488abc6fd684c93713d9, user_id=62ce691ab7284c3db7d6306c62248e31, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:29.118240 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6ea03-862f-4f20-a966-64a23eb096f5 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:29.159367 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 822/1644] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:28 2021] PUT /identity/v3/projects/3841a841e151488abc6fd684c93713d9/users/62ce691ab7284c3db7d6306c62248e31/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:29.165958 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6ea03-862f-4f20-a966-64a23eb096f5 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:29.211309 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 823/1645] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:29 2021] POST /identity/v3/users => generated 302 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:29.225934 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b7d46-36f0-418d-b033-b4e9abb82bef admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:29.286341 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b7d46-36f0-418d-b033-b4e9abb82bef admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:29.367599 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6ea03-862f-4f20-a966-64a23eb096f5 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:29.384855 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758519e5-3cd5-495f-a0b1-db7f0550ea0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:29.385884 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758519e5-3cd5-495f-a0b1-db7f0550ea0a admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:29.386166 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758519e5-3cd5-495f-a0b1-db7f0550ea0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:29.386443 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758519e5-3cd5-495f-a0b1-db7f0550ea0a admin admin] PATH_INFO: `/v3/projects/f56d6d6aa832425da0dedbfcf5a478d9/users/7a14210424754291988688e7e6746033/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:29.398419 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758519e5-3cd5-495f-a0b1-db7f0550ea0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56d6d6aa832425da0dedbfcf5a478d9, user_id=7a14210424754291988688e7e6746033, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:29.401637 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758519e5-3cd5-495f-a0b1-db7f0550ea0a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:29.457522 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a907d4c-7367-45e4-bff7-a4a0e5fdf9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:29.458467 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 823/1646] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:29 2021] PUT /identity/v3/projects/f56d6d6aa832425da0dedbfcf5a478d9/users/7a14210424754291988688e7e6746033/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:29.459287 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a907d4c-7367-45e4-bff7-a4a0e5fdf9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:29.459892 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a907d4c-7367-45e4-bff7-a4a0e5fdf9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:29.460464 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a907d4c-7367-45e4-bff7-a4a0e5fdf9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:29.461880 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a907d4c-7367-45e4-bff7-a4a0e5fdf9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:29.464842 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a907d4c-7367-45e4-bff7-a4a0e5fdf9d4 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:29.485654 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c200fa-88e5-4da2-b607-3ec04fb5aa87 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:29.486060 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c200fa-88e5-4da2-b607-3ec04fb5aa87 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:29.489367 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c200fa-88e5-4da2-b607-3ec04fb5aa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:29.515710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 824/1647] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:29 2021] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:29.520826 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a813b58-fbb6-4744-b2e0-ed5fe3dbe9ec None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:29.521250 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a813b58-fbb6-4744-b2e0-ed5fe3dbe9ec None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:29.523118 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a813b58-fbb6-4744-b2e0-ed5fe3dbe9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:29.553841 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-e8c200fa-88e5-4da2-b607-3ec04fb5aa87 None None] MFA Rules not processed for user `62ce691ab7284c3db7d6306c62248e31`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:29.556722 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-e8c200fa-88e5-4da2-b607-3ec04fb5aa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:29.614675 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-9a813b58-fbb6-4744-b2e0-ed5fe3dbe9ec None None] MFA Rules not processed for user `7a14210424754291988688e7e6746033`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:29.615755 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-9a813b58-fbb6-4744-b2e0-ed5fe3dbe9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:29.669173 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 824/1648] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:29 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:29.669173 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c200fa-88e5-4da2-b607-3ec04fb5aa87 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:29.758132 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c200fa-88e5-4da2-b607-3ec04fb5aa87 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:29.768891 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820e1b0-e729-4f6e-b462-8b14bdc44d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:29.769587 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820e1b0-e729-4f6e-b462-8b14bdc44d6c admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:29.769867 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820e1b0-e729-4f6e-b462-8b14bdc44d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:29.770138 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820e1b0-e729-4f6e-b462-8b14bdc44d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:29.771616 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820e1b0-e729-4f6e-b462-8b14bdc44d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:29.775966 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820e1b0-e729-4f6e-b462-8b14bdc44d6c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:29.798531 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 825/1649] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:29 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:29.799399 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820e1b0-e729-4f6e-b462-8b14bdc44d6c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:29.825492 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820e1b0-e729-4f6e-b462-8b14bdc44d6c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:29.836253 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6a47a-62cd-4f9f-884f-d0b973a2c4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:29.840193 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6a47a-62cd-4f9f-884f-d0b973a2c4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:29.840490 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6a47a-62cd-4f9f-884f-d0b973a2c4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:29.842583 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6a47a-62cd-4f9f-884f-d0b973a2c4b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:29.847525 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6a47a-62cd-4f9f-884f-d0b973a2c4b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:29.856030 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6a47a-62cd-4f9f-884f-d0b973a2c4b0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:29.865297 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 825/1650] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:29 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:29.867811 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a813b58-fbb6-4744-b2e0-ed5fe3dbe9ec None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:29.906658 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a813b58-fbb6-4744-b2e0-ed5fe3dbe9ec None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:29.919883 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 826/1651] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:29 2021] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:29.921178 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3b46e-f2d3-47db-a9aa-7d516d49aa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:29.921339 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6a47a-62cd-4f9f-884f-d0b973a2c4b0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:29.925081 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3b46e-f2d3-47db-a9aa-7d516d49aa9c admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:29.925550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3b46e-f2d3-47db-a9aa-7d516d49aa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:29.926457 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3b46e-f2d3-47db-a9aa-7d516d49aa9c admin admin] PATH_INFO: `/v3/projects/39d74d8136ed4bc29d461c03de3a975f/users/b4038012310f4d75bb41da3221f27774/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:29.928177 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-85e6a47a-62cd-4f9f-884f-d0b973a2c4b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:29.965940 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3b46e-f2d3-47db-a9aa-7d516d49aa9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d74d8136ed4bc29d461c03de3a975f, user_id=b4038012310f4d75bb41da3221f27774, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:29.976542 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3b46e-f2d3-47db-a9aa-7d516d49aa9c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:30.007096 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 826/1652] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:29 2021] PUT /identity/v3/projects/39d74d8136ed4bc29d461c03de3a975f/users/b4038012310f4d75bb41da3221f27774/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:30.008380 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3b46e-f2d3-47db-a9aa-7d516d49aa9c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:30.044490 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6a47a-62cd-4f9f-884f-d0b973a2c4b0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:30.117089 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cbe57-90ad-4df5-ba56-719d2a5efcdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:30.118758 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cbe57-90ad-4df5-ba56-719d2a5efcdb service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:30.119055 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cbe57-90ad-4df5-ba56-719d2a5efcdb service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:30.119339 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cbe57-90ad-4df5-ba56-719d2a5efcdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:30.207090 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3b46e-f2d3-47db-a9aa-7d516d49aa9c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:30.217319 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3074d-fa3b-47ff-9bc8-a7ef759a15a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:30.219504 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3074d-fa3b-47ff-9bc8-a7ef759a15a9 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:30.225467 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3074d-fa3b-47ff-9bc8-a7ef759a15a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:30.225467 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3074d-fa3b-47ff-9bc8-a7ef759a15a9 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:30.225467 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3074d-fa3b-47ff-9bc8-a7ef759a15a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:30.229667 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3074d-fa3b-47ff-9bc8-a7ef759a15a9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:30.271813 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 827/1653] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:30 2021] POST /identity/v3/users => generated 289 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:30.271813 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85917fc4-7e93-492d-9470-2c7b67976109 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:30.271813 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85917fc4-7e93-492d-9470-2c7b67976109 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:30.271813 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85917fc4-7e93-492d-9470-2c7b67976109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:30.276083 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175cbe57-90ad-4df5-ba56-719d2a5efcdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:30.277697 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175cbe57-90ad-4df5-ba56-719d2a5efcdb service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:30.303542 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 827/1654] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:29 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:30.304910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cbe57-90ad-4df5-ba56-719d2a5efcdb service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:30.326269 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cbe57-90ad-4df5-ba56-719d2a5efcdb service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:30.329538 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-85917fc4-7e93-492d-9470-2c7b67976109 None None] MFA Rules not processed for user `b4038012310f4d75bb41da3221f27774`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:30.335596 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-85917fc4-7e93-492d-9470-2c7b67976109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:30.338187 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77696f-1c36-4c86-9b33-db75bdb80678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:30.338991 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77696f-1c36-4c86-9b33-db75bdb80678 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:30.342034 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77696f-1c36-4c86-9b33-db75bdb80678 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:30.343666 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77696f-1c36-4c86-9b33-db75bdb80678 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:30.343666 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77696f-1c36-4c86-9b33-db75bdb80678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:30.346993 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77696f-1c36-4c86-9b33-db75bdb80678 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:30.373365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 828/1655] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:30 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:30.376110 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77696f-1c36-4c86-9b33-db75bdb80678 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:30.396381 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77696f-1c36-4c86-9b33-db75bdb80678 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:30.409430 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddebbc5-5381-45be-8bd3-ad0c82ad2329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:30.412654 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddebbc5-5381-45be-8bd3-ad0c82ad2329 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:30.413216 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddebbc5-5381-45be-8bd3-ad0c82ad2329 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:30.413877 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddebbc5-5381-45be-8bd3-ad0c82ad2329 admin admin] PATH_INFO: `/v3/projects/664d0e0890f148d991e632458bed1915/users/4feb9bc1575244fb8dea4868a8eadbc5/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:30.448267 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddebbc5-5381-45be-8bd3-ad0c82ad2329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=664d0e0890f148d991e632458bed1915, user_id=4feb9bc1575244fb8dea4868a8eadbc5, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:30.452370 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddebbc5-5381-45be-8bd3-ad0c82ad2329 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:30.495221 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 828/1657] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:30 2021] POST /identity/v3/auth/tokens => generated 3423 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:30.495373 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 829/1657] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:30 2021] PUT /identity/v3/projects/664d0e0890f148d991e632458bed1915/users/4feb9bc1575244fb8dea4868a8eadbc5/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:30.501994 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85917fc4-7e93-492d-9470-2c7b67976109 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:30.506985 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddebbc5-5381-45be-8bd3-ad0c82ad2329 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:30.520303 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85917fc4-7e93-492d-9470-2c7b67976109 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:30.583945 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddebbc5-5381-45be-8bd3-ad0c82ad2329 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:30.591866 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252cd57-10a1-4671-8f17-6a720aa123c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:30.592963 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252cd57-10a1-4671-8f17-6a720aa123c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:30.593459 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252cd57-10a1-4671-8f17-6a720aa123c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:30.593943 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252cd57-10a1-4671-8f17-6a720aa123c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:30.595750 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252cd57-10a1-4671-8f17-6a720aa123c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:30.598559 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252cd57-10a1-4671-8f17-6a720aa123c0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:30.630295 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 830/1658] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:30 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:30.633669 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de623b41-2062-4b82-9de1-2123359a4e86 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:30.634331 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de623b41-2062-4b82-9de1-2123359a4e86 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:30.635597 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de623b41-2062-4b82-9de1-2123359a4e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:30.681780 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a9c62-50a8-46b2-866d-206770b46e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:30.682613 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a9c62-50a8-46b2-866d-206770b46e33 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:30.684777 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a9c62-50a8-46b2-866d-206770b46e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:30.685150 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a9c62-50a8-46b2-866d-206770b46e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:30.685969 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a9c62-50a8-46b2-866d-206770b46e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:30.695143 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a9c62-50a8-46b2-866d-206770b46e33 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:30.724626 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-de623b41-2062-4b82-9de1-2123359a4e86 None None] MFA Rules not processed for user `a704df4e1ba0458c8f84f62330ff342e`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:30.725876 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-de623b41-2062-4b82-9de1-2123359a4e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:30.761010 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 829/1659] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:30 2021] POST /identity/v3/projects => generated 403 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:30.773314 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a9c62-50a8-46b2-866d-206770b46e33 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:30.911988 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a9c62-50a8-46b2-866d-206770b46e33 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:30.913807 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 831/1660] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:30 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:30.915075 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87543758-1ea1-4a82-b5c1-4d1fb863741e None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:30.915366 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87543758-1ea1-4a82-b5c1-4d1fb863741e None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:30.915644 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87543758-1ea1-4a82-b5c1-4d1fb863741e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:30.934463 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5c643-11c9-4c56-b8f4-71aa2a1f56b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:30.936644 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5c643-11c9-4c56-b8f4-71aa2a1f56b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:30.937772 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5c643-11c9-4c56-b8f4-71aa2a1f56b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:30.939184 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5c643-11c9-4c56-b8f4-71aa2a1f56b8 admin admin] PATH_INFO: `/v3/projects/664d0e0890f148d991e632458bed1915/users/4feb9bc1575244fb8dea4868a8eadbc5/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:30.944301 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5c643-11c9-4c56-b8f4-71aa2a1f56b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=664d0e0890f148d991e632458bed1915, user_id=4feb9bc1575244fb8dea4868a8eadbc5, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:30.958640 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5c643-11c9-4c56-b8f4-71aa2a1f56b8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:30.978554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-87543758-1ea1-4a82-b5c1-4d1fb863741e None None] MFA Rules not processed for user `a93401007dd64d88af5e41ff08679a28`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:30.980192 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-87543758-1ea1-4a82-b5c1-4d1fb863741e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:30.986084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 830/1661] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:30 2021] PUT /identity/v3/projects/664d0e0890f148d991e632458bed1915/users/4feb9bc1575244fb8dea4868a8eadbc5/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:30.989919 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5c643-11c9-4c56-b8f4-71aa2a1f56b8 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:31.096221 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 832/1662] 10.222.0.32 () {58 vars in 1010 bytes} [Wed Sep 15 02:29:30 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:31.097291 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87543758-1ea1-4a82-b5c1-4d1fb863741e None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:31.125809 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5c643-11c9-4c56-b8f4-71aa2a1f56b8 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:31.189927 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87543758-1ea1-4a82-b5c1-4d1fb863741e None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:31.193305 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0ed29-f18a-44f2-be80-421f34697e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:31.194375 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0ed29-f18a-44f2-be80-421f34697e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:31.194651 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0ed29-f18a-44f2-be80-421f34697e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:31.194934 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0ed29-f18a-44f2-be80-421f34697e00 admin admin] PATH_INFO: `/v3/users/1e474ecc19c741baa6f48388bf442b39` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:31.196348 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37d043-799e-4fd2-ab81-790020c89ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:31.197333 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d043-799e-4fd2-ab81-790020c89ebe admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:31.197450 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d043-799e-4fd2-ab81-790020c89ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:31.197662 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d043-799e-4fd2-ab81-790020c89ebe admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:31.198334 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37d043-799e-4fd2-ab81-790020c89ebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:31.200416 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0ed29-f18a-44f2-be80-421f34697e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e474ecc19c741baa6f48388bf442b39)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:31.202600 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0ed29-f18a-44f2-be80-421f34697e00 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:31.205553 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37d043-799e-4fd2-ab81-790020c89ebe admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:31.246180 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 833/1663] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:31 2021] POST /identity/v3/users => generated 308 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:31.247510 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b5cfd-d4dc-4ea7-b3dc-1d2f00ec1d68 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:31.247945 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b5cfd-d4dc-4ea7-b3dc-1d2f00ec1d68 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:31.248291 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b5cfd-d4dc-4ea7-b3dc-1d2f00ec1d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:31.272408 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-876b5cfd-d4dc-4ea7-b3dc-1d2f00ec1d68 None None] MFA Rules not processed for user `a704df4e1ba0458c8f84f62330ff342e`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:31.273920 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5ee0ed29-f18a-44f2-be80-421f34697e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e474ecc19c741baa6f48388bf442b39'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:31.274753 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-876b5cfd-d4dc-4ea7-b3dc-1d2f00ec1d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:31.274941 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5ee0ed29-f18a-44f2-be80-421f34697e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e474ecc19c741baa6f48388bf442b39'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:31.290113 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5ee0ed29-f18a-44f2-be80-421f34697e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e474ecc19c741baa6f48388bf442b39'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:31.291029 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5ee0ed29-f18a-44f2-be80-421f34697e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e474ecc19c741baa6f48388bf442b39'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:31.307297 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5ee0ed29-f18a-44f2-be80-421f34697e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e474ecc19c741baa6f48388bf442b39'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:31.322269 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 831/1664] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:30 2021] DELETE /identity/v3/users/1e474ecc19c741baa6f48388bf442b39 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:31.323956 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21f76b-3b8b-4a05-b55f-3ac6287e0a1c None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:31.324771 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21f76b-3b8b-4a05-b55f-3ac6287e0a1c None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:31.325923 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21f76b-3b8b-4a05-b55f-3ac6287e0a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:31.344346 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 834/1665] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:31 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:31.345488 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b5cfd-d4dc-4ea7-b3dc-1d2f00ec1d68 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:31.347231 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-876b5cfd-d4dc-4ea7-b3dc-1d2f00ec1d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:31.365339 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-2b21f76b-3b8b-4a05-b55f-3ac6287e0a1c None None] MFA Rules not processed for user `4feb9bc1575244fb8dea4868a8eadbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:31.367620 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-2b21f76b-3b8b-4a05-b55f-3ac6287e0a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:31.370576 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b5cfd-d4dc-4ea7-b3dc-1d2f00ec1d68 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:31.446823 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347eb4d-bb8e-4ccc-939b-ebdbf9cf4b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:31.447526 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347eb4d-bb8e-4ccc-939b-ebdbf9cf4b54 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:31.447813 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347eb4d-bb8e-4ccc-939b-ebdbf9cf4b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:31.448149 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347eb4d-bb8e-4ccc-939b-ebdbf9cf4b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:31.448826 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347eb4d-bb8e-4ccc-939b-ebdbf9cf4b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:31.451512 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347eb4d-bb8e-4ccc-939b-ebdbf9cf4b54 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:31.462897 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 835/1666] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:31 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:31.464231 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 832/1667] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:31 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:31.471142 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43cd40-2faf-4eaf-aa10-179728615b4c None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:31.471142 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43cd40-2faf-4eaf-aa10-179728615b4c None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:31.471142 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43cd40-2faf-4eaf-aa10-179728615b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:31.471493 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21f76b-3b8b-4a05-b55f-3ac6287e0a1c None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:31.474670 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-2b21f76b-3b8b-4a05-b55f-3ac6287e0a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:31.495047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-5a43cd40-2faf-4eaf-aa10-179728615b4c None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:31.496268 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-5a43cd40-2faf-4eaf-aa10-179728615b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:31.526095 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 836/1668] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:31.527273 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43cd40-2faf-4eaf-aa10-179728615b4c None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:31.529732 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-5a43cd40-2faf-4eaf-aa10-179728615b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:31.575613 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21f76b-3b8b-4a05-b55f-3ac6287e0a1c None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:31.605937 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68caddca-eeb8-47af-b1bb-44fca10d47a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:31.610905 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caddca-eeb8-47af-b1bb-44fca10d47a0 service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:31.611220 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caddca-eeb8-47af-b1bb-44fca10d47a0 service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:31.611606 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68caddca-eeb8-47af-b1bb-44fca10d47a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:31.614457 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-68caddca-eeb8-47af-b1bb-44fca10d47a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:31.662165 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43cd40-2faf-4eaf-aa10-179728615b4c None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:31.671295 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba3033-edb9-48ef-8761-4cbf680bf236 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea510f540b2d47dcb19c8715fd247786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:31.672011 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba3033-edb9-48ef-8761-4cbf680bf236 service swift] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:31.672301 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba3033-edb9-48ef-8761-4cbf680bf236 service swift] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:31.672574 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba3033-edb9-48ef-8761-4cbf680bf236 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:31.674582 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-40ba3033-edb9-48ef-8761-4cbf680bf236 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:31.754074 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68caddca-eeb8-47af-b1bb-44fca10d47a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:31.755975 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68caddca-eeb8-47af-b1bb-44fca10d47a0 service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:31.768134 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba3033-edb9-48ef-8761-4cbf680bf236 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:31.769980 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 833/1669] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:31 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:31.772081 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68caddca-eeb8-47af-b1bb-44fca10d47a0 service nova] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:31.772513 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba3033-edb9-48ef-8761-4cbf680bf236 service swift] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:31.797179 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68caddca-eeb8-47af-b1bb-44fca10d47a0 service nova] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:31.811363 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e3008-4113-4f3a-aeda-17858ff011f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:31.814514 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e3008-4113-4f3a-aeda-17858ff011f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:31.814514 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e3008-4113-4f3a-aeda-17858ff011f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:31.815302 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e3008-4113-4f3a-aeda-17858ff011f0 admin admin] PATH_INFO: `/v3/projects/fe40b72a5f704b7fb78c29e3df36e90d/users/687dfc4289df40db85c306c842e9bf40/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:31.840357 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 837/1670] 10.222.0.32 () {60 vars in 1385 bytes} [Wed Sep 15 02:29:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 02:29:31.844416 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba3033-edb9-48ef-8761-4cbf680bf236 service swift] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:31.850499 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-40ba3033-edb9-48ef-8761-4cbf680bf236 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:31.856361 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e3008-4113-4f3a-aeda-17858ff011f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe40b72a5f704b7fb78c29e3df36e90d, user_id=687dfc4289df40db85c306c842e9bf40, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:31.865992 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e3008-4113-4f3a-aeda-17858ff011f0 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:31.929130 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 834/1671] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:31 2021] PUT /identity/v3/projects/fe40b72a5f704b7fb78c29e3df36e90d/users/687dfc4289df40db85c306c842e9bf40/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:31.929130 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e3008-4113-4f3a-aeda-17858ff011f0 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:31.929898 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-0d6e3008-4113-4f3a-aeda-17858ff011f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:32.029699 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba3033-edb9-48ef-8761-4cbf680bf236 service swift] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:32.081710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e3008-4113-4f3a-aeda-17858ff011f0 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:32.097930 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0137e5-91ba-4d12-a815-c9ad566cc01e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:32.100109 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0137e5-91ba-4d12-a815-c9ad566cc01e service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:32.101973 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0137e5-91ba-4d12-a815-c9ad566cc01e service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:32.116239 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0137e5-91ba-4d12-a815-c9ad566cc01e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:32.126138 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f833a5d-609f-4805-b267-c5fef0d76fbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:32.127213 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f833a5d-609f-4805-b267-c5fef0d76fbc service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:32.127808 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f833a5d-609f-4805-b267-c5fef0d76fbc service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:32.128213 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f833a5d-609f-4805-b267-c5fef0d76fbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:32.324050 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0137e5-91ba-4d12-a815-c9ad566cc01e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:32.327071 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0137e5-91ba-4d12-a815-c9ad566cc01e service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:32.354572 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 835/1672] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:32.357159 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0137e5-91ba-4d12-a815-c9ad566cc01e service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:32.383485 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0137e5-91ba-4d12-a815-c9ad566cc01e service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:32.399378 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80334cd-59bf-4eff-ab6a-3c9926e03b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:32.400198 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80334cd-59bf-4eff-ab6a-3c9926e03b8f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:32.401809 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80334cd-59bf-4eff-ab6a-3c9926e03b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:32.403371 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f833a5d-609f-4805-b267-c5fef0d76fbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:32.403668 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80334cd-59bf-4eff-ab6a-3c9926e03b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:32.404545 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80334cd-59bf-4eff-ab6a-3c9926e03b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:32.404839 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f833a5d-609f-4805-b267-c5fef0d76fbc service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:32.408090 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80334cd-59bf-4eff-ab6a-3c9926e03b8f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:32.438435 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 838/1673] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:31 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:32.474061 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f833a5d-609f-4805-b267-c5fef0d76fbc service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:32.476111 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 836/1674] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:32 2021] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:32.502617 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f833a5d-609f-4805-b267-c5fef0d76fbc service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:32.518070 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d882f1-dc19-435d-ba50-6c9c0d5cbfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:32.521058 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d882f1-dc19-435d-ba50-6c9c0d5cbfb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:32.521356 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d882f1-dc19-435d-ba50-6c9c0d5cbfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:32.521779 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d882f1-dc19-435d-ba50-6c9c0d5cbfb2 admin admin] PATH_INFO: `/v3/projects/fe40b72a5f704b7fb78c29e3df36e90d/users/687dfc4289df40db85c306c842e9bf40/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:32.527715 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d882f1-dc19-435d-ba50-6c9c0d5cbfb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe40b72a5f704b7fb78c29e3df36e90d, user_id=687dfc4289df40db85c306c842e9bf40, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:32.544415 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d882f1-dc19-435d-ba50-6c9c0d5cbfb2 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:32.614501 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 839/1675] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:32 2021] PUT /identity/v3/projects/fe40b72a5f704b7fb78c29e3df36e90d/users/687dfc4289df40db85c306c842e9bf40/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:32.621449 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875a808-882d-43b9-bbb9-f8a99867c123 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:32.622076 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875a808-882d-43b9-bbb9-f8a99867c123 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:32.622595 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875a808-882d-43b9-bbb9-f8a99867c123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:32.648852 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d882f1-dc19-435d-ba50-6c9c0d5cbfb2 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:32.717941 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-7875a808-882d-43b9-bbb9-f8a99867c123 None None] MFA Rules not processed for user `687dfc4289df40db85c306c842e9bf40`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:32.725049 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7875a808-882d-43b9-bbb9-f8a99867c123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:32.929127 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d882f1-dc19-435d-ba50-6c9c0d5cbfb2 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:32.942838 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3a19a-bd6b-4900-b31b-0f3e36910712 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:32.944740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3a19a-bd6b-4900-b31b-0f3e36910712 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:32.945708 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3a19a-bd6b-4900-b31b-0f3e36910712 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:32.947391 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3a19a-bd6b-4900-b31b-0f3e36910712 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:32.960521 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f4f3a19a-bd6b-4900-b31b-0f3e36910712 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:32.966358 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 837/1676] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:32 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:29:33.030306 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875a808-882d-43b9-bbb9-f8a99867c123 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:33.032672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7875a808-882d-43b9-bbb9-f8a99867c123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:33.054360 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875a808-882d-43b9-bbb9-f8a99867c123 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:33.067873 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416da366-b314-45f1-aee1-4da190224af8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:33.068552 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416da366-b314-45f1-aee1-4da190224af8 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:33.071489 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416da366-b314-45f1-aee1-4da190224af8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:33.071840 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416da366-b314-45f1-aee1-4da190224af8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:33.109242 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416da366-b314-45f1-aee1-4da190224af8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:33.113846 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416da366-b314-45f1-aee1-4da190224af8 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:33.157411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 838/1677] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:33 2021] GET /identity/v3/auth/tokens => generated 3490 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:33.185753 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3a19a-bd6b-4900-b31b-0f3e36910712 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:33.193933 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3a19a-bd6b-4900-b31b-0f3e36910712 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:33.248026 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 840/1678] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:32 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:33.524754 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416da366-b314-45f1-aee1-4da190224af8 service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:33.717428 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416da366-b314-45f1-aee1-4da190224af8 service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:33.736290 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66a05b-0b26-43f3-b40f-17793f0cbd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:33.739967 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66a05b-0b26-43f3-b40f-17793f0cbd33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:33.741163 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66a05b-0b26-43f3-b40f-17793f0cbd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:33.742440 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66a05b-0b26-43f3-b40f-17793f0cbd33 admin admin] PATH_INFO: `/v3/users/b4038012310f4d75bb41da3221f27774` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:33.745679 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66a05b-0b26-43f3-b40f-17793f0cbd33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4038012310f4d75bb41da3221f27774)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:33.748118 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66a05b-0b26-43f3-b40f-17793f0cbd33 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:33.781576 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3a19a-bd6b-4900-b31b-0f3e36910712 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:33.784665 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f4f3a19a-bd6b-4900-b31b-0f3e36910712 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:33.806531 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3a19a-bd6b-4900-b31b-0f3e36910712 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:33.815665 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79578a-8d7d-4b4c-bd1a-a655c1d57efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:33.818853 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79578a-8d7d-4b4c-bd1a-a655c1d57efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:33.833798 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79578a-8d7d-4b4c-bd1a-a655c1d57efe admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:33.840125 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79578a-8d7d-4b4c-bd1a-a655c1d57efe admin admin] PATH_INFO: `/v3/users/f08c8b064bdd445eb63298271d435b2e` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:33.846129 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79578a-8d7d-4b4c-bd1a-a655c1d57efe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f08c8b064bdd445eb63298271d435b2e)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:33.852228 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79578a-8d7d-4b4c-bd1a-a655c1d57efe admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:33.907173 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ae66a05b-0b26-43f3-b40f-17793f0cbd33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4038012310f4d75bb41da3221f27774'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:33.909804 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ae66a05b-0b26-43f3-b40f-17793f0cbd33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4038012310f4d75bb41da3221f27774'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:33.920476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ae66a05b-0b26-43f3-b40f-17793f0cbd33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4038012310f4d75bb41da3221f27774'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:33.921268 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ae66a05b-0b26-43f3-b40f-17793f0cbd33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4038012310f4d75bb41da3221f27774'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:33.942760 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ae66a05b-0b26-43f3-b40f-17793f0cbd33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4038012310f4d75bb41da3221f27774'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:33.964285 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2c79578a-8d7d-4b4c-bd1a-a655c1d57efe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f08c8b064bdd445eb63298271d435b2e'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:33.977554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 839/1679] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:33 2021] DELETE /identity/v3/users/b4038012310f4d75bb41da3221f27774 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:33.979044 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25c930-6fc8-4610-b2b6-0c0f2897bc39 None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:33.982510 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25c930-6fc8-4610-b2b6-0c0f2897bc39 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:33.982862 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25c930-6fc8-4610-b2b6-0c0f2897bc39 None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:33.988544 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 840/1680] 10.222.0.32 () {54 vars in 912 bytes} [Wed Sep 15 02:29:33 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:29:33.990411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f57328-9458-408f-8b42-e6302dc2228e None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:33.991949 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f57328-9458-408f-8b42-e6302dc2228e None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:33.992209 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f57328-9458-408f-8b42-e6302dc2228e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:34.010762 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2c79578a-8d7d-4b4c-bd1a-a655c1d57efe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f08c8b064bdd445eb63298271d435b2e'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:34.024075 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2c79578a-8d7d-4b4c-bd1a-a655c1d57efe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f08c8b064bdd445eb63298271d435b2e'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:34.030233 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-07f57328-9458-408f-8b42-e6302dc2228e None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:34.031655 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-07f57328-9458-408f-8b42-e6302dc2228e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:34.040628 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2c79578a-8d7d-4b4c-bd1a-a655c1d57efe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f08c8b064bdd445eb63298271d435b2e'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:34.057591 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2c79578a-8d7d-4b4c-bd1a-a655c1d57efe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f08c8b064bdd445eb63298271d435b2e'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:34.066247 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 841/1681] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:33 2021] DELETE /identity/v3/users/f08c8b064bdd445eb63298271d435b2e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:34.068363 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5433c-d9eb-4993-bf09-e93cab66b504 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:34.068363 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5433c-d9eb-4993-bf09-e93cab66b504 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:34.071250 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5433c-d9eb-4993-bf09-e93cab66b504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:34.104461 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-0ad5433c-d9eb-4993-bf09-e93cab66b504 None None] MFA Rules not processed for user `91566418241b40ab840e1c3bf9e096c9`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:34.106226 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-0ad5433c-d9eb-4993-bf09-e93cab66b504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:34.178877 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 841/1682] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:34.183313 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1b6f4-2d46-40f3-99e6-b084cd6dc159 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:34.185281 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1b6f4-2d46-40f3-99e6-b084cd6dc159 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:34.187557 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1b6f4-2d46-40f3-99e6-b084cd6dc159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:34.204781 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 842/1683] 10.222.0.32 () {58 vars in 1010 bytes} [Wed Sep 15 02:29:34 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:34.208415 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebeffb-1a49-4ac8-89f8-4334e510e93b None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:34.208944 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebeffb-1a49-4ac8-89f8-4334e510e93b None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:34.209336 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebeffb-1a49-4ac8-89f8-4334e510e93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:34.240503 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-87ebeffb-1a49-4ac8-89f8-4334e510e93b None None] MFA Rules not processed for user `1a349783f06c414db888ac4f02a6e878`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:34.241873 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-87ebeffb-1a49-4ac8-89f8-4334e510e93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:34.263581 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-2ce1b6f4-2d46-40f3-99e6-b084cd6dc159 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:34.269438 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-2ce1b6f4-2d46-40f3-99e6-b084cd6dc159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:34.356535 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 843/1684] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:34 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:34.357803 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebeffb-1a49-4ac8-89f8-4334e510e93b None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:34.359833 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-87ebeffb-1a49-4ac8-89f8-4334e510e93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:34.389850 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebeffb-1a49-4ac8-89f8-4334e510e93b None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:34.395806 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1364f-c779-4b65-9354-447bbd59a6d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:34.396694 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1364f-c779-4b65-9354-447bbd59a6d8 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:34.397146 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1364f-c779-4b65-9354-447bbd59a6d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:34.397555 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1364f-c779-4b65-9354-447bbd59a6d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:34.436505 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 842/1685] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:34.436505 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1b6f4-2d46-40f3-99e6-b084cd6dc159 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:34.448139 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1b6f4-2d46-40f3-99e6-b084cd6dc159 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:34.464064 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52340988-787a-4728-87fb-c90d17dfd5b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:34.465178 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52340988-787a-4728-87fb-c90d17dfd5b1 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:34.467951 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52340988-787a-4728-87fb-c90d17dfd5b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:34.468288 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52340988-787a-4728-87fb-c90d17dfd5b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:34.476943 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52340988-787a-4728-87fb-c90d17dfd5b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:34.478481 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52340988-787a-4728-87fb-c90d17dfd5b1 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:34.492316 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 843/1686] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:34 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:34.496191 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2481a3-b10a-415a-acca-ca1bc8547c9f None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:34.496487 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2481a3-b10a-415a-acca-ca1bc8547c9f None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:34.496773 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2481a3-b10a-415a-acca-ca1bc8547c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:34.560824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1364f-c779-4b65-9354-447bbd59a6d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:34.563308 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1364f-c779-4b65-9354-447bbd59a6d8 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:34.586809 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 844/1687] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:34.588655 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1364f-c779-4b65-9354-447bbd59a6d8 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:34.590391 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-53d1364f-c779-4b65-9354-447bbd59a6d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:34.596928 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-1a2481a3-b10a-415a-acca-ca1bc8547c9f None None] MFA Rules not processed for user `91566418241b40ab840e1c3bf9e096c9`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:34.605450 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-1a2481a3-b10a-415a-acca-ca1bc8547c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:34.609457 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1364f-c779-4b65-9354-447bbd59a6d8 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:34.614739 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1a5a3-6acd-4507-86e1-9835fdb8b257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:34.615990 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1a5a3-6acd-4507-86e1-9835fdb8b257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:34.616424 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1a5a3-6acd-4507-86e1-9835fdb8b257 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:34.617341 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1a5a3-6acd-4507-86e1-9835fdb8b257 admin admin] PATH_INFO: `/v3/projects/97a79aeecd514dd89cec00cdd77eeb58` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:34.619124 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1a5a3-6acd-4507-86e1-9835fdb8b257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a79aeecd514dd89cec00cdd77eeb58)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:34.621390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1a5a3-6acd-4507-86e1-9835fdb8b257 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:34.661024 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 844/1688] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Sep 15 02:29:34 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:34.662079 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2481a3-b10a-415a-acca-ca1bc8547c9f None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:34.684561 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2481a3-b10a-415a-acca-ca1bc8547c9f None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:34.732225 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-98e1a5a3-6acd-4507-86e1-9835fdb8b257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a79aeecd514dd89cec00cdd77eeb58', 'request_id': 'req-98e1a5a3-6acd-4507-86e1-9835fdb8b257'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:34.751497 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-98e1a5a3-6acd-4507-86e1-9835fdb8b257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a79aeecd514dd89cec00cdd77eeb58', 'request_id': 'req-98e1a5a3-6acd-4507-86e1-9835fdb8b257'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:34.762384 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-98e1a5a3-6acd-4507-86e1-9835fdb8b257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a79aeecd514dd89cec00cdd77eeb58', 'request_id': 'req-98e1a5a3-6acd-4507-86e1-9835fdb8b257'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:34.799317 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-98e1a5a3-6acd-4507-86e1-9835fdb8b257 admin admin] The token cache is being invalidate because project 97a79aeecd514dd89cec00cdd77eeb58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:34.799878 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-98e1a5a3-6acd-4507-86e1-9835fdb8b257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:34.802096 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-98e1a5a3-6acd-4507-86e1-9835fdb8b257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:34.809028 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 845/1689] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:34 2021] DELETE /identity/v3/projects/97a79aeecd514dd89cec00cdd77eeb58 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:34.811855 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1a5a3-6acd-4507-86e1-9835fdb8b257 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:34.816025 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-98e1a5a3-6acd-4507-86e1-9835fdb8b257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:34.819075 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca7d48-e38e-4cff-a800-405ea9295601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:34.819853 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca7d48-e38e-4cff-a800-405ea9295601 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:34.820370 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca7d48-e38e-4cff-a800-405ea9295601 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:34.820982 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca7d48-e38e-4cff-a800-405ea9295601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:34.824191 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-25ca7d48-e38e-4cff-a800-405ea9295601 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:34.850716 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1a5a3-6acd-4507-86e1-9835fdb8b257 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:34.866488 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ad816-7cfa-4b19-9cd6-84c1a83d6fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:34.867820 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ad816-7cfa-4b19-9cd6-84c1a83d6fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:34.868695 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ad816-7cfa-4b19-9cd6-84c1a83d6fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:34.869442 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ad816-7cfa-4b19-9cd6-84c1a83d6fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:34.874552 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-e00ad816-7cfa-4b19-9cd6-84c1a83d6fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:34.925632 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ad816-7cfa-4b19-9cd6-84c1a83d6fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:34.927397 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ad816-7cfa-4b19-9cd6-84c1a83d6fa1 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:34.946953 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca7d48-e38e-4cff-a800-405ea9295601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:34.947533 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 846/1690] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:34 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:34.948611 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca7d48-e38e-4cff-a800-405ea9295601 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:34.948842 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ad816-7cfa-4b19-9cd6-84c1a83d6fa1 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:34.951333 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-e00ad816-7cfa-4b19-9cd6-84c1a83d6fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:34.971689 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 845/1691] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:34.997539 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ad816-7cfa-4b19-9cd6-84c1a83d6fa1 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:35.017687 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688729a4-3a8f-418c-ab4d-23ae5f156f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:35.018583 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688729a4-3a8f-418c-ab4d-23ae5f156f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:35.018871 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688729a4-3a8f-418c-ab4d-23ae5f156f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:35.019150 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688729a4-3a8f-418c-ab4d-23ae5f156f2e admin admin] PATH_INFO: `/v3/users/7a14210424754291988688e7e6746033` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:35.020510 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688729a4-3a8f-418c-ab4d-23ae5f156f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a14210424754291988688e7e6746033)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:35.022390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688729a4-3a8f-418c-ab4d-23ae5f156f2e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:35.113372 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-688729a4-3a8f-418c-ab4d-23ae5f156f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a14210424754291988688e7e6746033'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:35.148834 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-688729a4-3a8f-418c-ab4d-23ae5f156f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a14210424754291988688e7e6746033'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:35.149686 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-688729a4-3a8f-418c-ab4d-23ae5f156f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a14210424754291988688e7e6746033'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:35.176003 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-688729a4-3a8f-418c-ab4d-23ae5f156f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a14210424754291988688e7e6746033'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:35.184595 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-688729a4-3a8f-418c-ab4d-23ae5f156f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a14210424754291988688e7e6746033'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:35.201709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 847/1692] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:34 2021] DELETE /identity/v3/users/7a14210424754291988688e7e6746033 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:36.186380 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca7d48-e38e-4cff-a800-405ea9295601 service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:36.188626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-25ca7d48-e38e-4cff-a800-405ea9295601 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:36.254061 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688729a4-3a8f-418c-ab4d-23ae5f156f2e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:36.255944 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca7d48-e38e-4cff-a800-405ea9295601 service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:36.257330 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-688729a4-3a8f-418c-ab4d-23ae5f156f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:36.362667 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688729a4-3a8f-418c-ab4d-23ae5f156f2e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:36.371800 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dbb93-4864-4a47-9a6b-d44810ca6349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:36.373327 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dbb93-4864-4a47-9a6b-d44810ca6349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:36.373663 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dbb93-4864-4a47-9a6b-d44810ca6349 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:36.374119 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dbb93-4864-4a47-9a6b-d44810ca6349 admin admin] PATH_INFO: `/v3/projects/39d74d8136ed4bc29d461c03de3a975f` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:36.376222 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dbb93-4864-4a47-9a6b-d44810ca6349 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d74d8136ed4bc29d461c03de3a975f)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:36.379637 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dbb93-4864-4a47-9a6b-d44810ca6349 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:36.460105 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-415dbb93-4864-4a47-9a6b-d44810ca6349 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d74d8136ed4bc29d461c03de3a975f', 'request_id': 'req-415dbb93-4864-4a47-9a6b-d44810ca6349'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:36.474218 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-415dbb93-4864-4a47-9a6b-d44810ca6349 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d74d8136ed4bc29d461c03de3a975f', 'request_id': 'req-415dbb93-4864-4a47-9a6b-d44810ca6349'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:36.493690 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-415dbb93-4864-4a47-9a6b-d44810ca6349 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d74d8136ed4bc29d461c03de3a975f', 'request_id': 'req-415dbb93-4864-4a47-9a6b-d44810ca6349'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:36.512305 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-415dbb93-4864-4a47-9a6b-d44810ca6349 admin admin] The token cache is being invalidate because project 39d74d8136ed4bc29d461c03de3a975f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:36.513043 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-415dbb93-4864-4a47-9a6b-d44810ca6349 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:36.514803 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-415dbb93-4864-4a47-9a6b-d44810ca6349 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:36.519123 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 848/1693] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:36 2021] DELETE /identity/v3/projects/39d74d8136ed4bc29d461c03de3a975f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:36.524010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dbb93-4864-4a47-9a6b-d44810ca6349 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:36.527482 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-415dbb93-4864-4a47-9a6b-d44810ca6349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:36.540971 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1a667-b1c7-41b6-b6ff-13cbdf3e9d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:36.541711 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1a667-b1c7-41b6-b6ff-13cbdf3e9d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:36.541994 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1a667-b1c7-41b6-b6ff-13cbdf3e9d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:36.542268 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1a667-b1c7-41b6-b6ff-13cbdf3e9d27 admin admin] PATH_INFO: `/v3/projects/f3647835f3bd4798bc799b8bd529565e` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:36.543557 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1a667-b1c7-41b6-b6ff-13cbdf3e9d27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3647835f3bd4798bc799b8bd529565e)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:36.545674 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1a667-b1c7-41b6-b6ff-13cbdf3e9d27 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:36.671739 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-67b1a667-b1c7-41b6-b6ff-13cbdf3e9d27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3647835f3bd4798bc799b8bd529565e', 'request_id': 'req-67b1a667-b1c7-41b6-b6ff-13cbdf3e9d27'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:36.689310 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-67b1a667-b1c7-41b6-b6ff-13cbdf3e9d27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3647835f3bd4798bc799b8bd529565e', 'request_id': 'req-67b1a667-b1c7-41b6-b6ff-13cbdf3e9d27'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:36.699996 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-67b1a667-b1c7-41b6-b6ff-13cbdf3e9d27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3647835f3bd4798bc799b8bd529565e', 'request_id': 'req-67b1a667-b1c7-41b6-b6ff-13cbdf3e9d27'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:36.731426 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dbb93-4864-4a47-9a6b-d44810ca6349 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:36.752332 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-67b1a667-b1c7-41b6-b6ff-13cbdf3e9d27 admin admin] The token cache is being invalidate because project f3647835f3bd4798bc799b8bd529565e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:36.753091 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-67b1a667-b1c7-41b6-b6ff-13cbdf3e9d27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:36.754141 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-67b1a667-b1c7-41b6-b6ff-13cbdf3e9d27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:36.755936 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 846/1694] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:36 2021] DELETE /identity/v3/projects/f3647835f3bd4798bc799b8bd529565e => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:36.757410 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a8aef-49bc-455c-b149-2f78348eb236 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:36.757936 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a8aef-49bc-455c-b149-2f78348eb236 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:36.758374 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a8aef-49bc-455c-b149-2f78348eb236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:36.806923 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-145a8aef-49bc-455c-b149-2f78348eb236 None None] MFA Rules not processed for user `a704df4e1ba0458c8f84f62330ff342e`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:36.808831 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-145a8aef-49bc-455c-b149-2f78348eb236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:36.818401 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ecef6-174b-4906-83f0-d063e5c383fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:36.820258 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ecef6-174b-4906-83f0-d063e5c383fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:36.820914 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ecef6-174b-4906-83f0-d063e5c383fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:36.821384 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ecef6-174b-4906-83f0-d063e5c383fc admin admin] PATH_INFO: `/v3/users/687dfc4289df40db85c306c842e9bf40` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:36.823744 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ecef6-174b-4906-83f0-d063e5c383fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=687dfc4289df40db85c306c842e9bf40)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:36.826732 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ecef6-174b-4906-83f0-d063e5c383fc admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:36.918829 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-093ecef6-174b-4906-83f0-d063e5c383fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '687dfc4289df40db85c306c842e9bf40'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:36.944515 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 847/1695] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:36 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:36.946229 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db7911-3027-4cd6-bbad-3682e1bbe5bd None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:36.946677 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db7911-3027-4cd6-bbad-3682e1bbe5bd None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:36.947100 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db7911-3027-4cd6-bbad-3682e1bbe5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:36.982623 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-63db7911-3027-4cd6-bbad-3682e1bbe5bd None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:36.984626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-63db7911-3027-4cd6-bbad-3682e1bbe5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:36.991943 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-093ecef6-174b-4906-83f0-d063e5c383fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '687dfc4289df40db85c306c842e9bf40'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:36.995792 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-093ecef6-174b-4906-83f0-d063e5c383fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '687dfc4289df40db85c306c842e9bf40'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:37.007204 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 848/1696] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:37.015956 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-093ecef6-174b-4906-83f0-d063e5c383fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '687dfc4289df40db85c306c842e9bf40'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:37.024282 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec3a5d-7891-4cfc-863a-3410e1e57f1a None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:37.025069 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec3a5d-7891-4cfc-863a-3410e1e57f1a None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:37.026065 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec3a5d-7891-4cfc-863a-3410e1e57f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:37.052523 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-093ecef6-174b-4906-83f0-d063e5c383fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '687dfc4289df40db85c306c842e9bf40'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:37.081170 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 849/1697] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:36 2021] DELETE /identity/v3/users/687dfc4289df40db85c306c842e9bf40 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:37.116925 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-1dec3a5d-7891-4cfc-863a-3410e1e57f1a None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:37.121784 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-1dec3a5d-7891-4cfc-863a-3410e1e57f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:37.237038 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ecef6-174b-4906-83f0-d063e5c383fc admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:37.238951 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-093ecef6-174b-4906-83f0-d063e5c383fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:37.362849 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 849/1698] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:37.367441 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec3a5d-7891-4cfc-863a-3410e1e57f1a None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:37.394233 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec3a5d-7891-4cfc-863a-3410e1e57f1a None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:37.409419 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b694fdb-3453-4755-8470-f8c1477ce2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:37.410112 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b694fdb-3453-4755-8470-f8c1477ce2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:37.410394 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b694fdb-3453-4755-8470-f8c1477ce2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:37.410670 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b694fdb-3453-4755-8470-f8c1477ce2c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:37.411411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b694fdb-3453-4755-8470-f8c1477ce2c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:37.412101 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b694fdb-3453-4755-8470-f8c1477ce2c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:37.413775 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b694fdb-3453-4755-8470-f8c1477ce2c3 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:37.442892 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 850/1699] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:37.447293 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b694fdb-3453-4755-8470-f8c1477ce2c3 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:37.470441 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b694fdb-3453-4755-8470-f8c1477ce2c3 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:37.482327 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f15458-361d-4e61-a1ed-926d5b54a74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:37.483368 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f15458-361d-4e61-a1ed-926d5b54a74c admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:37.483639 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f15458-361d-4e61-a1ed-926d5b54a74c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:37.484467 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f15458-361d-4e61-a1ed-926d5b54a74c admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:37.485135 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f15458-361d-4e61-a1ed-926d5b54a74c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:37.487048 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f15458-361d-4e61-a1ed-926d5b54a74c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:37.512194 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ecef6-174b-4906-83f0-d063e5c383fc admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:37.532527 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3e60a-63d1-448d-bc52-370024bdd74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:37.533719 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3e60a-63d1-448d-bc52-370024bdd74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:37.535298 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3e60a-63d1-448d-bc52-370024bdd74d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:37.537433 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3e60a-63d1-448d-bc52-370024bdd74d admin admin] PATH_INFO: `/v3/users/62ce691ab7284c3db7d6306c62248e31` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:37.540120 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3e60a-63d1-448d-bc52-370024bdd74d admin admin] RBAC: Authorizing `identity:delete_user(user_id=62ce691ab7284c3db7d6306c62248e31)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:37.549612 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3e60a-63d1-448d-bc52-370024bdd74d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:37.554600 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 851/1700] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:37 2021] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:37.557244 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f15458-361d-4e61-a1ed-926d5b54a74c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:37.691486 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e5f3e60a-63d1-448d-bc52-370024bdd74d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62ce691ab7284c3db7d6306c62248e31'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:37.723946 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e5f3e60a-63d1-448d-bc52-370024bdd74d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62ce691ab7284c3db7d6306c62248e31'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:37.724977 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e5f3e60a-63d1-448d-bc52-370024bdd74d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62ce691ab7284c3db7d6306c62248e31'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:37.742371 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e5f3e60a-63d1-448d-bc52-370024bdd74d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62ce691ab7284c3db7d6306c62248e31'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:37.768372 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f15458-361d-4e61-a1ed-926d5b54a74c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:37.768841 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e5f3e60a-63d1-448d-bc52-370024bdd74d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62ce691ab7284c3db7d6306c62248e31'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:37.782952 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 850/1701] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:37 2021] DELETE /identity/v3/users/62ce691ab7284c3db7d6306c62248e31 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:29:37.789021 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617d1b1-f206-4a49-9209-54f90b8f5be1 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:37.789613 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617d1b1-f206-4a49-9209-54f90b8f5be1 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:37.790102 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617d1b1-f206-4a49-9209-54f90b8f5be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:37.793291 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00c3f2-c6c8-4421-a9be-b8f9a22c7afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:37.796835 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00c3f2-c6c8-4421-a9be-b8f9a22c7afa admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:37.797192 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00c3f2-c6c8-4421-a9be-b8f9a22c7afa admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:37.797482 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00c3f2-c6c8-4421-a9be-b8f9a22c7afa admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:37.802439 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00c3f2-c6c8-4421-a9be-b8f9a22c7afa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:37.808478 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00c3f2-c6c8-4421-a9be-b8f9a22c7afa admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:37.832232 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-b617d1b1-f206-4a49-9209-54f90b8f5be1 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:37.833902 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b617d1b1-f206-4a49-9209-54f90b8f5be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:37.897438 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 852/1702] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:37 2021] POST /identity/v3/users => generated 290 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:37.903377 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00c3f2-c6c8-4421-a9be-b8f9a22c7afa admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:37.910306 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-5a00c3f2-c6c8-4421-a9be-b8f9a22c7afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:37.964393 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00c3f2-c6c8-4421-a9be-b8f9a22c7afa admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:37.978270 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a95733-076c-408f-8131-b94bd5cb25e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:37.980139 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a95733-076c-408f-8131-b94bd5cb25e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:37.980433 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a95733-076c-408f-8131-b94bd5cb25e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:37.981199 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a95733-076c-408f-8131-b94bd5cb25e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:37.984676 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 851/1703] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:37.985034 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a95733-076c-408f-8131-b94bd5cb25e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:37.987971 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a95733-076c-408f-8131-b94bd5cb25e0 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:37.997360 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617d1b1-f206-4a49-9209-54f90b8f5be1 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:37.999205 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b617d1b1-f206-4a49-9209-54f90b8f5be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:38.017101 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 853/1704] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:37 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:38.018861 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a95733-076c-408f-8131-b94bd5cb25e0 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:38.021519 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617d1b1-f206-4a49-9209-54f90b8f5be1 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:38.037702 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cba47-e526-42bc-b4f4-5d67ae6973bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:38.038593 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cba47-e526-42bc-b4f4-5d67ae6973bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:38.038876 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cba47-e526-42bc-b4f4-5d67ae6973bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:38.039140 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cba47-e526-42bc-b4f4-5d67ae6973bc admin admin] PATH_INFO: `/v3/projects/f56d6d6aa832425da0dedbfcf5a478d9` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:38.041844 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cba47-e526-42bc-b4f4-5d67ae6973bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f56d6d6aa832425da0dedbfcf5a478d9)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:38.048202 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cba47-e526-42bc-b4f4-5d67ae6973bc admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:38.100011 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a95733-076c-408f-8131-b94bd5cb25e0 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:38.123582 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dab9d9-3e17-4265-969c-2133efd2edeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:38.124308 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dab9d9-3e17-4265-969c-2133efd2edeb admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:38.125151 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dab9d9-3e17-4265-969c-2133efd2edeb admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:38.125427 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dab9d9-3e17-4265-969c-2133efd2edeb admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:38.126546 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dab9d9-3e17-4265-969c-2133efd2edeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:38.144685 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dab9d9-3e17-4265-969c-2133efd2edeb admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:38.190919 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 854/1705] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:38 2021] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:38.191835 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dab9d9-3e17-4265-969c-2133efd2edeb admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:38.198348 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-92dab9d9-3e17-4265-969c-2133efd2edeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:38.268160 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-372cba47-e526-42bc-b4f4-5d67ae6973bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f56d6d6aa832425da0dedbfcf5a478d9', 'request_id': 'req-372cba47-e526-42bc-b4f4-5d67ae6973bc'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:38.300099 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-372cba47-e526-42bc-b4f4-5d67ae6973bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f56d6d6aa832425da0dedbfcf5a478d9', 'request_id': 'req-372cba47-e526-42bc-b4f4-5d67ae6973bc'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:38.316470 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-372cba47-e526-42bc-b4f4-5d67ae6973bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f56d6d6aa832425da0dedbfcf5a478d9', 'request_id': 'req-372cba47-e526-42bc-b4f4-5d67ae6973bc'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:38.402347 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-372cba47-e526-42bc-b4f4-5d67ae6973bc admin admin] The token cache is being invalidate because project f56d6d6aa832425da0dedbfcf5a478d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:38.403019 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-372cba47-e526-42bc-b4f4-5d67ae6973bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:38.404763 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-372cba47-e526-42bc-b4f4-5d67ae6973bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:38.407938 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 852/1706] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:37 2021] DELETE /identity/v3/projects/f56d6d6aa832425da0dedbfcf5a478d9 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:29:38.409489 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cba47-e526-42bc-b4f4-5d67ae6973bc admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:38.412686 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-372cba47-e526-42bc-b4f4-5d67ae6973bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:38.476707 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dab9d9-3e17-4265-969c-2133efd2edeb admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:38.610144 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cba47-e526-42bc-b4f4-5d67ae6973bc admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:38.637544 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f91004-5f7f-4389-af02-a88f0318951e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:38.638273 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f91004-5f7f-4389-af02-a88f0318951e admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:38.638556 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f91004-5f7f-4389-af02-a88f0318951e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:38.638877 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f91004-5f7f-4389-af02-a88f0318951e admin admin] PATH_INFO: `/v3/projects/f05cc0d421f74b79b332e64275d9ebc0/users/d0503fb57f61443cbe2a86b980d0b4f9/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:38.684444 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c1b17-9d52-44ba-b2fb-e9910ab9758d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:38.685350 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c1b17-9d52-44ba-b2fb-e9910ab9758d service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:38.687144 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c1b17-9d52-44ba-b2fb-e9910ab9758d service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:38.687799 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c1b17-9d52-44ba-b2fb-e9910ab9758d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:38.691065 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f91004-5f7f-4389-af02-a88f0318951e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f05cc0d421f74b79b332e64275d9ebc0, user_id=d0503fb57f61443cbe2a86b980d0b4f9, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:38.696762 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f91004-5f7f-4389-af02-a88f0318951e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:38.701890 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7e3c1b17-9d52-44ba-b2fb-e9910ab9758d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:38.747904 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 853/1707] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:38 2021] PUT /identity/v3/projects/f05cc0d421f74b79b332e64275d9ebc0/users/d0503fb57f61443cbe2a86b980d0b4f9/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:38.749549 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e24a2-d9de-4051-978b-1faac8429a4b None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:38.749844 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e24a2-d9de-4051-978b-1faac8429a4b None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:38.753262 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e24a2-d9de-4051-978b-1faac8429a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:38.756638 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c1b17-9d52-44ba-b2fb-e9910ab9758d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:38.763196 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c1b17-9d52-44ba-b2fb-e9910ab9758d service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:38.796906 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-998e24a2-d9de-4051-978b-1faac8429a4b None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:38.800577 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-998e24a2-d9de-4051-978b-1faac8429a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:38.827040 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 855/1708] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:38.829082 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da2040-39b9-4f97-9586-90af51d25b06 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:38.829404 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da2040-39b9-4f97-9586-90af51d25b06 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:38.829662 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da2040-39b9-4f97-9586-90af51d25b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:38.930873 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-64da2040-39b9-4f97-9586-90af51d25b06 None None] MFA Rules not processed for user `d0503fb57f61443cbe2a86b980d0b4f9`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:38.932103 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-64da2040-39b9-4f97-9586-90af51d25b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:39.080464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 854/1709] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:39.097768 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4e09b-c236-446c-9ed7-e9c73f9b53f8 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:39.099479 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4e09b-c236-446c-9ed7-e9c73f9b53f8 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:39.099881 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c4e09b-c236-446c-9ed7-e9c73f9b53f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:39.122409 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 856/1710] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:38 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:39.147016 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da2040-39b9-4f97-9586-90af51d25b06 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:39.169545 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da2040-39b9-4f97-9586-90af51d25b06 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:39.183572 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc560f-cb83-402b-a3d3-66feb23baa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:39.184366 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc560f-cb83-402b-a3d3-66feb23baa26 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:39.184696 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc560f-cb83-402b-a3d3-66feb23baa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:39.185026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc560f-cb83-402b-a3d3-66feb23baa26 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:39.185854 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc560f-cb83-402b-a3d3-66feb23baa26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:39.188577 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc560f-cb83-402b-a3d3-66feb23baa26 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:39.188697 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-c4c4e09b-c236-446c-9ed7-e9c73f9b53f8 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:39.219829 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-c4c4e09b-c236-446c-9ed7-e9c73f9b53f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:39.266007 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 857/1711] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:39 2021] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:39.269630 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc560f-cb83-402b-a3d3-66feb23baa26 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:39.271385 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 855/1712] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:39.275492 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4e09b-c236-446c-9ed7-e9c73f9b53f8 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:39.306506 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c4e09b-c236-446c-9ed7-e9c73f9b53f8 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:39.488369 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc560f-cb83-402b-a3d3-66feb23baa26 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:39.496462 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f14721-9922-4823-9a3a-f531144a0afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:39.497684 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f14721-9922-4823-9a3a-f531144a0afc admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:39.498172 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f14721-9922-4823-9a3a-f531144a0afc admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:39.498850 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f14721-9922-4823-9a3a-f531144a0afc admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:39.500633 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f14721-9922-4823-9a3a-f531144a0afc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:39.501350 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f14721-9922-4823-9a3a-f531144a0afc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:39.503411 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f14721-9922-4823-9a3a-f531144a0afc admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:39.506331 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62090193-f804-40a5-bac0-63bc4b5c638e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:39.507215 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62090193-f804-40a5-bac0-63bc4b5c638e admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:39.509595 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62090193-f804-40a5-bac0-63bc4b5c638e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:39.511084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62090193-f804-40a5-bac0-63bc4b5c638e admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:39.512079 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62090193-f804-40a5-bac0-63bc4b5c638e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:39.518094 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62090193-f804-40a5-bac0-63bc4b5c638e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:39.551869 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 856/1713] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:39.557585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f14721-9922-4823-9a3a-f531144a0afc admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:39.572099 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 858/1714] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:39 2021] POST /identity/v3/users => generated 297 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:39.576342 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62090193-f804-40a5-bac0-63bc4b5c638e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:39.601943 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f14721-9922-4823-9a3a-f531144a0afc admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:39.622095 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9cce8-f1db-4e71-b893-adc659f0130e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:39.623717 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9cce8-f1db-4e71-b893-adc659f0130e admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:39.624003 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9cce8-f1db-4e71-b893-adc659f0130e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:39.624335 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9cce8-f1db-4e71-b893-adc659f0130e admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:39.628741 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9cce8-f1db-4e71-b893-adc659f0130e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:39.630159 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62090193-f804-40a5-bac0-63bc4b5c638e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:39.633303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9cce8-f1db-4e71-b893-adc659f0130e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:39.671519 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4316c9-796c-4a93-b36e-0315f381ebae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:39.677624 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4316c9-796c-4a93-b36e-0315f381ebae admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:39.679679 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4316c9-796c-4a93-b36e-0315f381ebae admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:39.680323 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4316c9-796c-4a93-b36e-0315f381ebae admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:39.683072 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4316c9-796c-4a93-b36e-0315f381ebae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:39.686785 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4316c9-796c-4a93-b36e-0315f381ebae admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:39.738783 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 859/1715] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:39 2021] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:39.742547 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4316c9-796c-4a93-b36e-0315f381ebae admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:39.759067 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 857/1716] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:39 2021] POST /identity/v3/projects => generated 367 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:39.771243 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4316c9-796c-4a93-b36e-0315f381ebae admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:39.778718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9cce8-f1db-4e71-b893-adc659f0130e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:40.011047 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c659a85-3d76-4554-a020-331a700e9284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:40.014033 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c659a85-3d76-4554-a020-331a700e9284 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:40.015966 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c659a85-3d76-4554-a020-331a700e9284 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:40.016573 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c659a85-3d76-4554-a020-331a700e9284 admin admin] PATH_INFO: `/v3/projects/bcadbff4be004580a52155cdcda83925/users/87216ef06781469ca45bb2b3748aa6f0/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:40.025545 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9cce8-f1db-4e71-b893-adc659f0130e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:40.045586 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c242f3-2684-478d-a7b5-be9160cb9bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:40.046890 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c242f3-2684-478d-a7b5-be9160cb9bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:40.047553 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c242f3-2684-478d-a7b5-be9160cb9bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:40.047553 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c242f3-2684-478d-a7b5-be9160cb9bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:40.048156 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c242f3-2684-478d-a7b5-be9160cb9bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:40.061018 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c242f3-2684-478d-a7b5-be9160cb9bc5 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:40.061234 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c659a85-3d76-4554-a020-331a700e9284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcadbff4be004580a52155cdcda83925, user_id=87216ef06781469ca45bb2b3748aa6f0, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:40.064093 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c659a85-3d76-4554-a020-331a700e9284 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:40.111293 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 860/1717] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:39 2021] PUT /identity/v3/projects/bcadbff4be004580a52155cdcda83925/users/87216ef06781469ca45bb2b3748aa6f0/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:40.112581 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c659a85-3d76-4554-a020-331a700e9284 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:40.114598 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-0c659a85-3d76-4554-a020-331a700e9284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:40.152516 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 858/1718] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:39 2021] POST /identity/v3/users => generated 284 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:40.154368 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee7605-6704-44ae-9b27-eb78ea54e50f None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:40.157585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee7605-6704-44ae-9b27-eb78ea54e50f None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:40.161709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee7605-6704-44ae-9b27-eb78ea54e50f None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:40.172714 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 859/1719] 10.222.0.32 () {54 vars in 921 bytes} [Wed Sep 15 02:29:40 2021] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:29:40.173933 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee7605-6704-44ae-9b27-eb78ea54e50f None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:40.293944 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c659a85-3d76-4554-a020-331a700e9284 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:40.332473 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542b704-372f-4ea8-ad9f-03f7662347f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:40.333495 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542b704-372f-4ea8-ad9f-03f7662347f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:40.333810 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542b704-372f-4ea8-ad9f-03f7662347f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:40.334038 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542b704-372f-4ea8-ad9f-03f7662347f4 admin admin] PATH_INFO: `/v3/projects/fe40b72a5f704b7fb78c29e3df36e90d` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:40.337310 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542b704-372f-4ea8-ad9f-03f7662347f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe40b72a5f704b7fb78c29e3df36e90d)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:40.340403 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee7605-6704-44ae-9b27-eb78ea54e50f None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:40.342700 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542b704-372f-4ea8-ad9f-03f7662347f4 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:40.348930 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6bb87-6129-45b8-a2f0-da9fb8702bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:40.349812 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6bb87-6129-45b8-a2f0-da9fb8702bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:40.350198 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6bb87-6129-45b8-a2f0-da9fb8702bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:40.350654 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6bb87-6129-45b8-a2f0-da9fb8702bf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:40.351804 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6bb87-6129-45b8-a2f0-da9fb8702bf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:40.354058 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6bb87-6129-45b8-a2f0-da9fb8702bf4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:40.374667 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 860/1720] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:40 2021] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:40.379431 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6bb87-6129-45b8-a2f0-da9fb8702bf4 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:40.398050 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6bb87-6129-45b8-a2f0-da9fb8702bf4 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:40.403114 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff610bc-fa9d-499d-b2af-9a671bd18360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:40.404136 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff610bc-fa9d-499d-b2af-9a671bd18360 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:40.404541 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff610bc-fa9d-499d-b2af-9a671bd18360 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:40.404978 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff610bc-fa9d-499d-b2af-9a671bd18360 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:40.406420 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff610bc-fa9d-499d-b2af-9a671bd18360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:40.408157 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff610bc-fa9d-499d-b2af-9a671bd18360 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:40.421428 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 861/1721] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:40 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:40.422780 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e156af-0821-4ea0-9cac-9647a7242b8d None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:40.423180 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e156af-0821-4ea0-9cac-9647a7242b8d None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:40.423566 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e156af-0821-4ea0-9cac-9647a7242b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:40.454379 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-66e156af-0821-4ea0-9cac-9647a7242b8d None None] MFA Rules not processed for user `797b76e6f16d428198e7f7f05c9c0fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:40.455830 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-66e156af-0821-4ea0-9cac-9647a7242b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:40.484128 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9542b704-372f-4ea8-ad9f-03f7662347f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe40b72a5f704b7fb78c29e3df36e90d', 'request_id': 'req-9542b704-372f-4ea8-ad9f-03f7662347f4'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:40.509674 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9542b704-372f-4ea8-ad9f-03f7662347f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe40b72a5f704b7fb78c29e3df36e90d', 'request_id': 'req-9542b704-372f-4ea8-ad9f-03f7662347f4'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:40.525069 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9542b704-372f-4ea8-ad9f-03f7662347f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe40b72a5f704b7fb78c29e3df36e90d', 'request_id': 'req-9542b704-372f-4ea8-ad9f-03f7662347f4'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:40.547275 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 862/1722] 10.222.0.32 () {58 vars in 1019 bytes} [Wed Sep 15 02:29:40 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:40.548421 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e156af-0821-4ea0-9cac-9647a7242b8d None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:40.554074 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9542b704-372f-4ea8-ad9f-03f7662347f4 admin admin] The token cache is being invalidate because project fe40b72a5f704b7fb78c29e3df36e90d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:40.555005 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9542b704-372f-4ea8-ad9f-03f7662347f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:40.556061 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9542b704-372f-4ea8-ad9f-03f7662347f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:40.568601 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 861/1723] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:40 2021] DELETE /identity/v3/projects/fe40b72a5f704b7fb78c29e3df36e90d => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:40.569574 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542b704-372f-4ea8-ad9f-03f7662347f4 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:40.582086 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-9542b704-372f-4ea8-ad9f-03f7662347f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:40.684767 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e156af-0821-4ea0-9cac-9647a7242b8d None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:40.729874 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787c4c0-2923-4c1f-afd3-e1be9503ed51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:40.732716 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787c4c0-2923-4c1f-afd3-e1be9503ed51 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:40.734687 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787c4c0-2923-4c1f-afd3-e1be9503ed51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:40.735449 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787c4c0-2923-4c1f-afd3-e1be9503ed51 admin admin] PATH_INFO: `/v3/projects/bcadbff4be004580a52155cdcda83925/users/87216ef06781469ca45bb2b3748aa6f0/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:40.740098 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787c4c0-2923-4c1f-afd3-e1be9503ed51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcadbff4be004580a52155cdcda83925, user_id=87216ef06781469ca45bb2b3748aa6f0, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:40.745938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542b704-372f-4ea8-ad9f-03f7662347f4 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:40.747780 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787c4c0-2923-4c1f-afd3-e1be9503ed51 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:40.763810 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97834a6-66ac-4b69-b338-bff8c622e4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:40.764765 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97834a6-66ac-4b69-b338-bff8c622e4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:40.765759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97834a6-66ac-4b69-b338-bff8c622e4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:40.766194 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97834a6-66ac-4b69-b338-bff8c622e4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:40.767076 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97834a6-66ac-4b69-b338-bff8c622e4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:40.772433 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97834a6-66ac-4b69-b338-bff8c622e4f3 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:40.784291 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 863/1724] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:40 2021] PUT /identity/v3/projects/bcadbff4be004580a52155cdcda83925/users/87216ef06781469ca45bb2b3748aa6f0/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:40.785972 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938950c3-06b9-4919-9605-02c3334364e6 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:40.789208 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938950c3-06b9-4919-9605-02c3334364e6 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:40.792553 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938950c3-06b9-4919-9605-02c3334364e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:40.826627 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 862/1725] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:40 2021] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:40.830908 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97834a6-66ac-4b69-b338-bff8c622e4f3 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:40.837669 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e97834a6-66ac-4b69-b338-bff8c622e4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:40.858143 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-938950c3-06b9-4919-9605-02c3334364e6 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:40.859614 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-938950c3-06b9-4919-9605-02c3334364e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:40.893801 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97834a6-66ac-4b69-b338-bff8c622e4f3 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:41.033529 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 864/1726] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:41.034750 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938950c3-06b9-4919-9605-02c3334364e6 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:41.054986 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938950c3-06b9-4919-9605-02c3334364e6 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:41.075650 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb9054-d0d9-4f67-9a7d-ec17f5bcfaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:41.077344 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb9054-d0d9-4f67-9a7d-ec17f5bcfaec admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:41.077910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb9054-d0d9-4f67-9a7d-ec17f5bcfaec admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:41.078449 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb9054-d0d9-4f67-9a7d-ec17f5bcfaec admin admin] PATH_INFO: `/v3/projects/3cbe282601b2485dbdb8b44cb72be2d7/users/f05616115da745deaf2b06a49bf9c19c/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:41.123098 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb9054-d0d9-4f67-9a7d-ec17f5bcfaec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cbe282601b2485dbdb8b44cb72be2d7, user_id=f05616115da745deaf2b06a49bf9c19c, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:41.149753 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ff0c2-749d-4318-8cce-50612d941960 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:41.150870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ff0c2-749d-4318-8cce-50612d941960 service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:41.151306 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ff0c2-749d-4318-8cce-50612d941960 service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:41.151739 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ff0c2-749d-4318-8cce-50612d941960 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:41.157839 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-618ff0c2-749d-4318-8cce-50612d941960 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:41.158401 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb9054-d0d9-4f67-9a7d-ec17f5bcfaec admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:41.189956 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ff0c2-749d-4318-8cce-50612d941960 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:41.191561 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ff0c2-749d-4318-8cce-50612d941960 service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:41.215567 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 865/1727] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:41 2021] PUT /identity/v3/projects/3cbe282601b2485dbdb8b44cb72be2d7/users/f05616115da745deaf2b06a49bf9c19c/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:41.217518 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c6400-f597-4ad5-bece-6a58c7e596f2 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:41.218106 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c6400-f597-4ad5-bece-6a58c7e596f2 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:41.218598 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c6400-f597-4ad5-bece-6a58c7e596f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:41.229761 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 863/1728] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:40 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:41.231299 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefe514-dfb6-4de0-8953-f866dc7a6117 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:41.234413 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefe514-dfb6-4de0-8953-f866dc7a6117 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:41.234698 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefe514-dfb6-4de0-8953-f866dc7a6117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:41.271111 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-aeefe514-dfb6-4de0-8953-f866dc7a6117 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:41.272918 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-aeefe514-dfb6-4de0-8953-f866dc7a6117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:41.302292 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-d41c6400-f597-4ad5-bece-6a58c7e596f2 None None] MFA Rules not processed for user `87216ef06781469ca45bb2b3748aa6f0`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:41.305546 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d41c6400-f597-4ad5-bece-6a58c7e596f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:41.382712 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 864/1729] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:41.383778 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefe514-dfb6-4de0-8953-f866dc7a6117 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:41.385322 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-aeefe514-dfb6-4de0-8953-f866dc7a6117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:41.414424 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefe514-dfb6-4de0-8953-f866dc7a6117 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:41.425146 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdbf93-44eb-4f8d-9aa4-6c00c98b17e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:41.426813 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdbf93-44eb-4f8d-9aa4-6c00c98b17e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:41.429253 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdbf93-44eb-4f8d-9aa4-6c00c98b17e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:41.429535 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdbf93-44eb-4f8d-9aa4-6c00c98b17e1 admin admin] PATH_INFO: `/v3/users/41db5d18376c436b86e5bb2212bf9219` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:41.435627 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdbf93-44eb-4f8d-9aa4-6c00c98b17e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41db5d18376c436b86e5bb2212bf9219)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:41.443708 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdbf93-44eb-4f8d-9aa4-6c00c98b17e1 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:41.497416 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 866/1730] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:41 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:41.499168 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8f695-ea16-4124-b9d2-e9615b4e1e68 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:41.499688 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8f695-ea16-4124-b9d2-e9615b4e1e68 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:41.500252 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8f695-ea16-4124-b9d2-e9615b4e1e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:41.535074 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-25d8f695-ea16-4124-b9d2-e9615b4e1e68 None None] MFA Rules not processed for user `f05616115da745deaf2b06a49bf9c19c`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:41.537433 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-25d8f695-ea16-4124-b9d2-e9615b4e1e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:41.626090 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-43cdbf93-44eb-4f8d-9aa4-6c00c98b17e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41db5d18376c436b86e5bb2212bf9219'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:41.627202 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 867/1731] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:41 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:41.628155 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8f695-ea16-4124-b9d2-e9615b4e1e68 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:41.631425 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-43cdbf93-44eb-4f8d-9aa4-6c00c98b17e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41db5d18376c436b86e5bb2212bf9219'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:41.642302 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8f695-ea16-4124-b9d2-e9615b4e1e68 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:41.647605 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-43cdbf93-44eb-4f8d-9aa4-6c00c98b17e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41db5d18376c436b86e5bb2212bf9219'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:41.650261 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6caf4-6f12-45c8-9645-bae0b4fc8de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:41.651017 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6caf4-6f12-45c8-9645-bae0b4fc8de4 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:41.651458 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6caf4-6f12-45c8-9645-bae0b4fc8de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:41.651846 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6caf4-6f12-45c8-9645-bae0b4fc8de4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:41.651956 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-43cdbf93-44eb-4f8d-9aa4-6c00c98b17e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41db5d18376c436b86e5bb2212bf9219'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:41.653082 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6caf4-6f12-45c8-9645-bae0b4fc8de4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:41.653557 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6caf4-6f12-45c8-9645-bae0b4fc8de4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:41.656344 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6caf4-6f12-45c8-9645-bae0b4fc8de4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:41.671698 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 868/1732] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:41.672979 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6caf4-6f12-45c8-9645-bae0b4fc8de4 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:41.679254 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-80b6caf4-6f12-45c8-9645-bae0b4fc8de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:41.683730 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-43cdbf93-44eb-4f8d-9aa4-6c00c98b17e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41db5d18376c436b86e5bb2212bf9219'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:41.702852 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 865/1733] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:41 2021] DELETE /identity/v3/users/41db5d18376c436b86e5bb2212bf9219 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:41.703851 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdbf93-44eb-4f8d-9aa4-6c00c98b17e1 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:41.705660 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-43cdbf93-44eb-4f8d-9aa4-6c00c98b17e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:41.799737 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdbf93-44eb-4f8d-9aa4-6c00c98b17e1 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:41.801199 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2a845-0f7f-4a5e-b7f7-d03413fdba42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:41.802375 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2a845-0f7f-4a5e-b7f7-d03413fdba42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:41.802893 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2a845-0f7f-4a5e-b7f7-d03413fdba42 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:41.803274 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2a845-0f7f-4a5e-b7f7-d03413fdba42 admin admin] PATH_INFO: `/v3/projects/3841a841e151488abc6fd684c93713d9` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:41.804710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2a845-0f7f-4a5e-b7f7-d03413fdba42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3841a841e151488abc6fd684c93713d9)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:41.811773 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2a845-0f7f-4a5e-b7f7-d03413fdba42 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:41.820703 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6caf4-6f12-45c8-9645-bae0b4fc8de4 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:41.944325 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-0ba2a845-0f7f-4a5e-b7f7-d03413fdba42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3841a841e151488abc6fd684c93713d9', 'request_id': 'req-0ba2a845-0f7f-4a5e-b7f7-d03413fdba42'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:41.974626 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2dff7-def7-4227-ae94-4ad4870414e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:41.976357 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2dff7-def7-4227-ae94-4ad4870414e0 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:41.977313 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2dff7-def7-4227-ae94-4ad4870414e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:41.977938 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2dff7-def7-4227-ae94-4ad4870414e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:41.980215 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-0ba2a845-0f7f-4a5e-b7f7-d03413fdba42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3841a841e151488abc6fd684c93713d9', 'request_id': 'req-0ba2a845-0f7f-4a5e-b7f7-d03413fdba42'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:41.984157 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-34d2dff7-def7-4227-ae94-4ad4870414e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:41.991919 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-0ba2a845-0f7f-4a5e-b7f7-d03413fdba42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3841a841e151488abc6fd684c93713d9', 'request_id': 'req-0ba2a845-0f7f-4a5e-b7f7-d03413fdba42'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:42.040830 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-0ba2a845-0f7f-4a5e-b7f7-d03413fdba42 admin admin] The token cache is being invalidate because project 3841a841e151488abc6fd684c93713d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:42.041152 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-0ba2a845-0f7f-4a5e-b7f7-d03413fdba42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:42.043117 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-0ba2a845-0f7f-4a5e-b7f7-d03413fdba42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:42.047518 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 866/1734] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:41 2021] DELETE /identity/v3/projects/3841a841e151488abc6fd684c93713d9 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:42.049487 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2a845-0f7f-4a5e-b7f7-d03413fdba42 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:42.050894 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-0ba2a845-0f7f-4a5e-b7f7-d03413fdba42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:42.093785 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2dff7-def7-4227-ae94-4ad4870414e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:42.106275 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2dff7-def7-4227-ae94-4ad4870414e0 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:42.132151 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 869/1735] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:41 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:42.134857 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2dff7-def7-4227-ae94-4ad4870414e0 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:42.138433 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-34d2dff7-def7-4227-ae94-4ad4870414e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:42.166964 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2dff7-def7-4227-ae94-4ad4870414e0 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:42.216449 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2a845-0f7f-4a5e-b7f7-d03413fdba42 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:42.227447 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a7b15-9537-4db8-a0f1-e063b89c6276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:42.228299 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a7b15-9537-4db8-a0f1-e063b89c6276 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:42.228755 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a7b15-9537-4db8-a0f1-e063b89c6276 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:42.229498 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a7b15-9537-4db8-a0f1-e063b89c6276 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:42.232263 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a7b15-9537-4db8-a0f1-e063b89c6276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:42.234565 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a7b15-9537-4db8-a0f1-e063b89c6276 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:42.313913 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 867/1736] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:42 2021] POST /identity/v3/projects => generated 369 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:42.322280 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f777d-d7cd-4a81-b1e0-8eb14f2ece55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:42.323254 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f777d-d7cd-4a81-b1e0-8eb14f2ece55 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:42.323867 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f777d-d7cd-4a81-b1e0-8eb14f2ece55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:42.324934 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f777d-d7cd-4a81-b1e0-8eb14f2ece55 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:42.325889 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f777d-d7cd-4a81-b1e0-8eb14f2ece55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:42.327081 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e22b2-cabc-4a1c-9ecc-7b463e4caf6d None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:42.328070 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e22b2-cabc-4a1c-9ecc-7b463e4caf6d None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:42.328367 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e22b2-cabc-4a1c-9ecc-7b463e4caf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:42.333142 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f777d-d7cd-4a81-b1e0-8eb14f2ece55 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:42.383205 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-a87e22b2-cabc-4a1c-9ecc-7b463e4caf6d None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:42.385838 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a87e22b2-cabc-4a1c-9ecc-7b463e4caf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:42.390741 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 870/1737] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:42 2021] POST /identity/v3/projects => generated 387 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:42.390741 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f777d-d7cd-4a81-b1e0-8eb14f2ece55 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:42.392726 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-a48f777d-d7cd-4a81-b1e0-8eb14f2ece55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:42.475459 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 868/1738] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:42.476720 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e22b2-cabc-4a1c-9ecc-7b463e4caf6d None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:42.508033 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e22b2-cabc-4a1c-9ecc-7b463e4caf6d None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:42.517262 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c590c8-ec08-4634-8e13-a1a1e5aebb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:42.518512 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c590c8-ec08-4634-8e13-a1a1e5aebb94 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:42.518938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c590c8-ec08-4634-8e13-a1a1e5aebb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:42.519580 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c590c8-ec08-4634-8e13-a1a1e5aebb94 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:42.520650 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c590c8-ec08-4634-8e13-a1a1e5aebb94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:42.528591 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c590c8-ec08-4634-8e13-a1a1e5aebb94 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:42.556818 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f777d-d7cd-4a81-b1e0-8eb14f2ece55 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:42.567108 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 869/1739] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:42 2021] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:42.569122 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c590c8-ec08-4634-8e13-a1a1e5aebb94 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:42.569994 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa7833-8447-4e4a-ac09-50ab9b4f734e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:42.571080 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa7833-8447-4e4a-ac09-50ab9b4f734e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:42.571531 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa7833-8447-4e4a-ac09-50ab9b4f734e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:42.571794 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa7833-8447-4e4a-ac09-50ab9b4f734e admin admin] PATH_INFO: `/v3/users/4feb9bc1575244fb8dea4868a8eadbc5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:42.572863 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-23c590c8-ec08-4634-8e13-a1a1e5aebb94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:42.573731 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa7833-8447-4e4a-ac09-50ab9b4f734e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4feb9bc1575244fb8dea4868a8eadbc5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:42.575824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa7833-8447-4e4a-ac09-50ab9b4f734e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:42.603025 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c590c8-ec08-4634-8e13-a1a1e5aebb94 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:42.612315 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f082e2-3ca6-40ce-8545-d3ce9b5edc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:42.615273 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f082e2-3ca6-40ce-8545-d3ce9b5edc6e admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:42.615582 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f082e2-3ca6-40ce-8545-d3ce9b5edc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:42.616043 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f082e2-3ca6-40ce-8545-d3ce9b5edc6e admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:42.632274 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f082e2-3ca6-40ce-8545-d3ce9b5edc6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:42.635406 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f082e2-3ca6-40ce-8545-d3ce9b5edc6e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:42.678792 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-daaa7833-8447-4e4a-ac09-50ab9b4f734e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4feb9bc1575244fb8dea4868a8eadbc5'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:42.703265 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 870/1740] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:42 2021] POST /identity/v3/users => generated 294 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:42.703485 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-daaa7833-8447-4e4a-ac09-50ab9b4f734e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4feb9bc1575244fb8dea4868a8eadbc5'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:42.703582 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f082e2-3ca6-40ce-8545-d3ce9b5edc6e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:42.703660 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-daaa7833-8447-4e4a-ac09-50ab9b4f734e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4feb9bc1575244fb8dea4868a8eadbc5'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:42.707791 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-76f082e2-3ca6-40ce-8545-d3ce9b5edc6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:42.711027 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-daaa7833-8447-4e4a-ac09-50ab9b4f734e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4feb9bc1575244fb8dea4868a8eadbc5'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:42.724014 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-daaa7833-8447-4e4a-ac09-50ab9b4f734e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4feb9bc1575244fb8dea4868a8eadbc5'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:42.733147 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 871/1741] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:42 2021] DELETE /identity/v3/users/4feb9bc1575244fb8dea4868a8eadbc5 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:42.735127 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa7833-8447-4e4a-ac09-50ab9b4f734e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:42.742806 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-daaa7833-8447-4e4a-ac09-50ab9b4f734e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:42.799044 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f082e2-3ca6-40ce-8545-d3ce9b5edc6e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:42.874027 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa7833-8447-4e4a-ac09-50ab9b4f734e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:42.896133 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ee940-8ae1-4653-a614-f90c0e8be17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:42.897903 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ee940-8ae1-4653-a614-f90c0e8be17a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:42.899445 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ee940-8ae1-4653-a614-f90c0e8be17a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:42.899882 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ee940-8ae1-4653-a614-f90c0e8be17a admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:42.901147 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ee940-8ae1-4653-a614-f90c0e8be17a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:42.902868 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ee940-8ae1-4653-a614-f90c0e8be17a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:42.910191 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38331065-ab6f-43eb-bae7-c278c7a3bdb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:42.910996 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38331065-ab6f-43eb-bae7-c278c7a3bdb1 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:42.911390 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38331065-ab6f-43eb-bae7-c278c7a3bdb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:42.911694 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38331065-ab6f-43eb-bae7-c278c7a3bdb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:42.928052 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 872/1742] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:42 2021] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:42.928052 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ee940-8ae1-4653-a614-f90c0e8be17a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:42.930360 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-38331065-ab6f-43eb-bae7-c278c7a3bdb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:42.938406 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-be0ee940-8ae1-4653-a614-f90c0e8be17a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:42.969343 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ee940-8ae1-4653-a614-f90c0e8be17a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:42.969813 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38331065-ab6f-43eb-bae7-c278c7a3bdb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:42.971700 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38331065-ab6f-43eb-bae7-c278c7a3bdb1 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:42.980422 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa814682-78ff-40a8-ac2a-3eb33e5ebd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:42.981222 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa814682-78ff-40a8-ac2a-3eb33e5ebd1b admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:42.981573 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa814682-78ff-40a8-ac2a-3eb33e5ebd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:42.981853 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa814682-78ff-40a8-ac2a-3eb33e5ebd1b admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:42.982751 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa814682-78ff-40a8-ac2a-3eb33e5ebd1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:42.985642 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa814682-78ff-40a8-ac2a-3eb33e5ebd1b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:42.999897 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 871/1743] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:43.004993 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38331065-ab6f-43eb-bae7-c278c7a3bdb1 service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:43.005711 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 873/1744] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:42 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:43.006608 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa814682-78ff-40a8-ac2a-3eb33e5ebd1b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:43.006904 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-38331065-ab6f-43eb-bae7-c278c7a3bdb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:43.017886 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa814682-78ff-40a8-ac2a-3eb33e5ebd1b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:43.023094 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023aef7-b58a-4e8e-a2fa-d6677a77437a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:43.024004 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023aef7-b58a-4e8e-a2fa-d6677a77437a admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:43.024291 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023aef7-b58a-4e8e-a2fa-d6677a77437a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:43.024566 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023aef7-b58a-4e8e-a2fa-d6677a77437a admin admin] PATH_INFO: `/v3/projects/c3c55df461434f85ae16c45e8bb52941/users/e28d18d40aea48ebbdb10ddc1882e3a5/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:43.045630 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023aef7-b58a-4e8e-a2fa-d6677a77437a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c55df461434f85ae16c45e8bb52941, user_id=e28d18d40aea48ebbdb10ddc1882e3a5, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:43.049009 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023aef7-b58a-4e8e-a2fa-d6677a77437a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:43.073637 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 874/1745] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:43 2021] PUT /identity/v3/projects/c3c55df461434f85ae16c45e8bb52941/users/e28d18d40aea48ebbdb10ddc1882e3a5/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:43.076244 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023aef7-b58a-4e8e-a2fa-d6677a77437a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:43.157473 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38331065-ab6f-43eb-bae7-c278c7a3bdb1 service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:43.222640 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023aef7-b58a-4e8e-a2fa-d6677a77437a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:43.231695 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa1228-7625-44f1-b244-1df784c623fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:43.232555 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa1228-7625-44f1-b244-1df784c623fa admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:43.234032 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa1228-7625-44f1-b244-1df784c623fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:43.234842 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa1228-7625-44f1-b244-1df784c623fa admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:43.235866 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa1228-7625-44f1-b244-1df784c623fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:43.237665 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa1228-7625-44f1-b244-1df784c623fa admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:43.269706 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 875/1746] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:43 2021] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:43.276311 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa1228-7625-44f1-b244-1df784c623fa admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:43.302395 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa1228-7625-44f1-b244-1df784c623fa admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:43.308852 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39379df8-1dc7-4dbf-a10e-2f62102956b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:43.309753 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39379df8-1dc7-4dbf-a10e-2f62102956b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:43.310146 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39379df8-1dc7-4dbf-a10e-2f62102956b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:43.310531 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39379df8-1dc7-4dbf-a10e-2f62102956b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:43.311386 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39379df8-1dc7-4dbf-a10e-2f62102956b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:43.313203 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39379df8-1dc7-4dbf-a10e-2f62102956b5 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:43.319020 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab486e9d-cc0f-45ca-80d7-619e667d3557 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87216ef06781469ca45bb2b3748aa6f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcadbff4be004580a52155cdcda83925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:43.320792 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab486e9d-cc0f-45ca-80d7-619e667d3557 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:43.321139 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab486e9d-cc0f-45ca-80d7-619e667d3557 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:43.321554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab486e9d-cc0f-45ca-80d7-619e667d3557 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:43.322421 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab486e9d-cc0f-45ca-80d7-619e667d3557 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:43.322879 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab486e9d-cc0f-45ca-80d7-619e667d3557 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:43.324637 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab486e9d-cc0f-45ca-80d7-619e667d3557 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:43.338763 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 876/1747] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:43 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:43.340099 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39379df8-1dc7-4dbf-a10e-2f62102956b5 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:43.347856 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 872/1748] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:43.348718 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab486e9d-cc0f-45ca-80d7-619e667d3557 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:43.361549 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39379df8-1dc7-4dbf-a10e-2f62102956b5 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:43.363833 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab486e9d-cc0f-45ca-80d7-619e667d3557 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:43.376084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58ceec-b7fa-483f-82d4-680fbda7fd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:43.377276 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58ceec-b7fa-483f-82d4-680fbda7fd0f admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:43.377470 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58ceec-b7fa-483f-82d4-680fbda7fd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:43.377798 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58ceec-b7fa-483f-82d4-680fbda7fd0f admin admin] PATH_INFO: `/v3/projects/c3c55df461434f85ae16c45e8bb52941/users/e28d18d40aea48ebbdb10ddc1882e3a5/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:43.387179 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a12de1-43de-4f9f-9bc5-f880af77c1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:43.388037 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58ceec-b7fa-483f-82d4-680fbda7fd0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c55df461434f85ae16c45e8bb52941, user_id=e28d18d40aea48ebbdb10ddc1882e3a5, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:43.388227 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a12de1-43de-4f9f-9bc5-f880af77c1fe admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:43.388434 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a12de1-43de-4f9f-9bc5-f880af77c1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:43.388737 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a12de1-43de-4f9f-9bc5-f880af77c1fe admin admin] PATH_INFO: `/v3/projects/ba22d94a5739402caf091c7634f1f47f/users/1b3e3467f5274e2aa050efbec4251067/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:43.391348 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58ceec-b7fa-483f-82d4-680fbda7fd0f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:43.408402 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 873/1749] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:43 2021] PUT /identity/v3/projects/c3c55df461434f85ae16c45e8bb52941/users/e28d18d40aea48ebbdb10ddc1882e3a5/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:43.416959 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58ceec-b7fa-483f-82d4-680fbda7fd0f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:43.452330 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a12de1-43de-4f9f-9bc5-f880af77c1fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba22d94a5739402caf091c7634f1f47f, user_id=1b3e3467f5274e2aa050efbec4251067, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:43.454656 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a12de1-43de-4f9f-9bc5-f880af77c1fe admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:43.476421 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 877/1750] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:43 2021] PUT /identity/v3/projects/ba22d94a5739402caf091c7634f1f47f/users/1b3e3467f5274e2aa050efbec4251067/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:43.477172 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a12de1-43de-4f9f-9bc5-f880af77c1fe admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:43.483006 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b8a12de1-43de-4f9f-9bc5-f880af77c1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:43.507741 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58ceec-b7fa-483f-82d4-680fbda7fd0f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:43.612926 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a12de1-43de-4f9f-9bc5-f880af77c1fe admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:43.617900 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bffd4-fa3b-4570-9c91-a3e6f368227f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:43.619034 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bffd4-fa3b-4570-9c91-a3e6f368227f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:43.619284 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bffd4-fa3b-4570-9c91-a3e6f368227f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:43.619679 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bffd4-fa3b-4570-9c91-a3e6f368227f admin admin] PATH_INFO: `/v3/projects/664d0e0890f148d991e632458bed1915` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:43.622848 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bffd4-fa3b-4570-9c91-a3e6f368227f admin admin] RBAC: Authorizing `identity:delete_project(project_id=664d0e0890f148d991e632458bed1915)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:43.628236 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ba145-83cd-456a-a29b-8c0f72a68d72 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87216ef06781469ca45bb2b3748aa6f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcadbff4be004580a52155cdcda83925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:43.629185 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ba145-83cd-456a-a29b-8c0f72a68d72 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:43.629627 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ba145-83cd-456a-a29b-8c0f72a68d72 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:43.630052 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ba145-83cd-456a-a29b-8c0f72a68d72 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:43.630907 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ba145-83cd-456a-a29b-8c0f72a68d72 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:43.632295 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bffd4-fa3b-4570-9c91-a3e6f368227f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:43.634326 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ba145-83cd-456a-a29b-8c0f72a68d72 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:43.678978 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 874/1751] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:43 2021] POST /identity/v3/projects => generated 354 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:43.680800 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb98834-7a3c-43fc-b047-7ee4ba38b18c None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:43.681296 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb98834-7a3c-43fc-b047-7ee4ba38b18c None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:43.681834 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb98834-7a3c-43fc-b047-7ee4ba38b18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:43.701412 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-591bffd4-fa3b-4570-9c91-a3e6f368227f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '664d0e0890f148d991e632458bed1915', 'request_id': 'req-591bffd4-fa3b-4570-9c91-a3e6f368227f'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:43.709709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-591bffd4-fa3b-4570-9c91-a3e6f368227f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '664d0e0890f148d991e632458bed1915', 'request_id': 'req-591bffd4-fa3b-4570-9c91-a3e6f368227f'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:43.719435 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-591bffd4-fa3b-4570-9c91-a3e6f368227f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '664d0e0890f148d991e632458bed1915', 'request_id': 'req-591bffd4-fa3b-4570-9c91-a3e6f368227f'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:43.732318 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-591bffd4-fa3b-4570-9c91-a3e6f368227f admin admin] The token cache is being invalidate because project 664d0e0890f148d991e632458bed1915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:43.734161 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-591bffd4-fa3b-4570-9c91-a3e6f368227f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:43.734987 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-591bffd4-fa3b-4570-9c91-a3e6f368227f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:43.737094 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 878/1752] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:43 2021] DELETE /identity/v3/projects/664d0e0890f148d991e632458bed1915 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:43.739007 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c8860-e438-4f74-8ab0-58a6adf39cbb None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:43.739271 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c8860-e438-4f74-8ab0-58a6adf39cbb None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:43.739654 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c8860-e438-4f74-8ab0-58a6adf39cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:43.749927 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-8fb98834-7a3c-43fc-b047-7ee4ba38b18c None None] MFA Rules not processed for user `e28d18d40aea48ebbdb10ddc1882e3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:43.753471 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8fb98834-7a3c-43fc-b047-7ee4ba38b18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:43.776755 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-f93c8860-e438-4f74-8ab0-58a6adf39cbb None None] MFA Rules not processed for user `1b3e3467f5274e2aa050efbec4251067`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:43.780939 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f93c8860-e438-4f74-8ab0-58a6adf39cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:43.836422 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 875/1753] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:43 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:43.837396 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb98834-7a3c-43fc-b047-7ee4ba38b18c None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:43.838624 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8fb98834-7a3c-43fc-b047-7ee4ba38b18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:43.855511 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 879/1754] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:43 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:43.856442 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c8860-e438-4f74-8ab0-58a6adf39cbb None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:43.857928 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f93c8860-e438-4f74-8ab0-58a6adf39cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:43.911696 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb98834-7a3c-43fc-b047-7ee4ba38b18c None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:43.916635 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceadba8-b549-4334-9ca8-ae581b106b28 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87216ef06781469ca45bb2b3748aa6f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcadbff4be004580a52155cdcda83925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:43.917349 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceadba8-b549-4334-9ca8-ae581b106b28 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:43.917730 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceadba8-b549-4334-9ca8-ae581b106b28 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:43.918038 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceadba8-b549-4334-9ca8-ae581b106b28 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:43.918884 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceadba8-b549-4334-9ca8-ae581b106b28 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:43.919196 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceadba8-b549-4334-9ca8-ae581b106b28 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:43.921870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceadba8-b549-4334-9ca8-ae581b106b28 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:43.935388 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 876/1755] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:43.935844 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c8860-e438-4f74-8ab0-58a6adf39cbb None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:43.936743 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e27c8-89c6-423e-a073-8bb1f002a6ba None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:43.937065 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e27c8-89c6-423e-a073-8bb1f002a6ba None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:43.937347 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e27c8-89c6-423e-a073-8bb1f002a6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:43.943145 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769ad97-0143-48f5-bd43-4b47b176cb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:43.944020 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769ad97-0143-48f5-bd43-4b47b176cb69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:43.944300 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769ad97-0143-48f5-bd43-4b47b176cb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:43.944576 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769ad97-0143-48f5-bd43-4b47b176cb69 admin admin] PATH_INFO: `/v3/projects/5db79f3cdc4d45a5aa50e2f6ecdbc717` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:43.946239 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769ad97-0143-48f5-bd43-4b47b176cb69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db79f3cdc4d45a5aa50e2f6ecdbc717)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:43.947741 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769ad97-0143-48f5-bd43-4b47b176cb69 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:43.960423 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-399e27c8-89c6-423e-a073-8bb1f002a6ba None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:43.972748 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-399e27c8-89c6-423e-a073-8bb1f002a6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:43.989208 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 877/1756] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:43.995496 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e27c8-89c6-423e-a073-8bb1f002a6ba None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:43.997196 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-399e27c8-89c6-423e-a073-8bb1f002a6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:44.005223 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0769ad97-0143-48f5-bd43-4b47b176cb69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db79f3cdc4d45a5aa50e2f6ecdbc717', 'request_id': 'req-0769ad97-0143-48f5-bd43-4b47b176cb69'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:44.012156 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0769ad97-0143-48f5-bd43-4b47b176cb69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db79f3cdc4d45a5aa50e2f6ecdbc717', 'request_id': 'req-0769ad97-0143-48f5-bd43-4b47b176cb69'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:44.020172 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0769ad97-0143-48f5-bd43-4b47b176cb69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db79f3cdc4d45a5aa50e2f6ecdbc717', 'request_id': 'req-0769ad97-0143-48f5-bd43-4b47b176cb69'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:44.036310 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0769ad97-0143-48f5-bd43-4b47b176cb69 admin admin] The token cache is being invalidate because project 5db79f3cdc4d45a5aa50e2f6ecdbc717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:44.037370 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0769ad97-0143-48f5-bd43-4b47b176cb69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:44.038130 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0769ad97-0143-48f5-bd43-4b47b176cb69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:44.040323 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 880/1757] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:43 2021] DELETE /identity/v3/projects/5db79f3cdc4d45a5aa50e2f6ecdbc717 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:44.041066 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769ad97-0143-48f5-bd43-4b47b176cb69 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:44.044372 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-0769ad97-0143-48f5-bd43-4b47b176cb69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:44.069925 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e27c8-89c6-423e-a073-8bb1f002a6ba None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:44.137146 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769ad97-0143-48f5-bd43-4b47b176cb69 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:44.143482 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088431f-30d6-4a32-832d-b958492284e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:44.144365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088431f-30d6-4a32-832d-b958492284e8 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:44.144811 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088431f-30d6-4a32-832d-b958492284e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:44.145175 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088431f-30d6-4a32-832d-b958492284e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:44.145884 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088431f-30d6-4a32-832d-b958492284e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:44.147845 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088431f-30d6-4a32-832d-b958492284e8 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:44.151106 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdc5a7-8cc0-4e0b-a174-ef4f68ba8c8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:44.152017 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdc5a7-8cc0-4e0b-a174-ef4f68ba8c8e service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:44.152369 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdc5a7-8cc0-4e0b-a174-ef4f68ba8c8e service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:44.152672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdc5a7-8cc0-4e0b-a174-ef4f68ba8c8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:44.154485 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-3dbdc5a7-8cc0-4e0b-a174-ef4f68ba8c8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:44.178997 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 881/1758] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:44 2021] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:44.179915 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088431f-30d6-4a32-832d-b958492284e8 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:44.182041 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4088431f-30d6-4a32-832d-b958492284e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:44.255259 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbdc5a7-8cc0-4e0b-a174-ef4f68ba8c8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:44.256700 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbdc5a7-8cc0-4e0b-a174-ef4f68ba8c8e service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:44.267268 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088431f-30d6-4a32-832d-b958492284e8 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:44.272306 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93292772-f768-431e-979f-33a5305e5597 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87216ef06781469ca45bb2b3748aa6f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcadbff4be004580a52155cdcda83925', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:44.272731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 878/1759] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:43 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:44.274668 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b45c39-3e88-4fe9-addd-7db16f9217db None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:44.275047 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b45c39-3e88-4fe9-addd-7db16f9217db None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:44.275519 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b45c39-3e88-4fe9-addd-7db16f9217db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:44.284684 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93292772-f768-431e-979f-33a5305e5597 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:44.286452 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93292772-f768-431e-979f-33a5305e5597 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:44.286898 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93292772-f768-431e-979f-33a5305e5597 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] PATH_INFO: `/v3/projects/8e4406903d9f422e83dbebbaf1e5df0b` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:44.289651 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93292772-f768-431e-979f-33a5305e5597 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8e4406903d9f422e83dbebbaf1e5df0b)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:44.291788 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93292772-f768-431e-979f-33a5305e5597 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:44.303271 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-69b45c39-3e88-4fe9-addd-7db16f9217db None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:44.304731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-69b45c39-3e88-4fe9-addd-7db16f9217db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:44.386324 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-93292772-f768-431e-979f-33a5305e5597 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e4406903d9f422e83dbebbaf1e5df0b', 'request_id': 'req-93292772-f768-431e-979f-33a5305e5597'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:44.391827 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-93292772-f768-431e-979f-33a5305e5597 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e4406903d9f422e83dbebbaf1e5df0b', 'request_id': 'req-93292772-f768-431e-979f-33a5305e5597'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:44.401718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-93292772-f768-431e-979f-33a5305e5597 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e4406903d9f422e83dbebbaf1e5df0b', 'request_id': 'req-93292772-f768-431e-979f-33a5305e5597'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:44.408317 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 879/1760] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:44.408317 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b45c39-3e88-4fe9-addd-7db16f9217db None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:44.410341 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-69b45c39-3e88-4fe9-addd-7db16f9217db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:44.425117 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b45c39-3e88-4fe9-addd-7db16f9217db None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:44.426354 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-93292772-f768-431e-979f-33a5305e5597 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] The token cache is being invalidate because project 8e4406903d9f422e83dbebbaf1e5df0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:44.426884 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-93292772-f768-431e-979f-33a5305e5597 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:44.428196 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-93292772-f768-431e-979f-33a5305e5597 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:44.429974 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 882/1761] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:44 2021] DELETE /identity/v3/projects/8e4406903d9f422e83dbebbaf1e5df0b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:44.430952 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93292772-f768-431e-979f-33a5305e5597 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:44.432516 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-93292772-f768-431e-979f-33a5305e5597 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:44.512810 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04257716-7ea6-4787-aa6c-6ba7e4f48a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:44.514329 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04257716-7ea6-4787-aa6c-6ba7e4f48a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:44.517222 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04257716-7ea6-4787-aa6c-6ba7e4f48a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:44.517535 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04257716-7ea6-4787-aa6c-6ba7e4f48a46 admin admin] PATH_INFO: `/v3/users/8baf7b93626e441881e8015e90fb30c8` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:44.519276 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04257716-7ea6-4787-aa6c-6ba7e4f48a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8baf7b93626e441881e8015e90fb30c8)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:44.523270 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04257716-7ea6-4787-aa6c-6ba7e4f48a46 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:44.588851 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93292772-f768-431e-979f-33a5305e5597 tempest-VolumeQuotaClassesTest-1418283001 tempest-VolumeQuotaClassesTest-1418283001-project-admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:44.598294 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8306edd-4e74-40de-a367-587695baf108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:44.599329 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8306edd-4e74-40de-a367-587695baf108 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:44.600257 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-04257716-7ea6-4787-aa6c-6ba7e4f48a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8baf7b93626e441881e8015e90fb30c8'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:44.601266 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-04257716-7ea6-4787-aa6c-6ba7e4f48a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8baf7b93626e441881e8015e90fb30c8'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:44.602068 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8306edd-4e74-40de-a367-587695baf108 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:44.603585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8306edd-4e74-40de-a367-587695baf108 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:44.604816 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8306edd-4e74-40de-a367-587695baf108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:44.609541 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8306edd-4e74-40de-a367-587695baf108 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:44.610269 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-04257716-7ea6-4787-aa6c-6ba7e4f48a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8baf7b93626e441881e8015e90fb30c8'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:44.610984 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-04257716-7ea6-4787-aa6c-6ba7e4f48a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8baf7b93626e441881e8015e90fb30c8'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:44.641744 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 883/1762] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:44 2021] POST /identity/v3/users => generated 300 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:44.643586 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-04257716-7ea6-4787-aa6c-6ba7e4f48a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8baf7b93626e441881e8015e90fb30c8'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:44.644459 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8306edd-4e74-40de-a367-587695baf108 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:44.646516 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-a8306edd-4e74-40de-a367-587695baf108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:44.660361 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8306edd-4e74-40de-a367-587695baf108 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:44.676905 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 880/1763] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:44 2021] DELETE /identity/v3/users/8baf7b93626e441881e8015e90fb30c8 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:44.676905 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04257716-7ea6-4787-aa6c-6ba7e4f48a46 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:44.686108 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-04257716-7ea6-4787-aa6c-6ba7e4f48a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:44.726849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2435cf0-2c1e-49d2-b44c-ff2ebef8b487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:44.727956 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2435cf0-2c1e-49d2-b44c-ff2ebef8b487 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:44.728347 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2435cf0-2c1e-49d2-b44c-ff2ebef8b487 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:44.728732 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2435cf0-2c1e-49d2-b44c-ff2ebef8b487 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:44.729666 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2435cf0-2c1e-49d2-b44c-ff2ebef8b487 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:44.730084 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2435cf0-2c1e-49d2-b44c-ff2ebef8b487 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:44.731935 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2435cf0-2c1e-49d2-b44c-ff2ebef8b487 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:44.755072 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 884/1764] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:44.757027 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2435cf0-2c1e-49d2-b44c-ff2ebef8b487 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:44.780456 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2435cf0-2c1e-49d2-b44c-ff2ebef8b487 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:44.786993 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba7027-5278-439f-8b0c-95c406573543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:44.788310 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba7027-5278-439f-8b0c-95c406573543 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:44.788844 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba7027-5278-439f-8b0c-95c406573543 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:44.789424 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba7027-5278-439f-8b0c-95c406573543 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:44.790674 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba7027-5278-439f-8b0c-95c406573543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:44.794365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba7027-5278-439f-8b0c-95c406573543 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:44.850089 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 885/1765] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:44 2021] POST /identity/v3/projects => generated 399 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:44.853047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba7027-5278-439f-8b0c-95c406573543 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:44.853965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-1dba7027-5278-439f-8b0c-95c406573543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:44.869677 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04257716-7ea6-4787-aa6c-6ba7e4f48a46 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:44.967215 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba7027-5278-439f-8b0c-95c406573543 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:44.967818 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43bb0c-ed0e-42d5-bdd3-cd4c14dc0fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:44.968101 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43bb0c-ed0e-42d5-bdd3-cd4c14dc0fbc admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:44.968388 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43bb0c-ed0e-42d5-bdd3-cd4c14dc0fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:44.968666 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43bb0c-ed0e-42d5-bdd3-cd4c14dc0fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:44.969439 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43bb0c-ed0e-42d5-bdd3-cd4c14dc0fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:44.971396 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43bb0c-ed0e-42d5-bdd3-cd4c14dc0fbc admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:44.974270 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd789767-9bc5-4f0b-b3a9-02954bd00959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:44.975385 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd789767-9bc5-4f0b-b3a9-02954bd00959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:44.975679 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd789767-9bc5-4f0b-b3a9-02954bd00959 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:44.975964 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd789767-9bc5-4f0b-b3a9-02954bd00959 admin admin] PATH_INFO: `/v3/users/d0503fb57f61443cbe2a86b980d0b4f9` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:44.978623 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd789767-9bc5-4f0b-b3a9-02954bd00959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0503fb57f61443cbe2a86b980d0b4f9)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:44.981376 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd789767-9bc5-4f0b-b3a9-02954bd00959 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:44.983316 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 881/1766] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:44 2021] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:44.986178 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43bb0c-ed0e-42d5-bdd3-cd4c14dc0fbc admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:45.000474 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43bb0c-ed0e-42d5-bdd3-cd4c14dc0fbc admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:45.005960 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd555366-bd79-4234-a04d-27f1d1f960a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:45.006573 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd555366-bd79-4234-a04d-27f1d1f960a8 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:45.007040 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd555366-bd79-4234-a04d-27f1d1f960a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:45.007427 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd555366-bd79-4234-a04d-27f1d1f960a8 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:45.008349 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd555366-bd79-4234-a04d-27f1d1f960a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:45.011224 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd555366-bd79-4234-a04d-27f1d1f960a8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:45.035877 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 882/1767] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:44 2021] POST /identity/v3/users => generated 300 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:45.036987 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd555366-bd79-4234-a04d-27f1d1f960a8 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:45.042738 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-cd789767-9bc5-4f0b-b3a9-02954bd00959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0503fb57f61443cbe2a86b980d0b4f9'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:45.052448 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd555366-bd79-4234-a04d-27f1d1f960a8 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:45.057493 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f4e5e-9495-481f-a307-8277187258f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:45.058399 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f4e5e-9495-481f-a307-8277187258f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:45.058686 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f4e5e-9495-481f-a307-8277187258f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:45.058969 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f4e5e-9495-481f-a307-8277187258f1 admin admin] PATH_INFO: `/v3/projects/1dbd6bab95c14ef693f7aa4e23d9a0c3/users/360ed97deac44d3f8237875b3c1415ea/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:45.067377 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-cd789767-9bc5-4f0b-b3a9-02954bd00959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0503fb57f61443cbe2a86b980d0b4f9'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:45.068138 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-cd789767-9bc5-4f0b-b3a9-02954bd00959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0503fb57f61443cbe2a86b980d0b4f9'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:45.080489 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f4e5e-9495-481f-a307-8277187258f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dbd6bab95c14ef693f7aa4e23d9a0c3, user_id=360ed97deac44d3f8237875b3c1415ea, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:45.083271 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-cd789767-9bc5-4f0b-b3a9-02954bd00959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0503fb57f61443cbe2a86b980d0b4f9'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:45.083418 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f4e5e-9495-481f-a307-8277187258f1 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:45.095152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-cd789767-9bc5-4f0b-b3a9-02954bd00959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0503fb57f61443cbe2a86b980d0b4f9'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:45.102005 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 883/1768] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:45 2021] PUT /identity/v3/projects/1dbd6bab95c14ef693f7aa4e23d9a0c3/users/360ed97deac44d3f8237875b3c1415ea/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:45.103426 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f4e5e-9495-481f-a307-8277187258f1 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:45.111023 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-093f4e5e-9495-481f-a307-8277187258f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:45.112959 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 886/1769] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:44 2021] DELETE /identity/v3/users/d0503fb57f61443cbe2a86b980d0b4f9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:45.114835 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd789767-9bc5-4f0b-b3a9-02954bd00959 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:45.117504 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-cd789767-9bc5-4f0b-b3a9-02954bd00959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:45.196134 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f4e5e-9495-481f-a307-8277187258f1 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:45.241812 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd789767-9bc5-4f0b-b3a9-02954bd00959 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:45.248322 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f271924-7aff-4e4a-9209-0e34ab1dc375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:45.249219 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f271924-7aff-4e4a-9209-0e34ab1dc375 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:45.249617 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f271924-7aff-4e4a-9209-0e34ab1dc375 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:45.250003 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f271924-7aff-4e4a-9209-0e34ab1dc375 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:45.251004 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f271924-7aff-4e4a-9209-0e34ab1dc375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:45.253429 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f271924-7aff-4e4a-9209-0e34ab1dc375 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:45.266762 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 887/1770] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:45 2021] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:45.267345 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4157c5-1eb9-4aa3-b012-489624e33b75 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:45.267736 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4157c5-1eb9-4aa3-b012-489624e33b75 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:45.268118 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4157c5-1eb9-4aa3-b012-489624e33b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:45.273758 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b90f0-14fe-463a-93d6-72080267f6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:45.274657 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b90f0-14fe-463a-93d6-72080267f6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:45.275094 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b90f0-14fe-463a-93d6-72080267f6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:45.275418 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b90f0-14fe-463a-93d6-72080267f6c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:45.276141 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b90f0-14fe-463a-93d6-72080267f6c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:45.277993 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b90f0-14fe-463a-93d6-72080267f6c7 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:45.294709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-ae4157c5-1eb9-4aa3-b012-489624e33b75 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:45.294900 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 884/1771] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:45 2021] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:45.295634 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b90f0-14fe-463a-93d6-72080267f6c7 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:45.297781 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ae4157c5-1eb9-4aa3-b012-489624e33b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:45.308058 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b90f0-14fe-463a-93d6-72080267f6c7 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:45.313482 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68432db-543e-4f20-9fac-edb8bd708d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:45.316292 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68432db-543e-4f20-9fac-edb8bd708d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:45.316292 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68432db-543e-4f20-9fac-edb8bd708d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:45.316292 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68432db-543e-4f20-9fac-edb8bd708d24 admin admin] PATH_INFO: `/v3/projects/1dbd6bab95c14ef693f7aa4e23d9a0c3/users/360ed97deac44d3f8237875b3c1415ea/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:45.317020 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68432db-543e-4f20-9fac-edb8bd708d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dbd6bab95c14ef693f7aa4e23d9a0c3, user_id=360ed97deac44d3f8237875b3c1415ea, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:45.318347 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 888/1772] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:45.319671 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68432db-543e-4f20-9fac-edb8bd708d24 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:45.322024 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4157c5-1eb9-4aa3-b012-489624e33b75 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:45.339570 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 885/1773] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:45 2021] PUT /identity/v3/projects/1dbd6bab95c14ef693f7aa4e23d9a0c3/users/360ed97deac44d3f8237875b3c1415ea/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:45.340223 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68432db-543e-4f20-9fac-edb8bd708d24 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:45.346929 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c68432db-543e-4f20-9fac-edb8bd708d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:45.352719 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4157c5-1eb9-4aa3-b012-489624e33b75 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:45.429223 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097066b-23a6-4ec5-afb6-c7b60a2da171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:45.430330 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097066b-23a6-4ec5-afb6-c7b60a2da171 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:45.430928 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097066b-23a6-4ec5-afb6-c7b60a2da171 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:45.431644 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097066b-23a6-4ec5-afb6-c7b60a2da171 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:45.433022 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097066b-23a6-4ec5-afb6-c7b60a2da171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:45.435599 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097066b-23a6-4ec5-afb6-c7b60a2da171 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:45.455376 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 889/1774] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:45 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:45.456254 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097066b-23a6-4ec5-afb6-c7b60a2da171 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:45.460707 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b097066b-23a6-4ec5-afb6-c7b60a2da171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:45.460812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68432db-543e-4f20-9fac-edb8bd708d24 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:45.464104 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58301a1-d418-43c2-a9fc-b8a002e46ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:45.464998 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58301a1-d418-43c2-a9fc-b8a002e46ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:45.465461 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58301a1-d418-43c2-a9fc-b8a002e46ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:45.465746 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58301a1-d418-43c2-a9fc-b8a002e46ffc admin admin] PATH_INFO: `/v3/projects/08c65bfd5afb4f67b0fbaca2a747788a` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:45.466951 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58301a1-d418-43c2-a9fc-b8a002e46ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=08c65bfd5afb4f67b0fbaca2a747788a)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:45.469681 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58301a1-d418-43c2-a9fc-b8a002e46ffc admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:45.521959 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-e58301a1-d418-43c2-a9fc-b8a002e46ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c65bfd5afb4f67b0fbaca2a747788a', 'request_id': 'req-e58301a1-d418-43c2-a9fc-b8a002e46ffc'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:45.530143 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-e58301a1-d418-43c2-a9fc-b8a002e46ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c65bfd5afb4f67b0fbaca2a747788a', 'request_id': 'req-e58301a1-d418-43c2-a9fc-b8a002e46ffc'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:45.535803 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097066b-23a6-4ec5-afb6-c7b60a2da171 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:45.536845 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-e58301a1-d418-43c2-a9fc-b8a002e46ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c65bfd5afb4f67b0fbaca2a747788a', 'request_id': 'req-e58301a1-d418-43c2-a9fc-b8a002e46ffc'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:45.549128 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-e58301a1-d418-43c2-a9fc-b8a002e46ffc admin admin] The token cache is being invalidate because project 08c65bfd5afb4f67b0fbaca2a747788a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:45.549424 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-e58301a1-d418-43c2-a9fc-b8a002e46ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:45.550115 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-e58301a1-d418-43c2-a9fc-b8a002e46ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:45.556954 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 886/1775] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:45 2021] DELETE /identity/v3/projects/08c65bfd5afb4f67b0fbaca2a747788a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:45.556954 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b1359-9516-4e9b-9544-737e91232106 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:45.556954 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b1359-9516-4e9b-9544-737e91232106 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:45.556954 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b1359-9516-4e9b-9544-737e91232106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:45.583450 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-916b1359-9516-4e9b-9544-737e91232106 None None] MFA Rules not processed for user `360ed97deac44d3f8237875b3c1415ea`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:45.584809 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-916b1359-9516-4e9b-9544-737e91232106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:45.594667 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db0183-def2-4b88-94eb-0f1c7ae2c283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:45.595441 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db0183-def2-4b88-94eb-0f1c7ae2c283 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:45.595983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db0183-def2-4b88-94eb-0f1c7ae2c283 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:45.596263 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db0183-def2-4b88-94eb-0f1c7ae2c283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:45.598116 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-83db0183-def2-4b88-94eb-0f1c7ae2c283 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:45.656578 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 887/1776] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:45 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:45.657413 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b1359-9516-4e9b-9544-737e91232106 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:45.659001 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-916b1359-9516-4e9b-9544-737e91232106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:45.684398 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db0183-def2-4b88-94eb-0f1c7ae2c283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:45.685592 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db0183-def2-4b88-94eb-0f1c7ae2c283 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:45.696405 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 890/1777] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:45.698359 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cb04a-df56-4899-a419-3877d0ec275a None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:45.698863 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cb04a-df56-4899-a419-3877d0ec275a None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:45.699215 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cb04a-df56-4899-a419-3877d0ec275a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:45.721590 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-619cb04a-df56-4899-a419-3877d0ec275a None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:45.722824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-619cb04a-df56-4899-a419-3877d0ec275a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:45.727487 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b1359-9516-4e9b-9544-737e91232106 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:45.737829 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 891/1778] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:45.737924 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05094e7b-0b96-4eee-bd9a-dde9ce34bb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:45.738021 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cb04a-df56-4899-a419-3877d0ec275a None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:45.738097 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05094e7b-0b96-4eee-bd9a-dde9ce34bb99 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:45.738097 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05094e7b-0b96-4eee-bd9a-dde9ce34bb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:45.738097 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05094e7b-0b96-4eee-bd9a-dde9ce34bb99 admin admin] PATH_INFO: `/v3/projects/b862fe945de24a30bd57be689fc55212/users/dd79cf34364e4759ac71d50527be63a3/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:45.738294 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-619cb04a-df56-4899-a419-3877d0ec275a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:45.762047 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05094e7b-0b96-4eee-bd9a-dde9ce34bb99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b862fe945de24a30bd57be689fc55212, user_id=dd79cf34364e4759ac71d50527be63a3, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:45.769255 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05094e7b-0b96-4eee-bd9a-dde9ce34bb99 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:45.786257 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 888/1779] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:45 2021] PUT /identity/v3/projects/b862fe945de24a30bd57be689fc55212/users/dd79cf34364e4759ac71d50527be63a3/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:45.787758 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5e809-65b5-4944-9b85-51e182fd7e11 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:45.788054 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5e809-65b5-4944-9b85-51e182fd7e11 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:45.788379 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5e809-65b5-4944-9b85-51e182fd7e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:45.808042 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-73e5e809-65b5-4944-9b85-51e182fd7e11 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:45.809306 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-73e5e809-65b5-4944-9b85-51e182fd7e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:45.829534 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cb04a-df56-4899-a419-3877d0ec275a None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:45.898456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 889/1780] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:45.898456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4dd3c5-e688-4385-8347-22867402c0bf None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:45.898456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4dd3c5-e688-4385-8347-22867402c0bf None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:45.898663 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4dd3c5-e688-4385-8347-22867402c0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:45.914094 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a223efb-f76e-4380-aab0-c35e93de1956 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:45.915110 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a223efb-f76e-4380-aab0-c35e93de1956 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:45.916026 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a223efb-f76e-4380-aab0-c35e93de1956 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:45.916517 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a223efb-f76e-4380-aab0-c35e93de1956 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:45.933213 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-9c4dd3c5-e688-4385-8347-22867402c0bf None None] MFA Rules not processed for user `dd79cf34364e4759ac71d50527be63a3`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:45.934434 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-9c4dd3c5-e688-4385-8347-22867402c0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:45.987138 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a223efb-f76e-4380-aab0-c35e93de1956 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:45.989169 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a223efb-f76e-4380-aab0-c35e93de1956 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:46.004490 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 892/1781] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:45 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:46.006189 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a223efb-f76e-4380-aab0-c35e93de1956 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:46.022532 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a223efb-f76e-4380-aab0-c35e93de1956 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:46.029241 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872b58c-0d82-4dae-990b-4ab896e530ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:46.030706 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872b58c-0d82-4dae-990b-4ab896e530ea admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:46.031470 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872b58c-0d82-4dae-990b-4ab896e530ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:46.031836 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872b58c-0d82-4dae-990b-4ab896e530ea admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:46.032786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872b58c-0d82-4dae-990b-4ab896e530ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:46.033364 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872b58c-0d82-4dae-990b-4ab896e530ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:46.039837 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872b58c-0d82-4dae-990b-4ab896e530ea admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:46.049077 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 890/1782] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:45 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:46.050288 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4dd3c5-e688-4385-8347-22867402c0bf None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:46.052369 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-9c4dd3c5-e688-4385-8347-22867402c0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:46.058676 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 893/1783] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:46.059634 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872b58c-0d82-4dae-990b-4ab896e530ea admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:46.074504 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872b58c-0d82-4dae-990b-4ab896e530ea admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:46.083018 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d2fb0-42a1-4a3c-afe8-8cb9ebd358c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:46.083815 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4dd3c5-e688-4385-8347-22867402c0bf None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:46.084168 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d2fb0-42a1-4a3c-afe8-8cb9ebd358c0 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:46.084516 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d2fb0-42a1-4a3c-afe8-8cb9ebd358c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:46.084858 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d2fb0-42a1-4a3c-afe8-8cb9ebd358c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:46.085664 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d2fb0-42a1-4a3c-afe8-8cb9ebd358c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:46.087695 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d2fb0-42a1-4a3c-afe8-8cb9ebd358c0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:46.090219 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6e0eb-7471-4327-ad47-407a7be6f263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:46.091315 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6e0eb-7471-4327-ad47-407a7be6f263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:46.091985 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6e0eb-7471-4327-ad47-407a7be6f263 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:46.092780 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6e0eb-7471-4327-ad47-407a7be6f263 admin admin] PATH_INFO: `/v3/users/1b3e3467f5274e2aa050efbec4251067` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:46.094283 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6e0eb-7471-4327-ad47-407a7be6f263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b3e3467f5274e2aa050efbec4251067)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:46.096838 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6e0eb-7471-4327-ad47-407a7be6f263 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:46.132720 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 894/1784] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:46 2021] POST /identity/v3/projects => generated 397 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:46.134102 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d2fb0-42a1-4a3c-afe8-8cb9ebd358c0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:46.136763 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-e64d2fb0-42a1-4a3c-afe8-8cb9ebd358c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:46.162224 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-66b6e0eb-7471-4327-ad47-407a7be6f263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b3e3467f5274e2aa050efbec4251067'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:46.162964 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-66b6e0eb-7471-4327-ad47-407a7be6f263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b3e3467f5274e2aa050efbec4251067'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:46.170906 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-66b6e0eb-7471-4327-ad47-407a7be6f263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b3e3467f5274e2aa050efbec4251067'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:46.172292 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-66b6e0eb-7471-4327-ad47-407a7be6f263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b3e3467f5274e2aa050efbec4251067'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:46.184456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-66b6e0eb-7471-4327-ad47-407a7be6f263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b3e3467f5274e2aa050efbec4251067'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:46.196786 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 891/1785] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:46 2021] DELETE /identity/v3/users/1b3e3467f5274e2aa050efbec4251067 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:46.197889 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6e0eb-7471-4327-ad47-407a7be6f263 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:46.199299 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-66b6e0eb-7471-4327-ad47-407a7be6f263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:46.208399 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d2fb0-42a1-4a3c-afe8-8cb9ebd358c0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:46.265920 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb142c-827c-4016-b322-69b21e2c7efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:46.266692 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb142c-827c-4016-b322-69b21e2c7efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:46.266962 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb142c-827c-4016-b322-69b21e2c7efc admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:46.267229 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb142c-827c-4016-b322-69b21e2c7efc admin admin] PATH_INFO: `/v3/projects/f05cc0d421f74b79b332e64275d9ebc0` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:46.268415 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb142c-827c-4016-b322-69b21e2c7efc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f05cc0d421f74b79b332e64275d9ebc0)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:46.270345 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb142c-827c-4016-b322-69b21e2c7efc admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:46.272647 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6e0eb-7471-4327-ad47-407a7be6f263 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:46.277569 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b3fdf-376e-4991-b95b-aa209d1daf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:46.278262 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b3fdf-376e-4991-b95b-aa209d1daf3d admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:46.278570 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b3fdf-376e-4991-b95b-aa209d1daf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:46.278873 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b3fdf-376e-4991-b95b-aa209d1daf3d admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:46.279646 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b3fdf-376e-4991-b95b-aa209d1daf3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:46.281643 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b3fdf-376e-4991-b95b-aa209d1daf3d admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:46.309089 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 892/1786] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:46 2021] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:46.310480 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b3fdf-376e-4991-b95b-aa209d1daf3d admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:46.318319 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-cf1b3fdf-376e-4991-b95b-aa209d1daf3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:46.320533 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5abb142c-827c-4016-b322-69b21e2c7efc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f05cc0d421f74b79b332e64275d9ebc0', 'request_id': 'req-5abb142c-827c-4016-b322-69b21e2c7efc'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:46.326865 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5abb142c-827c-4016-b322-69b21e2c7efc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f05cc0d421f74b79b332e64275d9ebc0', 'request_id': 'req-5abb142c-827c-4016-b322-69b21e2c7efc'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:46.334374 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5abb142c-827c-4016-b322-69b21e2c7efc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f05cc0d421f74b79b332e64275d9ebc0', 'request_id': 'req-5abb142c-827c-4016-b322-69b21e2c7efc'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:46.347614 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5abb142c-827c-4016-b322-69b21e2c7efc admin admin] The token cache is being invalidate because project f05cc0d421f74b79b332e64275d9ebc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:46.348034 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5abb142c-827c-4016-b322-69b21e2c7efc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:46.349016 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5abb142c-827c-4016-b322-69b21e2c7efc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:46.351148 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 895/1787] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:46 2021] DELETE /identity/v3/projects/f05cc0d421f74b79b332e64275d9ebc0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:46.356614 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb142c-827c-4016-b322-69b21e2c7efc admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:46.356614 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-5abb142c-827c-4016-b322-69b21e2c7efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:46.384285 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b3fdf-376e-4991-b95b-aa209d1daf3d admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:46.389444 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d897c3-e189-49f6-b743-0f2bca454798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:46.390350 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d897c3-e189-49f6-b743-0f2bca454798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:46.390666 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d897c3-e189-49f6-b743-0f2bca454798 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:46.390943 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d897c3-e189-49f6-b743-0f2bca454798 admin admin] PATH_INFO: `/v3/users/f05616115da745deaf2b06a49bf9c19c` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:46.392187 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d897c3-e189-49f6-b743-0f2bca454798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f05616115da745deaf2b06a49bf9c19c)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:46.394145 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d897c3-e189-49f6-b743-0f2bca454798 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:46.417923 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb142c-827c-4016-b322-69b21e2c7efc admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:46.423826 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382572b3-4913-47cb-b79d-19332352ea46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:46.424534 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382572b3-4913-47cb-b79d-19332352ea46 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:46.424858 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382572b3-4913-47cb-b79d-19332352ea46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:46.425254 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382572b3-4913-47cb-b79d-19332352ea46 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:46.425894 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382572b3-4913-47cb-b79d-19332352ea46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:46.427891 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382572b3-4913-47cb-b79d-19332352ea46 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:46.439736 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-d7d897c3-e189-49f6-b743-0f2bca454798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f05616115da745deaf2b06a49bf9c19c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:46.440432 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-d7d897c3-e189-49f6-b743-0f2bca454798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f05616115da745deaf2b06a49bf9c19c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:46.447104 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-d7d897c3-e189-49f6-b743-0f2bca454798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f05616115da745deaf2b06a49bf9c19c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:46.447747 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 896/1788] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:46 2021] POST /identity/v3/users => generated 305 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:46.448272 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-d7d897c3-e189-49f6-b743-0f2bca454798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f05616115da745deaf2b06a49bf9c19c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:46.449192 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1bf0b-9904-4e03-9f89-a83454e8869b None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:46.449476 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1bf0b-9904-4e03-9f89-a83454e8869b None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:46.449752 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1bf0b-9904-4e03-9f89-a83454e8869b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:46.460693 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-d7d897c3-e189-49f6-b743-0f2bca454798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f05616115da745deaf2b06a49bf9c19c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:46.471103 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-f8f1bf0b-9904-4e03-9f89-a83454e8869b None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:46.473206 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f8f1bf0b-9904-4e03-9f89-a83454e8869b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:46.474229 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 893/1789] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:46 2021] DELETE /identity/v3/users/f05616115da745deaf2b06a49bf9c19c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:46.474824 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d897c3-e189-49f6-b743-0f2bca454798 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:46.476171 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-d7d897c3-e189-49f6-b743-0f2bca454798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:46.538217 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 897/1790] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:46.538889 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1bf0b-9904-4e03-9f89-a83454e8869b None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:46.540186 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f8f1bf0b-9904-4e03-9f89-a83454e8869b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:46.545352 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d897c3-e189-49f6-b743-0f2bca454798 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:46.552704 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1bf0b-9904-4e03-9f89-a83454e8869b None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:46.553372 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b723992-028f-428c-8449-2ab768c88872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:46.554182 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b723992-028f-428c-8449-2ab768c88872 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:46.554476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b723992-028f-428c-8449-2ab768c88872 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:46.554759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b723992-028f-428c-8449-2ab768c88872 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:46.555512 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b723992-028f-428c-8449-2ab768c88872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:46.557486 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b723992-028f-428c-8449-2ab768c88872 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:46.557831 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e34b2-6d35-464d-8e91-7df6d6188710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:46.558694 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e34b2-6d35-464d-8e91-7df6d6188710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:46.558971 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e34b2-6d35-464d-8e91-7df6d6188710 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:46.559240 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e34b2-6d35-464d-8e91-7df6d6188710 admin admin] PATH_INFO: `/v3/users/87216ef06781469ca45bb2b3748aa6f0` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:46.560415 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e34b2-6d35-464d-8e91-7df6d6188710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87216ef06781469ca45bb2b3748aa6f0)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:46.562987 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e34b2-6d35-464d-8e91-7df6d6188710 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:46.578150 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 894/1791] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:46 2021] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:46.579281 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b723992-028f-428c-8449-2ab768c88872 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:46.582677 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7b723992-028f-428c-8449-2ab768c88872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:46.595387 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b723992-028f-428c-8449-2ab768c88872 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:46.600464 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c963c-c462-4a70-960d-c504a4f9939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:46.601166 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c963c-c462-4a70-960d-c504a4f9939c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:46.601451 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c963c-c462-4a70-960d-c504a4f9939c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:46.601740 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c963c-c462-4a70-960d-c504a4f9939c admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:46.602786 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c963c-c462-4a70-960d-c504a4f9939c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:46.604443 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c963c-c462-4a70-960d-c504a4f9939c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:46.609608 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2d6e34b2-6d35-464d-8e91-7df6d6188710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87216ef06781469ca45bb2b3748aa6f0'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:46.615019 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 895/1792] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:46 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:46.616231 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eb187-8d0c-4863-a10a-5b51525b94d9 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:46.616522 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eb187-8d0c-4863-a10a-5b51525b94d9 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:46.616802 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36eb187-8d0c-4863-a10a-5b51525b94d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:46.621407 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2d6e34b2-6d35-464d-8e91-7df6d6188710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87216ef06781469ca45bb2b3748aa6f0'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:46.622096 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2d6e34b2-6d35-464d-8e91-7df6d6188710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87216ef06781469ca45bb2b3748aa6f0'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:46.629960 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2d6e34b2-6d35-464d-8e91-7df6d6188710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87216ef06781469ca45bb2b3748aa6f0'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:46.634908 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-b36eb187-8d0c-4863-a10a-5b51525b94d9 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:46.636100 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b36eb187-8d0c-4863-a10a-5b51525b94d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:46.637046 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2d6e34b2-6d35-464d-8e91-7df6d6188710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87216ef06781469ca45bb2b3748aa6f0'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:46.643198 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 898/1793] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:46 2021] DELETE /identity/v3/users/87216ef06781469ca45bb2b3748aa6f0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:46.646867 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 896/1794] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:46.647069 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e34b2-6d35-464d-8e91-7df6d6188710 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:46.647241 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36eb187-8d0c-4863-a10a-5b51525b94d9 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:46.648276 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b36eb187-8d0c-4863-a10a-5b51525b94d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:46.653241 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-2d6e34b2-6d35-464d-8e91-7df6d6188710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:46.660936 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36eb187-8d0c-4863-a10a-5b51525b94d9 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:46.714452 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e34b2-6d35-464d-8e91-7df6d6188710 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:46.719167 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af003ae-7dd6-483f-a068-6c0bb28f8453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:46.719919 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af003ae-7dd6-483f-a068-6c0bb28f8453 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:46.720205 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af003ae-7dd6-483f-a068-6c0bb28f8453 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:46.720322 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863480a-0a91-46c1-af0f-100c23bc1f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:46.720793 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af003ae-7dd6-483f-a068-6c0bb28f8453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:46.721200 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863480a-0a91-46c1-af0f-100c23bc1f95 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:46.721531 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863480a-0a91-46c1-af0f-100c23bc1f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:46.721862 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863480a-0a91-46c1-af0f-100c23bc1f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:46.722654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863480a-0a91-46c1-af0f-100c23bc1f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:46.723212 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4af003ae-7dd6-483f-a068-6c0bb28f8453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:46.724427 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863480a-0a91-46c1-af0f-100c23bc1f95 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:46.736314 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 897/1795] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:46 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:46.737000 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863480a-0a91-46c1-af0f-100c23bc1f95 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:46.737556 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af003ae-7dd6-483f-a068-6c0bb28f8453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:46.738745 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e863480a-0a91-46c1-af0f-100c23bc1f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:46.739288 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af003ae-7dd6-483f-a068-6c0bb28f8453 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:46.750477 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 899/1796] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:46.751174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af003ae-7dd6-483f-a068-6c0bb28f8453 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:46.751275 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863480a-0a91-46c1-af0f-100c23bc1f95 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:46.752520 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4af003ae-7dd6-483f-a068-6c0bb28f8453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:46.755993 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d098f-6591-4f8a-a25b-892f67ef5953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:46.756869 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d098f-6591-4f8a-a25b-892f67ef5953 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:46.757527 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d098f-6591-4f8a-a25b-892f67ef5953 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:46.757527 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d098f-6591-4f8a-a25b-892f67ef5953 admin admin] PATH_INFO: `/v3/projects/b8aa1569ecc749a7b147b0ac23a2d764/users/182816725b6444feb4394de04b9f310f/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:46.763190 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af003ae-7dd6-483f-a068-6c0bb28f8453 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:46.767099 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57caf646-4c82-42fa-9f5b-aeb98125fe1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:46.767788 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caf646-4c82-42fa-9f5b-aeb98125fe1c service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:46.768192 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caf646-4c82-42fa-9f5b-aeb98125fe1c service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:46.768521 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caf646-4c82-42fa-9f5b-aeb98125fe1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:46.773537 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d098f-6591-4f8a-a25b-892f67ef5953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8aa1569ecc749a7b147b0ac23a2d764, user_id=182816725b6444feb4394de04b9f310f, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:46.776522 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d098f-6591-4f8a-a25b-892f67ef5953 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:46.780834 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57caf646-4c82-42fa-9f5b-aeb98125fe1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:46.782680 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57caf646-4c82-42fa-9f5b-aeb98125fe1c service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:46.794556 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 898/1797] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:46 2021] PUT /identity/v3/projects/b8aa1569ecc749a7b147b0ac23a2d764/users/182816725b6444feb4394de04b9f310f/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:46.794556 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d098f-6591-4f8a-a25b-892f67ef5953 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:46.794772 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 900/1798] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:46.795473 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57caf646-4c82-42fa-9f5b-aeb98125fe1c service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:46.805971 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57caf646-4c82-42fa-9f5b-aeb98125fe1c service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:46.874696 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998196c7-4a66-4e5b-acf3-c315b890e9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:46.875397 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998196c7-4a66-4e5b-acf3-c315b890e9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:46.875861 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998196c7-4a66-4e5b-acf3-c315b890e9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:46.876149 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998196c7-4a66-4e5b-acf3-c315b890e9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:46.877130 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998196c7-4a66-4e5b-acf3-c315b890e9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:46.878926 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998196c7-4a66-4e5b-acf3-c315b890e9f1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:46.884094 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d098f-6591-4f8a-a25b-892f67ef5953 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:46.889995 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437afef-caab-4bd7-b93c-468078314b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:46.890844 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437afef-caab-4bd7-b93c-468078314b0e admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:46.891123 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437afef-caab-4bd7-b93c-468078314b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:46.891579 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437afef-caab-4bd7-b93c-468078314b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:46.892546 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437afef-caab-4bd7-b93c-468078314b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:46.893420 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 901/1799] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:46 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:29:46.898095 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437afef-caab-4bd7-b93c-468078314b0e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:46.898244 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998196c7-4a66-4e5b-acf3-c315b890e9f1 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:46.911106 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998196c7-4a66-4e5b-acf3-c315b890e9f1 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:46.911984 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 899/1800] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:46 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:46.915675 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437afef-caab-4bd7-b93c-468078314b0e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:46.917667 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62525eb-895b-4522-96c2-205360ff2835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:46.918776 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62525eb-895b-4522-96c2-205360ff2835 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:46.919821 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62525eb-895b-4522-96c2-205360ff2835 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:46.920103 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62525eb-895b-4522-96c2-205360ff2835 admin admin] PATH_INFO: `/v3/projects/b8aa1569ecc749a7b147b0ac23a2d764/users/182816725b6444feb4394de04b9f310f/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:46.924539 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62525eb-895b-4522-96c2-205360ff2835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8aa1569ecc749a7b147b0ac23a2d764, user_id=182816725b6444feb4394de04b9f310f, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:46.926183 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437afef-caab-4bd7-b93c-468078314b0e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:46.928019 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62525eb-895b-4522-96c2-205360ff2835 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:46.932085 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c00a41-9d83-4aa9-81a5-d81c45302f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:46.933047 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c00a41-9d83-4aa9-81a5-d81c45302f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:46.933345 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c00a41-9d83-4aa9-81a5-d81c45302f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:46.933620 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c00a41-9d83-4aa9-81a5-d81c45302f21 admin admin] PATH_INFO: `/v3/projects/e1bae7c3e09d47e2aa0f52517a523bed/users/870ac4d0be824d5a8fb5929391d3688b/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:46.941990 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 902/1801] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:46 2021] PUT /identity/v3/projects/b8aa1569ecc749a7b147b0ac23a2d764/users/182816725b6444feb4394de04b9f310f/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:46.951907 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5d732-6d2f-45c4-a696-ac13675f1a37 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:46.952718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5d732-6d2f-45c4-a696-ac13675f1a37 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:46.953047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5d732-6d2f-45c4-a696-ac13675f1a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:46.956030 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c00a41-9d83-4aa9-81a5-d81c45302f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1bae7c3e09d47e2aa0f52517a523bed, user_id=870ac4d0be824d5a8fb5929391d3688b, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:46.958932 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c00a41-9d83-4aa9-81a5-d81c45302f21 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:46.989769 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 900/1802] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:46 2021] PUT /identity/v3/projects/e1bae7c3e09d47e2aa0f52517a523bed/users/870ac4d0be824d5a8fb5929391d3688b/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:29:46.998875 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-b2e5d732-6d2f-45c4-a696-ac13675f1a37 None None] MFA Rules not processed for user `182816725b6444feb4394de04b9f310f`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:47.000216 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b2e5d732-6d2f-45c4-a696-ac13675f1a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:47.026239 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f0f09-aa87-46ae-bab0-9d204861839d None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:47.026530 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f0f09-aa87-46ae-bab0-9d204861839d None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:47.026813 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f0f09-aa87-46ae-bab0-9d204861839d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:47.054495 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-b86f0f09-aa87-46ae-bab0-9d204861839d None None] MFA Rules not processed for user `870ac4d0be824d5a8fb5929391d3688b`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:47.055835 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b86f0f09-aa87-46ae-bab0-9d204861839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:47.094933 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 903/1803] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:46 2021] POST /identity/v3/auth/tokens => generated 3484 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:29:47.105934 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5d732-6d2f-45c4-a696-ac13675f1a37 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:47.108693 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b2e5d732-6d2f-45c4-a696-ac13675f1a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:47.156009 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 901/1804] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:47 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:29:47.157222 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f0f09-aa87-46ae-bab0-9d204861839d None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:47.158758 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b86f0f09-aa87-46ae-bab0-9d204861839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:47.192321 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5d732-6d2f-45c4-a696-ac13675f1a37 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:47.199694 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6872c1-ffa6-4fb5-a044-137bc947ed33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:47.209085 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6872c1-ffa6-4fb5-a044-137bc947ed33 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:47.209434 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6872c1-ffa6-4fb5-a044-137bc947ed33 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:47.209736 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6872c1-ffa6-4fb5-a044-137bc947ed33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:47.225343 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6872c1-ffa6-4fb5-a044-137bc947ed33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:47.227453 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6872c1-ffa6-4fb5-a044-137bc947ed33 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:47.241280 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 904/1805] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:47 2021] GET /identity/v3/auth/tokens => generated 3484 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:29:47.242667 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6872c1-ffa6-4fb5-a044-137bc947ed33 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:47.278075 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f0f09-aa87-46ae-bab0-9d204861839d None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:47.284172 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132d81d-1b8e-4438-a1c5-a91c69182cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:47.285643 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132d81d-1b8e-4438-a1c5-a91c69182cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:47.285933 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132d81d-1b8e-4438-a1c5-a91c69182cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:47.286210 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132d81d-1b8e-4438-a1c5-a91c69182cbb admin admin] PATH_INFO: `/v3/projects/bcadbff4be004580a52155cdcda83925` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:47.287748 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132d81d-1b8e-4438-a1c5-a91c69182cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcadbff4be004580a52155cdcda83925)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:47.290646 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132d81d-1b8e-4438-a1c5-a91c69182cbb admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:47.374456 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6872c1-ffa6-4fb5-a044-137bc947ed33 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:47.382977 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c498759-3e77-4662-ba52-7c9e12d9c31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:47.384294 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c498759-3e77-4662-ba52-7c9e12d9c31e admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:47.384681 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c498759-3e77-4662-ba52-7c9e12d9c31e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:47.385085 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c498759-3e77-4662-ba52-7c9e12d9c31e admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:47.386188 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c498759-3e77-4662-ba52-7c9e12d9c31e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:47.389079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c498759-3e77-4662-ba52-7c9e12d9c31e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:47.400047 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1132d81d-1b8e-4438-a1c5-a91c69182cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcadbff4be004580a52155cdcda83925', 'request_id': 'req-1132d81d-1b8e-4438-a1c5-a91c69182cbb'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:47.412191 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1132d81d-1b8e-4438-a1c5-a91c69182cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcadbff4be004580a52155cdcda83925', 'request_id': 'req-1132d81d-1b8e-4438-a1c5-a91c69182cbb'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:47.419330 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1132d81d-1b8e-4438-a1c5-a91c69182cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcadbff4be004580a52155cdcda83925', 'request_id': 'req-1132d81d-1b8e-4438-a1c5-a91c69182cbb'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:47.437215 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1132d81d-1b8e-4438-a1c5-a91c69182cbb admin admin] The token cache is being invalidate because project bcadbff4be004580a52155cdcda83925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:47.438727 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1132d81d-1b8e-4438-a1c5-a91c69182cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:47.442217 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1132d81d-1b8e-4438-a1c5-a91c69182cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:47.449354 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 905/1806] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:47 2021] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:47.453910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c498759-3e77-4662-ba52-7c9e12d9c31e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:47.457028 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-2c498759-3e77-4662-ba52-7c9e12d9c31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:47.459416 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 902/1807] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:47 2021] DELETE /identity/v3/projects/bcadbff4be004580a52155cdcda83925 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:47.460650 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132d81d-1b8e-4438-a1c5-a91c69182cbb admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:47.462378 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-1132d81d-1b8e-4438-a1c5-a91c69182cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:47.552644 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132d81d-1b8e-4438-a1c5-a91c69182cbb admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:47.587622 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c498759-3e77-4662-ba52-7c9e12d9c31e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:47.599303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cedc4-7cb1-4b9c-af46-e21e7758eef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:47.600039 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cedc4-7cb1-4b9c-af46-e21e7758eef5 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:47.600330 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cedc4-7cb1-4b9c-af46-e21e7758eef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:47.600608 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cedc4-7cb1-4b9c-af46-e21e7758eef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:47.603539 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-208cedc4-7cb1-4b9c-af46-e21e7758eef5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:47.663649 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c3d79-cde3-4182-9fa0-8a85a7f533f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:47.664558 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c3d79-cde3-4182-9fa0-8a85a7f533f4 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:47.664852 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c3d79-cde3-4182-9fa0-8a85a7f533f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:47.665200 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c3d79-cde3-4182-9fa0-8a85a7f533f4 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:47.665949 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c3d79-cde3-4182-9fa0-8a85a7f533f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:47.668846 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c3d79-cde3-4182-9fa0-8a85a7f533f4 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:47.704946 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 903/1808] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:47 2021] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:47.707538 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c9c43-8fd2-4a5b-bd8d-857e09faa4b9 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:47.709593 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c9c43-8fd2-4a5b-bd8d-857e09faa4b9 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:47.710140 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c9c43-8fd2-4a5b-bd8d-857e09faa4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:47.737823 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cedc4-7cb1-4b9c-af46-e21e7758eef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:47.737823 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cedc4-7cb1-4b9c-af46-e21e7758eef5 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:47.739181 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-490c9c43-8fd2-4a5b-bd8d-857e09faa4b9 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:47.742510 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-490c9c43-8fd2-4a5b-bd8d-857e09faa4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:47.745683 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 906/1809] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:47 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:47.746659 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cedc4-7cb1-4b9c-af46-e21e7758eef5 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:47.748044 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-208cedc4-7cb1-4b9c-af46-e21e7758eef5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:47.753495 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 904/1810] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:47.761784 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c9c43-8fd2-4a5b-bd8d-857e09faa4b9 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:47.768064 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cedc4-7cb1-4b9c-af46-e21e7758eef5 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:47.773380 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57aec1-f572-4d4f-9fc0-17a3a28a4ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:47.774258 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57aec1-f572-4d4f-9fc0-17a3a28a4ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:47.774558 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57aec1-f572-4d4f-9fc0-17a3a28a4ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:47.774964 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57aec1-f572-4d4f-9fc0-17a3a28a4ffc admin admin] PATH_INFO: `/v3/projects/ba22d94a5739402caf091c7634f1f47f` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:47.776638 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57aec1-f572-4d4f-9fc0-17a3a28a4ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba22d94a5739402caf091c7634f1f47f)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:47.776757 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c9c43-8fd2-4a5b-bd8d-857e09faa4b9 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:47.779442 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57aec1-f572-4d4f-9fc0-17a3a28a4ffc admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:47.783227 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20601e-41d5-44ac-b88d-c5301bba0ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:47.785188 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20601e-41d5-44ac-b88d-c5301bba0ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:47.785574 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20601e-41d5-44ac-b88d-c5301bba0ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:47.786023 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20601e-41d5-44ac-b88d-c5301bba0ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:47.786854 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20601e-41d5-44ac-b88d-c5301bba0ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:47.789112 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20601e-41d5-44ac-b88d-c5301bba0ba2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:47.804452 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 905/1811] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:47 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:47.806257 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0e370-8668-4f40-93e5-7f4a48cfc34c None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:47.806651 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0e370-8668-4f40-93e5-7f4a48cfc34c None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:47.807023 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0e370-8668-4f40-93e5-7f4a48cfc34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:47.834877 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-dbb0e370-8668-4f40-93e5-7f4a48cfc34c None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:47.836423 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-dbb0e370-8668-4f40-93e5-7f4a48cfc34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:47.857432 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8c57aec1-f572-4d4f-9fc0-17a3a28a4ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba22d94a5739402caf091c7634f1f47f', 'request_id': 'req-8c57aec1-f572-4d4f-9fc0-17a3a28a4ffc'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:47.865274 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8c57aec1-f572-4d4f-9fc0-17a3a28a4ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba22d94a5739402caf091c7634f1f47f', 'request_id': 'req-8c57aec1-f572-4d4f-9fc0-17a3a28a4ffc'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:47.876776 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8c57aec1-f572-4d4f-9fc0-17a3a28a4ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba22d94a5739402caf091c7634f1f47f', 'request_id': 'req-8c57aec1-f572-4d4f-9fc0-17a3a28a4ffc'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:47.894547 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8c57aec1-f572-4d4f-9fc0-17a3a28a4ffc admin admin] The token cache is being invalidate because project ba22d94a5739402caf091c7634f1f47f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:47.894849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8c57aec1-f572-4d4f-9fc0-17a3a28a4ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:47.896202 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8c57aec1-f572-4d4f-9fc0-17a3a28a4ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:47.901062 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 907/1812] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:47 2021] DELETE /identity/v3/projects/ba22d94a5739402caf091c7634f1f47f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:47.901062 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57aec1-f572-4d4f-9fc0-17a3a28a4ffc admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:47.901289 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-8c57aec1-f572-4d4f-9fc0-17a3a28a4ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:47.973483 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 906/1813] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:47.974787 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0e370-8668-4f40-93e5-7f4a48cfc34c None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:47.978936 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-dbb0e370-8668-4f40-93e5-7f4a48cfc34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:48.007938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0e370-8668-4f40-93e5-7f4a48cfc34c None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:48.011329 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57aec1-f572-4d4f-9fc0-17a3a28a4ffc admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:48.015399 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c153b0-8b3e-4228-9984-bbc6b864ad2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:48.016996 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c153b0-8b3e-4228-9984-bbc6b864ad2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:48.017287 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c153b0-8b3e-4228-9984-bbc6b864ad2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:48.017626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c153b0-8b3e-4228-9984-bbc6b864ad2f admin admin] PATH_INFO: `/v3/users/360ed97deac44d3f8237875b3c1415ea` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:48.019078 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c153b0-8b3e-4228-9984-bbc6b864ad2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=360ed97deac44d3f8237875b3c1415ea)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:48.019932 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177a57a-48c0-42fa-bb0a-58884242bbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:48.021274 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177a57a-48c0-42fa-bb0a-58884242bbd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:48.021764 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177a57a-48c0-42fa-bb0a-58884242bbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:48.021890 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c153b0-8b3e-4228-9984-bbc6b864ad2f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:48.022072 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177a57a-48c0-42fa-bb0a-58884242bbd0 admin admin] PATH_INFO: `/v3/projects/05bf1ee5488b4cae8bf92e83e9092168/users/d460dab30970483894de8827ac9245dd/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:48.044327 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177a57a-48c0-42fa-bb0a-58884242bbd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05bf1ee5488b4cae8bf92e83e9092168, user_id=d460dab30970483894de8827ac9245dd, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:48.049404 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177a57a-48c0-42fa-bb0a-58884242bbd0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:48.072723 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 908/1814] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:47 2021] PUT /identity/v3/projects/05bf1ee5488b4cae8bf92e83e9092168/users/d460dab30970483894de8827ac9245dd/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:48.075220 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177a57a-48c0-42fa-bb0a-58884242bbd0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:48.104065 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-38c153b0-8b3e-4228-9984-bbc6b864ad2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '360ed97deac44d3f8237875b3c1415ea'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:48.105178 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-38c153b0-8b3e-4228-9984-bbc6b864ad2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '360ed97deac44d3f8237875b3c1415ea'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:48.119608 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-38c153b0-8b3e-4228-9984-bbc6b864ad2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '360ed97deac44d3f8237875b3c1415ea'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:48.121013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-38c153b0-8b3e-4228-9984-bbc6b864ad2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '360ed97deac44d3f8237875b3c1415ea'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:48.152481 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-38c153b0-8b3e-4228-9984-bbc6b864ad2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '360ed97deac44d3f8237875b3c1415ea'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:48.163261 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177a57a-48c0-42fa-bb0a-58884242bbd0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:48.167374 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 907/1815] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:47 2021] DELETE /identity/v3/users/360ed97deac44d3f8237875b3c1415ea => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:48.168170 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c153b0-8b3e-4228-9984-bbc6b864ad2f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:48.169717 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-38c153b0-8b3e-4228-9984-bbc6b864ad2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:48.169997 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b7418-fbbb-4afe-ad28-f067302d7836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:48.170784 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b7418-fbbb-4afe-ad28-f067302d7836 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:48.171703 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b7418-fbbb-4afe-ad28-f067302d7836 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:48.172125 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b7418-fbbb-4afe-ad28-f067302d7836 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:48.173550 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b7418-fbbb-4afe-ad28-f067302d7836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:48.174241 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b7418-fbbb-4afe-ad28-f067302d7836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:48.176658 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b7418-fbbb-4afe-ad28-f067302d7836 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:48.208786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 909/1816] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:48.208786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b7418-fbbb-4afe-ad28-f067302d7836 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:48.208786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-1d7b7418-fbbb-4afe-ad28-f067302d7836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:48.227777 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b7418-fbbb-4afe-ad28-f067302d7836 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:48.247012 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c153b0-8b3e-4228-9984-bbc6b864ad2f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:48.253295 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8cea6-9487-4618-be30-465ce1b7f0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:48.254506 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8cea6-9487-4618-be30-465ce1b7f0bd admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:48.254800 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8cea6-9487-4618-be30-465ce1b7f0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:48.255078 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8cea6-9487-4618-be30-465ce1b7f0bd admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:48.255824 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8cea6-9487-4618-be30-465ce1b7f0bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:48.258289 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8cea6-9487-4618-be30-465ce1b7f0bd admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:48.282450 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 908/1817] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:48 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:48.287353 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8cea6-9487-4618-be30-465ce1b7f0bd admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:48.289325 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-28c8cea6-9487-4618-be30-465ce1b7f0bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:48.307243 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8cea6-9487-4618-be30-465ce1b7f0bd admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:48.314671 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506db48-3984-4f14-bfda-805b0e255b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:48.315941 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506db48-3984-4f14-bfda-805b0e255b32 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:48.316727 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506db48-3984-4f14-bfda-805b0e255b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:48.317496 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506db48-3984-4f14-bfda-805b0e255b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:48.318213 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506db48-3984-4f14-bfda-805b0e255b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:48.319081 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fbb91-6cbc-4041-aefb-ac398833bbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:48.320527 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fbb91-6cbc-4041-aefb-ac398833bbb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:48.320650 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b506db48-3984-4f14-bfda-805b0e255b32 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:48.323392 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fbb91-6cbc-4041-aefb-ac398833bbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:48.323862 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fbb91-6cbc-4041-aefb-ac398833bbb8 admin admin] PATH_INFO: `/v3/projects/3cbe282601b2485dbdb8b44cb72be2d7` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:48.326056 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fbb91-6cbc-4041-aefb-ac398833bbb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cbe282601b2485dbdb8b44cb72be2d7)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:48.328465 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fbb91-6cbc-4041-aefb-ac398833bbb8 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:48.355935 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 909/1818] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:48 2021] POST /identity/v3/projects => generated 387 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:48.356852 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506db48-3984-4f14-bfda-805b0e255b32 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:48.410751 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d35fbb91-6cbc-4041-aefb-ac398833bbb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cbe282601b2485dbdb8b44cb72be2d7', 'request_id': 'req-d35fbb91-6cbc-4041-aefb-ac398833bbb8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:48.419662 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d35fbb91-6cbc-4041-aefb-ac398833bbb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cbe282601b2485dbdb8b44cb72be2d7', 'request_id': 'req-d35fbb91-6cbc-4041-aefb-ac398833bbb8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:48.428904 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d35fbb91-6cbc-4041-aefb-ac398833bbb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cbe282601b2485dbdb8b44cb72be2d7', 'request_id': 'req-d35fbb91-6cbc-4041-aefb-ac398833bbb8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:48.441518 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d35fbb91-6cbc-4041-aefb-ac398833bbb8 admin admin] The token cache is being invalidate because project 3cbe282601b2485dbdb8b44cb72be2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:48.442034 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d35fbb91-6cbc-4041-aefb-ac398833bbb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:48.442696 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d35fbb91-6cbc-4041-aefb-ac398833bbb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:48.447498 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 910/1819] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:48 2021] DELETE /identity/v3/projects/3cbe282601b2485dbdb8b44cb72be2d7 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:48.447747 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506db48-3984-4f14-bfda-805b0e255b32 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:48.448357 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fbb91-6cbc-4041-aefb-ac398833bbb8 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:48.449763 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d35fbb91-6cbc-4041-aefb-ac398833bbb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:48.529286 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc351513-3629-4233-8d7d-c9d21e7a1419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:48.530723 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc351513-3629-4233-8d7d-c9d21e7a1419 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:48.531269 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc351513-3629-4233-8d7d-c9d21e7a1419 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:48.531915 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc351513-3629-4233-8d7d-c9d21e7a1419 admin admin] PATH_INFO: `/v3/projects/05bf1ee5488b4cae8bf92e83e9092168/users/d460dab30970483894de8827ac9245dd/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:48.533144 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fbb91-6cbc-4041-aefb-ac398833bbb8 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:48.534817 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc351513-3629-4233-8d7d-c9d21e7a1419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05bf1ee5488b4cae8bf92e83e9092168, user_id=d460dab30970483894de8827ac9245dd, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:48.538768 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28004a85-3f23-42fd-8988-ab0d24d9d8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:48.538998 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28004a85-3f23-42fd-8988-ab0d24d9d8eb admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:48.539196 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc351513-3629-4233-8d7d-c9d21e7a1419 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:48.539390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28004a85-3f23-42fd-8988-ab0d24d9d8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:48.539663 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28004a85-3f23-42fd-8988-ab0d24d9d8eb admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:48.540355 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28004a85-3f23-42fd-8988-ab0d24d9d8eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:48.542971 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28004a85-3f23-42fd-8988-ab0d24d9d8eb admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:48.558012 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 910/1820] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:48 2021] PUT /identity/v3/projects/05bf1ee5488b4cae8bf92e83e9092168/users/d460dab30970483894de8827ac9245dd/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:48.559995 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc351513-3629-4233-8d7d-c9d21e7a1419 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:48.562459 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-cc351513-3629-4233-8d7d-c9d21e7a1419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:48.576316 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 911/1821] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:48 2021] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:48.578550 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a7636-6544-4c0c-ba3a-c3e7ed77da5e None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:48.578843 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a7636-6544-4c0c-ba3a-c3e7ed77da5e None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:48.579123 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a7636-6544-4c0c-ba3a-c3e7ed77da5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:48.614065 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-e24a7636-6544-4c0c-ba3a-c3e7ed77da5e None None] MFA Rules not processed for user `d460dab30970483894de8827ac9245dd`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:48.616395 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-e24a7636-6544-4c0c-ba3a-c3e7ed77da5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:48.651434 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc351513-3629-4233-8d7d-c9d21e7a1419 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:48.668507 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8470b66-c6b0-45db-92a4-104135ea3ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:48.670475 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8470b66-c6b0-45db-92a4-104135ea3ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:48.671527 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8470b66-c6b0-45db-92a4-104135ea3ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:48.672012 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8470b66-c6b0-45db-92a4-104135ea3ddb admin admin] PATH_INFO: `/v3/users/e28d18d40aea48ebbdb10ddc1882e3a5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:48.673608 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8470b66-c6b0-45db-92a4-104135ea3ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e28d18d40aea48ebbdb10ddc1882e3a5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:48.675821 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8470b66-c6b0-45db-92a4-104135ea3ddb admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:48.720046 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 912/1822] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:48 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:48.721467 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a7636-6544-4c0c-ba3a-c3e7ed77da5e None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:48.744507 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a7636-6544-4c0c-ba3a-c3e7ed77da5e None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:48.750398 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a8470b66-c6b0-45db-92a4-104135ea3ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e28d18d40aea48ebbdb10ddc1882e3a5'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:48.750550 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4f8fc-21a7-4838-a317-6e15dd60a47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:48.751136 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a8470b66-c6b0-45db-92a4-104135ea3ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e28d18d40aea48ebbdb10ddc1882e3a5'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:48.751258 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4f8fc-21a7-4838-a317-6e15dd60a47e admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:48.751469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4f8fc-21a7-4838-a317-6e15dd60a47e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:48.752002 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4f8fc-21a7-4838-a317-6e15dd60a47e admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:48.752747 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4f8fc-21a7-4838-a317-6e15dd60a47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:48.754429 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4f8fc-21a7-4838-a317-6e15dd60a47e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:48.762494 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a8470b66-c6b0-45db-92a4-104135ea3ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e28d18d40aea48ebbdb10ddc1882e3a5'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:48.763509 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a8470b66-c6b0-45db-92a4-104135ea3ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e28d18d40aea48ebbdb10ddc1882e3a5'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:48.766452 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 913/1823] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:48 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:48.767374 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4f8fc-21a7-4838-a317-6e15dd60a47e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:48.771820 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-c3a4f8fc-21a7-4838-a317-6e15dd60a47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:48.785925 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a8470b66-c6b0-45db-92a4-104135ea3ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e28d18d40aea48ebbdb10ddc1882e3a5'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:48.802565 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 911/1824] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:48 2021] DELETE /identity/v3/users/e28d18d40aea48ebbdb10ddc1882e3a5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:48.804765 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8470b66-c6b0-45db-92a4-104135ea3ddb admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:48.806612 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a8470b66-c6b0-45db-92a4-104135ea3ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:48.898571 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8470b66-c6b0-45db-92a4-104135ea3ddb admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:48.903951 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844ef7e-aff2-400b-8305-ee2065184e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:48.904746 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844ef7e-aff2-400b-8305-ee2065184e6d admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:48.904947 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844ef7e-aff2-400b-8305-ee2065184e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:48.905738 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844ef7e-aff2-400b-8305-ee2065184e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:48.906476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844ef7e-aff2-400b-8305-ee2065184e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:48.908583 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844ef7e-aff2-400b-8305-ee2065184e6d admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:48.922783 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 912/1825] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:48 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:48.922783 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b89e5-ac01-4580-8b71-8eab18b0db5a None None] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:48.922783 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b89e5-ac01-4580-8b71-8eab18b0db5a None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:48.922783 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b89e5-ac01-4580-8b71-8eab18b0db5a None None] PATH_INFO: `/` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:48.924394 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 913/1826] 10.222.0.32 () {54 vars in 921 bytes} [Wed Sep 15 02:29:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:29:48.927473 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4f8fc-21a7-4838-a317-6e15dd60a47e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:48.927596 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b89e5-ac01-4580-8b71-8eab18b0db5a None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:48.970845 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b89e5-ac01-4580-8b71-8eab18b0db5a None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:48.981571 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c5137-6b52-4c84-ab94-85d568f9625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:48.982855 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c5137-6b52-4c84-ab94-85d568f9625b admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:48.983477 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c5137-6b52-4c84-ab94-85d568f9625b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:48.984015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c5137-6b52-4c84-ab94-85d568f9625b admin admin] PATH_INFO: `/v3/projects/b3d9a2044f74489f84f7eaca40003810/users/0edbd0afd7e14a1aa7828430900fb9da/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:49.002910 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c5137-6b52-4c84-ab94-85d568f9625b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d9a2044f74489f84f7eaca40003810, user_id=0edbd0afd7e14a1aa7828430900fb9da, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:49.006064 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c5137-6b52-4c84-ab94-85d568f9625b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:49.010640 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4908639-5284-49de-8ea5-a95884a4dedb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:49.011968 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4908639-5284-49de-8ea5-a95884a4dedb service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:49.012562 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4908639-5284-49de-8ea5-a95884a4dedb service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:49.012637 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4908639-5284-49de-8ea5-a95884a4dedb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:49.017458 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d4908639-5284-49de-8ea5-a95884a4dedb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:49.027235 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 914/1827] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:48 2021] PUT /identity/v3/projects/b3d9a2044f74489f84f7eaca40003810/users/0edbd0afd7e14a1aa7828430900fb9da/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:49.028864 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500d8a2-71ff-4050-8089-fe8268af2469 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:49.029697 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500d8a2-71ff-4050-8089-fe8268af2469 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:49.030232 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500d8a2-71ff-4050-8089-fe8268af2469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:49.103351 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-a500d8a2-71ff-4050-8089-fe8268af2469 None None] MFA Rules not processed for user `797b76e6f16d428198e7f7f05c9c0fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:49.106661 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a500d8a2-71ff-4050-8089-fe8268af2469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:49.117724 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4908639-5284-49de-8ea5-a95884a4dedb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:49.125237 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4908639-5284-49de-8ea5-a95884a4dedb service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:49.139425 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 914/1828] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:48 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:49.141298 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d4c6a-2c8a-4f04-b7e2-9caad0268fa4 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:49.141589 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d4c6a-2c8a-4f04-b7e2-9caad0268fa4 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:49.141869 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d4c6a-2c8a-4f04-b7e2-9caad0268fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:49.207553 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-f13d4c6a-2c8a-4f04-b7e2-9caad0268fa4 None None] MFA Rules not processed for user `0edbd0afd7e14a1aa7828430900fb9da`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:49.219044 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f13d4c6a-2c8a-4f04-b7e2-9caad0268fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:49.284513 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 915/1829] 10.222.0.32 () {58 vars in 1019 bytes} [Wed Sep 15 02:29:49 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:49.330118 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 915/1830] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:49 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:49.335439 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500d8a2-71ff-4050-8089-fe8268af2469 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:49.353067 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d4c6a-2c8a-4f04-b7e2-9caad0268fa4 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:49.355608 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f13d4c6a-2c8a-4f04-b7e2-9caad0268fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:49.402753 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d4c6a-2c8a-4f04-b7e2-9caad0268fa4 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:49.416280 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbb7ab-1d90-4d58-a15f-ee22a7b04dce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:49.416608 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbb7ab-1d90-4d58-a15f-ee22a7b04dce service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:49.417411 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbb7ab-1d90-4d58-a15f-ee22a7b04dce service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:49.419012 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbb7ab-1d90-4d58-a15f-ee22a7b04dce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:49.437020 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbb7ab-1d90-4d58-a15f-ee22a7b04dce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:49.449468 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbb7ab-1d90-4d58-a15f-ee22a7b04dce service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:49.492669 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500d8a2-71ff-4050-8089-fe8268af2469 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:49.499146 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3078080-377e-439b-badf-229d01514799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:49.500634 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3078080-377e-439b-badf-229d01514799 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:49.501363 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3078080-377e-439b-badf-229d01514799 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:49.502852 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3078080-377e-439b-badf-229d01514799 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:49.503746 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3078080-377e-439b-badf-229d01514799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:49.504496 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 916/1831] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:49 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:49.507560 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3078080-377e-439b-badf-229d01514799 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:49.552574 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 916/1832] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:49 2021] POST /identity/v3/projects => generated 385 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:49.554844 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbb7ab-1d90-4d58-a15f-ee22a7b04dce service nova] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:49.574551 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbb7ab-1d90-4d58-a15f-ee22a7b04dce service nova] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:49.732804 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd81aa-444d-4b84-bb42-455da9ff37a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:49.737622 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd81aa-444d-4b84-bb42-455da9ff37a4 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:49.737960 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd81aa-444d-4b84-bb42-455da9ff37a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:49.739071 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd81aa-444d-4b84-bb42-455da9ff37a4 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:49.740233 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd81aa-444d-4b84-bb42-455da9ff37a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:49.746036 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd81aa-444d-4b84-bb42-455da9ff37a4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:49.801821 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3078080-377e-439b-badf-229d01514799 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:49.804445 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 917/1833] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:49 2021] POST /identity/v3/users => generated 299 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:49.816071 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3078080-377e-439b-badf-229d01514799 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:49.822763 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff08671-47a4-43b9-b86e-ca4cda63ac5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:49.823820 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff08671-47a4-43b9-b86e-ca4cda63ac5e admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:49.824396 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff08671-47a4-43b9-b86e-ca4cda63ac5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:49.824932 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff08671-47a4-43b9-b86e-ca4cda63ac5e admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:49.826385 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff08671-47a4-43b9-b86e-ca4cda63ac5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:49.829553 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff08671-47a4-43b9-b86e-ca4cda63ac5e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:49.844145 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 917/1834] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:49 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:29:49.848610 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd81aa-444d-4b84-bb42-455da9ff37a4 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:49.861192 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd81aa-444d-4b84-bb42-455da9ff37a4 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:49.874731 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f53ed-3a87-406f-bd13-1ce72a2bba9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:49.875689 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f53ed-3a87-406f-bd13-1ce72a2bba9e admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:49.875973 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f53ed-3a87-406f-bd13-1ce72a2bba9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:49.876235 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f53ed-3a87-406f-bd13-1ce72a2bba9e admin admin] PATH_INFO: `/v3/projects/65790bd172834f57b5034e76c017e835/users/d4892293dad54b329c0b350cfdea5425/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:49.914001 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f53ed-3a87-406f-bd13-1ce72a2bba9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=65790bd172834f57b5034e76c017e835, user_id=d4892293dad54b329c0b350cfdea5425, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:49.927592 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f53ed-3a87-406f-bd13-1ce72a2bba9e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:49.961094 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 918/1835] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:49 2021] PUT /identity/v3/projects/65790bd172834f57b5034e76c017e835/users/d4892293dad54b329c0b350cfdea5425/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:49.967118 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff08671-47a4-43b9-b86e-ca4cda63ac5e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:50.002467 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff08671-47a4-43b9-b86e-ca4cda63ac5e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:50.120202 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f53ed-3a87-406f-bd13-1ce72a2bba9e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:50.122392 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-080f53ed-3a87-406f-bd13-1ce72a2bba9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:50.131100 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c269ea3-5dd8-4b55-88b6-45a790ecf816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:50.134077 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c269ea3-5dd8-4b55-88b6-45a790ecf816 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:50.134686 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c269ea3-5dd8-4b55-88b6-45a790ecf816 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:50.135654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c269ea3-5dd8-4b55-88b6-45a790ecf816 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:50.137395 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c269ea3-5dd8-4b55-88b6-45a790ecf816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:50.139015 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f53ed-3a87-406f-bd13-1ce72a2bba9e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:50.141287 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c269ea3-5dd8-4b55-88b6-45a790ecf816 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:50.145323 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3365a16-6d3c-43bf-90f1-e80de4c3649d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:50.146675 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3365a16-6d3c-43bf-90f1-e80de4c3649d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:50.147039 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3365a16-6d3c-43bf-90f1-e80de4c3649d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:50.147452 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3365a16-6d3c-43bf-90f1-e80de4c3649d admin admin] PATH_INFO: `/v3/projects/1dbd6bab95c14ef693f7aa4e23d9a0c3` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:50.148936 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3365a16-6d3c-43bf-90f1-e80de4c3649d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dbd6bab95c14ef693f7aa4e23d9a0c3)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:50.151213 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3365a16-6d3c-43bf-90f1-e80de4c3649d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:50.162632 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 918/1836] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:49 2021] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:50.163396 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c269ea3-5dd8-4b55-88b6-45a790ecf816 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:50.184157 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c269ea3-5dd8-4b55-88b6-45a790ecf816 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:50.192774 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa7fb3-1953-41c4-98ba-2975032c475a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:50.194393 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa7fb3-1953-41c4-98ba-2975032c475a admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:50.194393 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa7fb3-1953-41c4-98ba-2975032c475a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:50.194773 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa7fb3-1953-41c4-98ba-2975032c475a admin admin] PATH_INFO: `/v3/projects/65790bd172834f57b5034e76c017e835/users/d4892293dad54b329c0b350cfdea5425/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:50.197149 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa7fb3-1953-41c4-98ba-2975032c475a admin admin] RBAC: Authorizing `identity:create_grant(project_id=65790bd172834f57b5034e76c017e835, user_id=d4892293dad54b329c0b350cfdea5425, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:50.201554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa7fb3-1953-41c4-98ba-2975032c475a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:50.225063 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 919/1837] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:50 2021] PUT /identity/v3/projects/65790bd172834f57b5034e76c017e835/users/d4892293dad54b329c0b350cfdea5425/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:29:50.227445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db2137-90ae-4ce0-8b17-cddbe5463759 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:50.227773 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db2137-90ae-4ce0-8b17-cddbe5463759 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:50.228070 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db2137-90ae-4ce0-8b17-cddbe5463759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:50.243925 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d3365a16-6d3c-43bf-90f1-e80de4c3649d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dbd6bab95c14ef693f7aa4e23d9a0c3', 'request_id': 'req-d3365a16-6d3c-43bf-90f1-e80de4c3649d'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:50.254350 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d3365a16-6d3c-43bf-90f1-e80de4c3649d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dbd6bab95c14ef693f7aa4e23d9a0c3', 'request_id': 'req-d3365a16-6d3c-43bf-90f1-e80de4c3649d'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:50.270698 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d3365a16-6d3c-43bf-90f1-e80de4c3649d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dbd6bab95c14ef693f7aa4e23d9a0c3', 'request_id': 'req-d3365a16-6d3c-43bf-90f1-e80de4c3649d'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:50.279549 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-26db2137-90ae-4ce0-8b17-cddbe5463759 None None] MFA Rules not processed for user `d4892293dad54b329c0b350cfdea5425`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:50.280665 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-26db2137-90ae-4ce0-8b17-cddbe5463759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:50.290970 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d3365a16-6d3c-43bf-90f1-e80de4c3649d admin admin] The token cache is being invalidate because project 1dbd6bab95c14ef693f7aa4e23d9a0c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:50.291468 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d3365a16-6d3c-43bf-90f1-e80de4c3649d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:50.292252 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d3365a16-6d3c-43bf-90f1-e80de4c3649d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:50.294152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 919/1838] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:50 2021] DELETE /identity/v3/projects/1dbd6bab95c14ef693f7aa4e23d9a0c3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:50.300252 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d49335-de1c-4332-bf2a-716f62438312 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:50.300663 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d49335-de1c-4332-bf2a-716f62438312 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:50.301075 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d49335-de1c-4332-bf2a-716f62438312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:50.320748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-84d49335-de1c-4332-bf2a-716f62438312 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:50.322142 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-84d49335-de1c-4332-bf2a-716f62438312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:50.362150 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 920/1839] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:50 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:50.368601 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db2137-90ae-4ce0-8b17-cddbe5463759 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:50.370231 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-26db2137-90ae-4ce0-8b17-cddbe5463759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:50.418782 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 920/1840] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:50.441505 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee60e0-5033-488e-942b-c70740daa96e None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:50.442438 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee60e0-5033-488e-942b-c70740daa96e None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:50.443704 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee60e0-5033-488e-942b-c70740daa96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:50.454340 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db2137-90ae-4ce0-8b17-cddbe5463759 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:50.465188 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71493d71-4d45-4f6d-a1a6-710d932d08c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:50.465858 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71493d71-4d45-4f6d-a1a6-710d932d08c9 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:50.469234 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71493d71-4d45-4f6d-a1a6-710d932d08c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:50.469774 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71493d71-4d45-4f6d-a1a6-710d932d08c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:50.499122 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-3fee60e0-5033-488e-942b-c70740daa96e None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:50.499352 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71493d71-4d45-4f6d-a1a6-710d932d08c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:50.501065 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-3fee60e0-5033-488e-942b-c70740daa96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:50.501661 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71493d71-4d45-4f6d-a1a6-710d932d08c9 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:50.517210 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 921/1841] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:50 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:29:50.518156 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 921/1842] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:50.522413 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71493d71-4d45-4f6d-a1a6-710d932d08c9 service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:50.529787 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee60e0-5033-488e-942b-c70740daa96e None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:50.531790 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-3fee60e0-5033-488e-942b-c70740daa96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:50.540796 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71493d71-4d45-4f6d-a1a6-710d932d08c9 service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:50.549324 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a9d78-fd5a-442a-b442-2ae021abca3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:50.550386 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a9d78-fd5a-442a-b442-2ae021abca3e admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:50.550885 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a9d78-fd5a-442a-b442-2ae021abca3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:50.551701 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a9d78-fd5a-442a-b442-2ae021abca3e admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:50.553025 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a9d78-fd5a-442a-b442-2ae021abca3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:50.553624 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a9d78-fd5a-442a-b442-2ae021abca3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:50.555610 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a9d78-fd5a-442a-b442-2ae021abca3e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:50.555737 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee60e0-5033-488e-942b-c70740daa96e None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:50.562882 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fa73a-fe25-4560-a56c-3f5e9770c885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:50.564039 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fa73a-fe25-4560-a56c-3f5e9770c885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:50.564327 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fa73a-fe25-4560-a56c-3f5e9770c885 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:50.564609 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fa73a-fe25-4560-a56c-3f5e9770c885 admin admin] PATH_INFO: `/v3/projects/c3c55df461434f85ae16c45e8bb52941` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:50.567451 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fa73a-fe25-4560-a56c-3f5e9770c885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c55df461434f85ae16c45e8bb52941)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:50.569798 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fa73a-fe25-4560-a56c-3f5e9770c885 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:50.578064 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 922/1843] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:50.579403 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a9d78-fd5a-442a-b442-2ae021abca3e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:50.621207 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a9d78-fd5a-442a-b442-2ae021abca3e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:50.631770 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71939520-3433-4f7e-b0a3-f60ed4d057ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:50.632584 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71939520-3433-4f7e-b0a3-f60ed4d057ed admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:50.633007 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71939520-3433-4f7e-b0a3-f60ed4d057ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:50.633498 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71939520-3433-4f7e-b0a3-f60ed4d057ed admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:50.634402 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71939520-3433-4f7e-b0a3-f60ed4d057ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:50.636609 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71939520-3433-4f7e-b0a3-f60ed4d057ed admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:50.677814 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 923/1844] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:50 2021] POST /identity/v3/projects => generated 361 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:50.682671 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-4f5fa73a-fe25-4560-a56c-3f5e9770c885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c55df461434f85ae16c45e8bb52941', 'request_id': 'req-4f5fa73a-fe25-4560-a56c-3f5e9770c885'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:50.690407 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71939520-3433-4f7e-b0a3-f60ed4d057ed admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:50.700995 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-4f5fa73a-fe25-4560-a56c-3f5e9770c885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c55df461434f85ae16c45e8bb52941', 'request_id': 'req-4f5fa73a-fe25-4560-a56c-3f5e9770c885'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:50.727971 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-4f5fa73a-fe25-4560-a56c-3f5e9770c885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c55df461434f85ae16c45e8bb52941', 'request_id': 'req-4f5fa73a-fe25-4560-a56c-3f5e9770c885'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:50.755980 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-4f5fa73a-fe25-4560-a56c-3f5e9770c885 admin admin] The token cache is being invalidate because project c3c55df461434f85ae16c45e8bb52941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:50.756555 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-4f5fa73a-fe25-4560-a56c-3f5e9770c885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:50.757848 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-4f5fa73a-fe25-4560-a56c-3f5e9770c885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:50.760916 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 922/1845] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:50 2021] DELETE /identity/v3/projects/c3c55df461434f85ae16c45e8bb52941 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:29:50.769039 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110647ba-327e-4125-9125-48af9ed2cba5 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:50.769737 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110647ba-327e-4125-9125-48af9ed2cba5 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:50.770226 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110647ba-327e-4125-9125-48af9ed2cba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:50.816659 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-110647ba-327e-4125-9125-48af9ed2cba5 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:50.820389 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-110647ba-327e-4125-9125-48af9ed2cba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:50.828177 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71939520-3433-4f7e-b0a3-f60ed4d057ed admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:50.846108 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd1cb4-279d-4d07-a2a7-39af02cb6968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:50.846569 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 923/1846] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:50.854186 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407bd24-5185-4df3-b845-e982c8c2c27e None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:50.854483 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407bd24-5185-4df3-b845-e982c8c2c27e None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:50.854649 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd1cb4-279d-4d07-a2a7-39af02cb6968 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:50.854753 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407bd24-5185-4df3-b845-e982c8c2c27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:50.854901 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd1cb4-279d-4d07-a2a7-39af02cb6968 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:50.855183 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd1cb4-279d-4d07-a2a7-39af02cb6968 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:50.856048 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd1cb4-279d-4d07-a2a7-39af02cb6968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:50.859044 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd1cb4-279d-4d07-a2a7-39af02cb6968 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:50.902145 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-3407bd24-5185-4df3-b845-e982c8c2c27e None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:50.905765 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 924/1847] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:50 2021] POST /identity/v3/users => generated 281 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:50.905893 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-3407bd24-5185-4df3-b845-e982c8c2c27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:50.907946 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd1cb4-279d-4d07-a2a7-39af02cb6968 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:50.911297 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-83fd1cb4-279d-4d07-a2a7-39af02cb6968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:50.934671 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 924/1848] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:29:50.937546 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407bd24-5185-4df3-b845-e982c8c2c27e None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:50.951589 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd1cb4-279d-4d07-a2a7-39af02cb6968 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:50.960613 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407bd24-5185-4df3-b845-e982c8c2c27e None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:50.965960 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed3853-5981-44fa-afd3-551d232e73da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:50.966756 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed3853-5981-44fa-afd3-551d232e73da admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:50.967046 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed3853-5981-44fa-afd3-551d232e73da admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:50.967321 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed3853-5981-44fa-afd3-551d232e73da admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:50.974740 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed3853-5981-44fa-afd3-551d232e73da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:50.977692 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89398b4-f6ca-46e4-9c1b-fa204081b6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:50.978600 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89398b4-f6ca-46e4-9c1b-fa204081b6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:50.979522 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89398b4-f6ca-46e4-9c1b-fa204081b6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:50.979820 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed3853-5981-44fa-afd3-551d232e73da admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:50.980314 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89398b4-f6ca-46e4-9c1b-fa204081b6e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:50.981425 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89398b4-f6ca-46e4-9c1b-fa204081b6e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:50.981938 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89398b4-f6ca-46e4-9c1b-fa204081b6e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:50.985344 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89398b4-f6ca-46e4-9c1b-fa204081b6e9 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:51.009972 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 925/1849] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:51.013238 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 925/1850] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:50 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:51.015495 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89398b4-f6ca-46e4-9c1b-fa204081b6e9 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:51.015887 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed3853-5981-44fa-afd3-551d232e73da admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:51.031074 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed3853-5981-44fa-afd3-551d232e73da admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:51.039241 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89398b4-f6ca-46e4-9c1b-fa204081b6e9 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:51.043832 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fe0b4-add9-4ba0-bf17-ab3447f80476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:51.044650 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fe0b4-add9-4ba0-bf17-ab3447f80476 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:51.045073 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fe0b4-add9-4ba0-bf17-ab3447f80476 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:51.045451 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fe0b4-add9-4ba0-bf17-ab3447f80476 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:51.046314 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fe0b4-add9-4ba0-bf17-ab3447f80476 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:51.049008 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e760bb-43ce-4669-8d51-bd7e653a1936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:51.049894 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e760bb-43ce-4669-8d51-bd7e653a1936 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:51.050455 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e760bb-43ce-4669-8d51-bd7e653a1936 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:51.050901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e760bb-43ce-4669-8d51-bd7e653a1936 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:51.051936 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e760bb-43ce-4669-8d51-bd7e653a1936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:51.052145 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fe0b4-add9-4ba0-bf17-ab3447f80476 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:51.054129 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e760bb-43ce-4669-8d51-bd7e653a1936 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:51.107064 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 926/1851] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:51 2021] POST /identity/v3/projects => generated 369 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:51.107854 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fe0b4-add9-4ba0-bf17-ab3447f80476 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:51.120741 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 926/1852] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:51 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:51.121824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e760bb-43ce-4669-8d51-bd7e653a1936 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:51.136319 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e760bb-43ce-4669-8d51-bd7e653a1936 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:51.219646 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fe0b4-add9-4ba0-bf17-ab3447f80476 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:51.234962 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ff488-ca9d-4564-8eff-da02622b47a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:51.235934 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ff488-ca9d-4564-8eff-da02622b47a8 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:51.236325 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ff488-ca9d-4564-8eff-da02622b47a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:51.236502 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ff488-ca9d-4564-8eff-da02622b47a8 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:51.237396 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ff488-ca9d-4564-8eff-da02622b47a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:51.242027 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ff488-ca9d-4564-8eff-da02622b47a8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:51.245965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf69160-f530-4361-bb21-6423fb7deff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:51.247145 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf69160-f530-4361-bb21-6423fb7deff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:51.247434 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf69160-f530-4361-bb21-6423fb7deff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:51.248254 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf69160-f530-4361-bb21-6423fb7deff1 admin admin] PATH_INFO: `/v3/projects/2455b67ef35444518aef74d3ad53fd4f/users/622eb386196645a1932b3cd3129e20d2/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:51.277115 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf69160-f530-4361-bb21-6423fb7deff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2455b67ef35444518aef74d3ad53fd4f, user_id=622eb386196645a1932b3cd3129e20d2, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:51.280766 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf69160-f530-4361-bb21-6423fb7deff1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:51.306831 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 927/1853] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:51 2021] POST /identity/v3/users => generated 285 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:51.307558 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 927/1854] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:51 2021] PUT /identity/v3/projects/2455b67ef35444518aef74d3ad53fd4f/users/622eb386196645a1932b3cd3129e20d2/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:51.309758 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ff488-ca9d-4564-8eff-da02622b47a8 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:51.318314 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f3136-8abd-4bdc-a243-f62f6d3e1b59 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:51.318611 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f3136-8abd-4bdc-a243-f62f6d3e1b59 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:51.318945 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f3136-8abd-4bdc-a243-f62f6d3e1b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:51.333769 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ff488-ca9d-4564-8eff-da02622b47a8 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:51.364911 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-f22f3136-8abd-4bdc-a243-f62f6d3e1b59 None None] MFA Rules not processed for user `622eb386196645a1932b3cd3129e20d2`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:51.367586 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f22f3136-8abd-4bdc-a243-f62f6d3e1b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:51.408456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67018d5-f779-44fe-a845-3efc60a3b715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:51.409405 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67018d5-f779-44fe-a845-3efc60a3b715 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:51.409754 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67018d5-f779-44fe-a845-3efc60a3b715 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:51.410097 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67018d5-f779-44fe-a845-3efc60a3b715 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:51.412085 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67018d5-f779-44fe-a845-3efc60a3b715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:51.413416 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67018d5-f779-44fe-a845-3efc60a3b715 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:51.427400 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 928/1855] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:51 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:51.432078 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67018d5-f779-44fe-a845-3efc60a3b715 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:51.445771 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67018d5-f779-44fe-a845-3efc60a3b715 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:51.458816 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ed91b-1fc1-4e6f-b6d9-e2bdd19a4695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:51.460449 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ed91b-1fc1-4e6f-b6d9-e2bdd19a4695 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:51.460586 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ed91b-1fc1-4e6f-b6d9-e2bdd19a4695 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:51.460860 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ed91b-1fc1-4e6f-b6d9-e2bdd19a4695 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:51.462603 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ed91b-1fc1-4e6f-b6d9-e2bdd19a4695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:51.466670 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ed91b-1fc1-4e6f-b6d9-e2bdd19a4695 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:51.493093 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 929/1856] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:51 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:51.502774 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ed91b-1fc1-4e6f-b6d9-e2bdd19a4695 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:51.522986 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ed91b-1fc1-4e6f-b6d9-e2bdd19a4695 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:51.531841 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382d37b-fe6f-45dc-843d-5e0f1b80d7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:51.532830 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382d37b-fe6f-45dc-843d-5e0f1b80d7c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:51.533189 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382d37b-fe6f-45dc-843d-5e0f1b80d7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:51.533542 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382d37b-fe6f-45dc-843d-5e0f1b80d7c0 admin admin] PATH_INFO: `/v3/projects/50306e36b5ca40a5b1f7908ccc805e4f/users/64f312e2adc643cf9d6a98f2c4112f4c/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:51.554969 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 928/1857] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:51 2021] POST /identity/v3/auth/tokens => generated 3381 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:29:51.604359 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382d37b-fe6f-45dc-843d-5e0f1b80d7c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50306e36b5ca40a5b1f7908ccc805e4f, user_id=64f312e2adc643cf9d6a98f2c4112f4c, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:51.607343 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382d37b-fe6f-45dc-843d-5e0f1b80d7c0 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:51.642667 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 930/1858] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:51 2021] PUT /identity/v3/projects/50306e36b5ca40a5b1f7908ccc805e4f/users/64f312e2adc643cf9d6a98f2c4112f4c/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:51.654767 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f3136-8abd-4bdc-a243-f62f6d3e1b59 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:51.657507 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f22f3136-8abd-4bdc-a243-f62f6d3e1b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:51.658302 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5ce91-dd6b-4d78-964a-e1f7f67e0647 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:51.659992 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5ce91-dd6b-4d78-964a-e1f7f67e0647 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:51.661973 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5ce91-dd6b-4d78-964a-e1f7f67e0647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:51.710522 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-e7e5ce91-dd6b-4d78-964a-e1f7f67e0647 None None] MFA Rules not processed for user `64f312e2adc643cf9d6a98f2c4112f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:51.712009 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e7e5ce91-dd6b-4d78-964a-e1f7f67e0647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:51.776136 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f3136-8abd-4bdc-a243-f62f6d3e1b59 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:51.826598 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 931/1859] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:51 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:51.828268 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5ce91-dd6b-4d78-964a-e1f7f67e0647 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:51.831794 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e7e5ce91-dd6b-4d78-964a-e1f7f67e0647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:51.858175 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa4846-781a-4dab-826a-f574417eb008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:51.858998 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa4846-781a-4dab-826a-f574417eb008 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:51.859292 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa4846-781a-4dab-826a-f574417eb008 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:51.859576 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa4846-781a-4dab-826a-f574417eb008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:51.925080 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5ce91-dd6b-4d78-964a-e1f7f67e0647 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:51.931255 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7dfb6-47ae-4a60-82c2-12f759f2789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:51.932138 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7dfb6-47ae-4a60-82c2-12f759f2789f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:51.932419 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7dfb6-47ae-4a60-82c2-12f759f2789f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:51.932693 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7dfb6-47ae-4a60-82c2-12f759f2789f admin admin] PATH_INFO: `/v3/users/0edbd0afd7e14a1aa7828430900fb9da` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:51.933986 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7dfb6-47ae-4a60-82c2-12f759f2789f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0edbd0afd7e14a1aa7828430900fb9da)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:51.935949 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7dfb6-47ae-4a60-82c2-12f759f2789f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:51.937815 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa4846-781a-4dab-826a-f574417eb008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:51.939277 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa4846-781a-4dab-826a-f574417eb008 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:51.948436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 929/1860] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:51 2021] GET /identity/v3/auth/tokens => generated 3381 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:51.949077 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa4846-781a-4dab-826a-f574417eb008 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:51.962915 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa4846-781a-4dab-826a-f574417eb008 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:51.968977 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48db699-b15f-4fa2-96b5-8f9113f81c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:51.969652 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48db699-b15f-4fa2-96b5-8f9113f81c6f admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:51.970267 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48db699-b15f-4fa2-96b5-8f9113f81c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:51.970267 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48db699-b15f-4fa2-96b5-8f9113f81c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:51.971276 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48db699-b15f-4fa2-96b5-8f9113f81c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:51.973383 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48db699-b15f-4fa2-96b5-8f9113f81c6f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:51.996662 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c9d7dfb6-47ae-4a60-82c2-12f759f2789f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0edbd0afd7e14a1aa7828430900fb9da'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:51.997588 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c9d7dfb6-47ae-4a60-82c2-12f759f2789f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0edbd0afd7e14a1aa7828430900fb9da'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:52.005238 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 930/1861] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:51 2021] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:52.006303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48db699-b15f-4fa2-96b5-8f9113f81c6f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:52.006935 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c9d7dfb6-47ae-4a60-82c2-12f759f2789f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0edbd0afd7e14a1aa7828430900fb9da'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:52.007861 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c9d7dfb6-47ae-4a60-82c2-12f759f2789f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0edbd0afd7e14a1aa7828430900fb9da'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:52.007979 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f48db699-b15f-4fa2-96b5-8f9113f81c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:52.022670 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c9d7dfb6-47ae-4a60-82c2-12f759f2789f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0edbd0afd7e14a1aa7828430900fb9da'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:52.039702 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 932/1862] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:51 2021] DELETE /identity/v3/users/0edbd0afd7e14a1aa7828430900fb9da => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:52.039702 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7dfb6-47ae-4a60-82c2-12f759f2789f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:52.040748 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c9d7dfb6-47ae-4a60-82c2-12f759f2789f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:52.083127 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48db699-b15f-4fa2-96b5-8f9113f81c6f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:52.124483 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7dfb6-47ae-4a60-82c2-12f759f2789f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:52.129232 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c804fb-54a6-46fa-81ce-28cc974d6f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:52.129904 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c804fb-54a6-46fa-81ce-28cc974d6f4e admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:52.130189 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c804fb-54a6-46fa-81ce-28cc974d6f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:52.130466 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c804fb-54a6-46fa-81ce-28cc974d6f4e admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:52.131152 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c804fb-54a6-46fa-81ce-28cc974d6f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:52.133127 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c804fb-54a6-46fa-81ce-28cc974d6f4e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:52.147870 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca56fd6-b72d-4d94-949b-6f89327818b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:52.148755 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca56fd6-b72d-4d94-949b-6f89327818b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:52.149138 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca56fd6-b72d-4d94-949b-6f89327818b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:52.149421 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca56fd6-b72d-4d94-949b-6f89327818b5 admin admin] PATH_INFO: `/v3/users/622eb386196645a1932b3cd3129e20d2` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:52.150672 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca56fd6-b72d-4d94-949b-6f89327818b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=622eb386196645a1932b3cd3129e20d2)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:52.152639 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca56fd6-b72d-4d94-949b-6f89327818b5 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:52.153344 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 933/1863] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:52 2021] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:52.155730 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469bed3-956d-423f-b34d-ef4a3c4fe3f5 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:52.155730 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469bed3-956d-423f-b34d-ef4a3c4fe3f5 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:52.156011 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469bed3-956d-423f-b34d-ef4a3c4fe3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:52.173277 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-8469bed3-956d-423f-b34d-ef4a3c4fe3f5 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:52.174486 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8469bed3-956d-423f-b34d-ef4a3c4fe3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:52.183364 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 934/1864] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:52.184198 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469bed3-956d-423f-b34d-ef4a3c4fe3f5 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:52.194556 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469bed3-956d-423f-b34d-ef4a3c4fe3f5 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:52.199506 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207a174-91d5-4a43-a66e-f7d932aabdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:52.200169 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207a174-91d5-4a43-a66e-f7d932aabdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:52.200448 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207a174-91d5-4a43-a66e-f7d932aabdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:52.200741 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207a174-91d5-4a43-a66e-f7d932aabdb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:52.201494 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207a174-91d5-4a43-a66e-f7d932aabdb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:52.203118 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207a174-91d5-4a43-a66e-f7d932aabdb6 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:52.205314 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5ca56fd6-b72d-4d94-949b-6f89327818b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '622eb386196645a1932b3cd3129e20d2'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:52.213620 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 935/1865] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:52 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:52.214741 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207a174-91d5-4a43-a66e-f7d932aabdb6 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:52.216978 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-2207a174-91d5-4a43-a66e-f7d932aabdb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:52.221426 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5ca56fd6-b72d-4d94-949b-6f89327818b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '622eb386196645a1932b3cd3129e20d2'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:52.222170 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5ca56fd6-b72d-4d94-949b-6f89327818b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '622eb386196645a1932b3cd3129e20d2'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:52.229844 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5ca56fd6-b72d-4d94-949b-6f89327818b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '622eb386196645a1932b3cd3129e20d2'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:52.236989 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5ca56fd6-b72d-4d94-949b-6f89327818b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '622eb386196645a1932b3cd3129e20d2'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:52.242850 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 931/1866] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:52 2021] DELETE /identity/v3/users/622eb386196645a1932b3cd3129e20d2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:52.243667 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca56fd6-b72d-4d94-949b-6f89327818b5 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:52.245046 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-5ca56fd6-b72d-4d94-949b-6f89327818b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:52.274524 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207a174-91d5-4a43-a66e-f7d932aabdb6 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:52.307215 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca56fd6-b72d-4d94-949b-6f89327818b5 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:52.312019 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a8d78-4839-4c87-87e5-703a2bc4f07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:52.312929 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a8d78-4839-4c87-87e5-703a2bc4f07b admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:52.313212 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a8d78-4839-4c87-87e5-703a2bc4f07b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:52.313486 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a8d78-4839-4c87-87e5-703a2bc4f07b admin admin] PATH_INFO: `/v3/projects/f1ec34fe1e944d268837a66109a4b1b6/users/bf25bf47186e4778a5262c718c8ed467/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:52.326349 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b71724-717e-4d3a-bf4c-dbf421b37903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:52.327605 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b71724-717e-4d3a-bf4c-dbf421b37903 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:52.327732 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a8d78-4839-4c87-87e5-703a2bc4f07b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1ec34fe1e944d268837a66109a4b1b6, user_id=bf25bf47186e4778a5262c718c8ed467, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:52.327888 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b71724-717e-4d3a-bf4c-dbf421b37903 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:52.328159 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b71724-717e-4d3a-bf4c-dbf421b37903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:52.330021 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-59b71724-717e-4d3a-bf4c-dbf421b37903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:52.330437 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a8d78-4839-4c87-87e5-703a2bc4f07b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:52.343090 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b71724-717e-4d3a-bf4c-dbf421b37903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:52.344358 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 932/1867] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:52 2021] PUT /identity/v3/projects/f1ec34fe1e944d268837a66109a4b1b6/users/bf25bf47186e4778a5262c718c8ed467/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:52.344513 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b71724-717e-4d3a-bf4c-dbf421b37903 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:52.345939 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8284450-01af-4cb6-99a0-fbbfc17fa131 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:52.346222 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8284450-01af-4cb6-99a0-fbbfc17fa131 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:52.346497 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8284450-01af-4cb6-99a0-fbbfc17fa131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:52.354796 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 936/1868] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:52.355699 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b71724-717e-4d3a-bf4c-dbf421b37903 service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:52.363146 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-b8284450-01af-4cb6-99a0-fbbfc17fa131 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:52.364340 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b8284450-01af-4cb6-99a0-fbbfc17fa131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:52.364858 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b71724-717e-4d3a-bf4c-dbf421b37903 service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:52.425802 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0c0c1-a32e-4c51-b674-2c74908b5a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:52.428914 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0c0c1-a32e-4c51-b674-2c74908b5a12 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:52.429068 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 933/1869] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:52.429189 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0c0c1-a32e-4c51-b674-2c74908b5a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:52.429189 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0c0c1-a32e-4c51-b674-2c74908b5a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:52.429189 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0c0c1-a32e-4c51-b674-2c74908b5a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:52.429926 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0c0c1-a32e-4c51-b674-2c74908b5a12 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:52.438105 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8284450-01af-4cb6-99a0-fbbfc17fa131 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:52.440103 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b8284450-01af-4cb6-99a0-fbbfc17fa131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:52.441693 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 937/1870] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:52 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:52.445791 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0c0c1-a32e-4c51-b674-2c74908b5a12 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:52.455944 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0c0c1-a32e-4c51-b674-2c74908b5a12 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:52.460558 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe44b252-f4e3-4988-b641-0c249e3ba805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:52.461467 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44b252-f4e3-4988-b641-0c249e3ba805 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:52.461752 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44b252-f4e3-4988-b641-0c249e3ba805 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:52.462019 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe44b252-f4e3-4988-b641-0c249e3ba805 admin admin] PATH_INFO: `/v3/projects/f1ec34fe1e944d268837a66109a4b1b6/users/bf25bf47186e4778a5262c718c8ed467/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:52.464042 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44b252-f4e3-4988-b641-0c249e3ba805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1ec34fe1e944d268837a66109a4b1b6, user_id=bf25bf47186e4778a5262c718c8ed467, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:52.466676 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe44b252-f4e3-4988-b641-0c249e3ba805 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:52.487860 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 938/1871] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:52 2021] PUT /identity/v3/projects/f1ec34fe1e944d268837a66109a4b1b6/users/bf25bf47186e4778a5262c718c8ed467/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:52.489528 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580a9a5-bac7-454b-87da-fda078587665 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:52.489821 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580a9a5-bac7-454b-87da-fda078587665 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:52.490138 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580a9a5-bac7-454b-87da-fda078587665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:52.499446 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8284450-01af-4cb6-99a0-fbbfc17fa131 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:52.518538 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-7580a9a5-bac7-454b-87da-fda078587665 None None] MFA Rules not processed for user `bf25bf47186e4778a5262c718c8ed467`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:52.519751 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7580a9a5-bac7-454b-87da-fda078587665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:52.552359 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b497cb2-cccb-48fc-8d3d-8f4972afe4e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:52.553099 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b497cb2-cccb-48fc-8d3d-8f4972afe4e1 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:52.553434 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b497cb2-cccb-48fc-8d3d-8f4972afe4e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:52.553719 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b497cb2-cccb-48fc-8d3d-8f4972afe4e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:52.602181 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 939/1872] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:52 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:29:52.616933 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b497cb2-cccb-48fc-8d3d-8f4972afe4e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:52.617827 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580a9a5-bac7-454b-87da-fda078587665 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:52.618403 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b497cb2-cccb-48fc-8d3d-8f4972afe4e1 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:52.625431 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7580a9a5-bac7-454b-87da-fda078587665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:52.629055 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 934/1873] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:29:52.694317 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580a9a5-bac7-454b-87da-fda078587665 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:52.700713 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc925007-1217-4ae9-98c0-eaa6dc2e4ade service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:52.701641 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc925007-1217-4ae9-98c0-eaa6dc2e4ade service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:52.702099 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc925007-1217-4ae9-98c0-eaa6dc2e4ade service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:52.702679 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc925007-1217-4ae9-98c0-eaa6dc2e4ade service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:52.714004 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc925007-1217-4ae9-98c0-eaa6dc2e4ade service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:52.715940 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc925007-1217-4ae9-98c0-eaa6dc2e4ade service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:52.737254 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 940/1874] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:52 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:52.775829 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b497cb2-cccb-48fc-8d3d-8f4972afe4e1 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:52.777631 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-9b497cb2-cccb-48fc-8d3d-8f4972afe4e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:52.790277 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc925007-1217-4ae9-98c0-eaa6dc2e4ade service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:52.792358 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b497cb2-cccb-48fc-8d3d-8f4972afe4e1 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:52.794570 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-cc925007-1217-4ae9-98c0-eaa6dc2e4ade service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:52.803838 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc75c9-d4a7-4cf8-b05f-d7ff5eb658c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:52.804986 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc75c9-d4a7-4cf8-b05f-d7ff5eb658c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:52.805359 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc75c9-d4a7-4cf8-b05f-d7ff5eb658c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:52.805819 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc75c9-d4a7-4cf8-b05f-d7ff5eb658c7 admin admin] PATH_INFO: `/v3/projects/b3d9a2044f74489f84f7eaca40003810` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:52.807083 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc75c9-d4a7-4cf8-b05f-d7ff5eb658c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3d9a2044f74489f84f7eaca40003810)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:52.807188 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc925007-1217-4ae9-98c0-eaa6dc2e4ade service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:52.809514 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc75c9-d4a7-4cf8-b05f-d7ff5eb658c7 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:52.811903 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe91d9a-5218-430c-9696-5f754a44be84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:52.812749 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe91d9a-5218-430c-9696-5f754a44be84 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:52.813233 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe91d9a-5218-430c-9696-5f754a44be84 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:52.813716 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe91d9a-5218-430c-9696-5f754a44be84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:52.815970 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-6fe91d9a-5218-430c-9696-5f754a44be84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:52.864297 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-35cc75c9-d4a7-4cf8-b05f-d7ff5eb658c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3d9a2044f74489f84f7eaca40003810', 'request_id': 'req-35cc75c9-d4a7-4cf8-b05f-d7ff5eb658c7'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:52.871094 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-35cc75c9-d4a7-4cf8-b05f-d7ff5eb658c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3d9a2044f74489f84f7eaca40003810', 'request_id': 'req-35cc75c9-d4a7-4cf8-b05f-d7ff5eb658c7'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:52.879930 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-35cc75c9-d4a7-4cf8-b05f-d7ff5eb658c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3d9a2044f74489f84f7eaca40003810', 'request_id': 'req-35cc75c9-d4a7-4cf8-b05f-d7ff5eb658c7'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:52.893250 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-35cc75c9-d4a7-4cf8-b05f-d7ff5eb658c7 admin admin] The token cache is being invalidate because project b3d9a2044f74489f84f7eaca40003810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:52.893635 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-35cc75c9-d4a7-4cf8-b05f-d7ff5eb658c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:52.894293 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-35cc75c9-d4a7-4cf8-b05f-d7ff5eb658c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:52.896186 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 935/1875] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:52 2021] DELETE /identity/v3/projects/b3d9a2044f74489f84f7eaca40003810 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:52.900102 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc75c9-d4a7-4cf8-b05f-d7ff5eb658c7 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:52.901521 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-35cc75c9-d4a7-4cf8-b05f-d7ff5eb658c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:52.909879 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe91d9a-5218-430c-9696-5f754a44be84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:52.911389 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe91d9a-5218-430c-9696-5f754a44be84 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:52.920761 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 941/1876] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:52 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:29:52.967823 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc75c9-d4a7-4cf8-b05f-d7ff5eb658c7 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:52.973216 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c91eeb-9902-4358-868c-36ba60b906aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:52.974131 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c91eeb-9902-4358-868c-36ba60b906aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:52.974416 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c91eeb-9902-4358-868c-36ba60b906aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:52.975350 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c91eeb-9902-4358-868c-36ba60b906aa admin admin] PATH_INFO: `/v3/users/d4892293dad54b329c0b350cfdea5425` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:52.976288 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c91eeb-9902-4358-868c-36ba60b906aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4892293dad54b329c0b350cfdea5425)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:52.978273 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c91eeb-9902-4358-868c-36ba60b906aa admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:53.031237 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a1c91eeb-9902-4358-868c-36ba60b906aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4892293dad54b329c0b350cfdea5425'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:53.046604 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a1c91eeb-9902-4358-868c-36ba60b906aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4892293dad54b329c0b350cfdea5425'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:53.047596 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a1c91eeb-9902-4358-868c-36ba60b906aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4892293dad54b329c0b350cfdea5425'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:53.056279 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a1c91eeb-9902-4358-868c-36ba60b906aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4892293dad54b329c0b350cfdea5425'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:53.064785 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a1c91eeb-9902-4358-868c-36ba60b906aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4892293dad54b329c0b350cfdea5425'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:53.072084 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 936/1877] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:52 2021] DELETE /identity/v3/users/d4892293dad54b329c0b350cfdea5425 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:53.083975 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe91d9a-5218-430c-9696-5f754a44be84 service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:53.085544 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-6fe91d9a-5218-430c-9696-5f754a44be84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:53.101091 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe91d9a-5218-430c-9696-5f754a44be84 service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:53.170246 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89578da7-6715-4f44-a590-7a1e993030ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:53.171729 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89578da7-6715-4f44-a590-7a1e993030ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:53.172217 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89578da7-6715-4f44-a590-7a1e993030ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:53.172409 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89578da7-6715-4f44-a590-7a1e993030ac admin admin] PATH_INFO: `/v3/projects/2455b67ef35444518aef74d3ad53fd4f` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:53.186067 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89578da7-6715-4f44-a590-7a1e993030ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=2455b67ef35444518aef74d3ad53fd4f)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:53.188746 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89578da7-6715-4f44-a590-7a1e993030ac admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:53.278629 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-89578da7-6715-4f44-a590-7a1e993030ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2455b67ef35444518aef74d3ad53fd4f', 'request_id': 'req-89578da7-6715-4f44-a590-7a1e993030ac'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:53.293691 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-89578da7-6715-4f44-a590-7a1e993030ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2455b67ef35444518aef74d3ad53fd4f', 'request_id': 'req-89578da7-6715-4f44-a590-7a1e993030ac'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:53.300964 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-89578da7-6715-4f44-a590-7a1e993030ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2455b67ef35444518aef74d3ad53fd4f', 'request_id': 'req-89578da7-6715-4f44-a590-7a1e993030ac'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:53.312527 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-89578da7-6715-4f44-a590-7a1e993030ac admin admin] The token cache is being invalidate because project 2455b67ef35444518aef74d3ad53fd4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:53.312637 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-89578da7-6715-4f44-a590-7a1e993030ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:53.313491 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-89578da7-6715-4f44-a590-7a1e993030ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:53.315257 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 942/1878] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:53 2021] DELETE /identity/v3/projects/2455b67ef35444518aef74d3ad53fd4f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:53.325640 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db4795-5eef-4bba-b4ea-1f26c8ca3afa None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:53.326445 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db4795-5eef-4bba-b4ea-1f26c8ca3afa None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:53.326732 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db4795-5eef-4bba-b4ea-1f26c8ca3afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:53.347714 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-f6db4795-5eef-4bba-b4ea-1f26c8ca3afa None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:53.348959 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f6db4795-5eef-4bba-b4ea-1f26c8ca3afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:53.407857 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 937/1879] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:53.416788 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4bcb7-f53b-49e6-8f8b-65d97fc6a4cd None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:53.417180 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4bcb7-f53b-49e6-8f8b-65d97fc6a4cd None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:53.417473 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4bcb7-f53b-49e6-8f8b-65d97fc6a4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:53.435490 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-10a4bcb7-f53b-49e6-8f8b-65d97fc6a4cd None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:53.437256 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-10a4bcb7-f53b-49e6-8f8b-65d97fc6a4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:53.446088 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 943/1880] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:53.450331 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db4795-5eef-4bba-b4ea-1f26c8ca3afa None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:53.457300 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4bcb7-f53b-49e6-8f8b-65d97fc6a4cd None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:53.459050 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-10a4bcb7-f53b-49e6-8f8b-65d97fc6a4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:53.461654 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db4795-5eef-4bba-b4ea-1f26c8ca3afa None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:53.466394 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ea3fa-3b95-4a3f-96c2-abf28fe02c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:53.471748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ea3fa-3b95-4a3f-96c2-abf28fe02c50 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:53.471748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ea3fa-3b95-4a3f-96c2-abf28fe02c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:53.471748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3ea3fa-3b95-4a3f-96c2-abf28fe02c50 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:53.471748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ea3fa-3b95-4a3f-96c2-abf28fe02c50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:53.471748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ea3fa-3b95-4a3f-96c2-abf28fe02c50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:53.471748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3ea3fa-3b95-4a3f-96c2-abf28fe02c50 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:53.478332 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4bcb7-f53b-49e6-8f8b-65d97fc6a4cd None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:53.485518 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce571b-06f3-4665-994e-492efe57b338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:53.488848 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 938/1881] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:53.488993 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce571b-06f3-4665-994e-492efe57b338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:53.488993 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce571b-06f3-4665-994e-492efe57b338 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:53.488993 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce571b-06f3-4665-994e-492efe57b338 admin admin] PATH_INFO: `/v3/projects/65790bd172834f57b5034e76c017e835` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:53.488993 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce571b-06f3-4665-994e-492efe57b338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65790bd172834f57b5034e76c017e835)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:53.489857 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ea3fa-3b95-4a3f-96c2-abf28fe02c50 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:53.490375 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce571b-06f3-4665-994e-492efe57b338 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:53.499954 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3ea3fa-3b95-4a3f-96c2-abf28fe02c50 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:53.504757 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54556fd-0f8e-4b90-a42c-9fff2f516e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:53.505436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54556fd-0f8e-4b90-a42c-9fff2f516e4f admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:53.505721 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54556fd-0f8e-4b90-a42c-9fff2f516e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:53.505997 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54556fd-0f8e-4b90-a42c-9fff2f516e4f admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:53.506680 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54556fd-0f8e-4b90-a42c-9fff2f516e4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:53.508624 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54556fd-0f8e-4b90-a42c-9fff2f516e4f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:53.533915 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 939/1882] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:53 2021] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:29:53.536458 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5cce571b-06f3-4665-994e-492efe57b338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65790bd172834f57b5034e76c017e835', 'request_id': 'req-5cce571b-06f3-4665-994e-492efe57b338'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:53.537902 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54556fd-0f8e-4b90-a42c-9fff2f516e4f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:53.544540 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5cce571b-06f3-4665-994e-492efe57b338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65790bd172834f57b5034e76c017e835', 'request_id': 'req-5cce571b-06f3-4665-994e-492efe57b338'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:53.549964 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5cce571b-06f3-4665-994e-492efe57b338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65790bd172834f57b5034e76c017e835', 'request_id': 'req-5cce571b-06f3-4665-994e-492efe57b338'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:53.560553 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5cce571b-06f3-4665-994e-492efe57b338 admin admin] The token cache is being invalidate because project 65790bd172834f57b5034e76c017e835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:53.560841 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5cce571b-06f3-4665-994e-492efe57b338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:53.562040 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5cce571b-06f3-4665-994e-492efe57b338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:53.563583 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 944/1883] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:53 2021] DELETE /identity/v3/projects/65790bd172834f57b5034e76c017e835 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:53.568926 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ed94d-805e-491b-8652-81698f3c4bb3 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:53.569214 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ed94d-805e-491b-8652-81698f3c4bb3 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:53.569495 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ed94d-805e-491b-8652-81698f3c4bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:53.587288 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-7f3ed94d-805e-491b-8652-81698f3c4bb3 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:53.588485 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7f3ed94d-805e-491b-8652-81698f3c4bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:53.596608 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 945/1884] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:29:53.597706 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54556fd-0f8e-4b90-a42c-9fff2f516e4f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:53.602349 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057353e5-c70c-471d-8fb6-3c6d960ecb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:53.603011 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057353e5-c70c-471d-8fb6-3c6d960ecb8a admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:53.603294 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057353e5-c70c-471d-8fb6-3c6d960ecb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:53.603564 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057353e5-c70c-471d-8fb6-3c6d960ecb8a admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:53.604239 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057353e5-c70c-471d-8fb6-3c6d960ecb8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:53.604330 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed98a0-6ed6-4f32-a97f-4d80a0aba2f4 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:53.604584 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed98a0-6ed6-4f32-a97f-4d80a0aba2f4 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:53.604907 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed98a0-6ed6-4f32-a97f-4d80a0aba2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:53.606180 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057353e5-c70c-471d-8fb6-3c6d960ecb8a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:53.625563 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-2aed98a0-6ed6-4f32-a97f-4d80a0aba2f4 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:53.626799 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-2aed98a0-6ed6-4f32-a97f-4d80a0aba2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:53.627660 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 940/1885] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:53 2021] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:53.631730 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057353e5-c70c-471d-8fb6-3c6d960ecb8a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:53.633349 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-057353e5-c70c-471d-8fb6-3c6d960ecb8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:53.636074 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 946/1886] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:29:53.644829 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed98a0-6ed6-4f32-a97f-4d80a0aba2f4 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:53.645882 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057353e5-c70c-471d-8fb6-3c6d960ecb8a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:53.650541 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d13b9-ee0d-4a5a-8e8f-6d1e54e522b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:53.651197 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d13b9-ee0d-4a5a-8e8f-6d1e54e522b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:53.651483 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d13b9-ee0d-4a5a-8e8f-6d1e54e522b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:53.651757 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d13b9-ee0d-4a5a-8e8f-6d1e54e522b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:53.652473 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d13b9-ee0d-4a5a-8e8f-6d1e54e522b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:53.654067 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed98a0-6ed6-4f32-a97f-4d80a0aba2f4 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:53.654176 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d13b9-ee0d-4a5a-8e8f-6d1e54e522b5 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:53.658844 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b5132-3c66-4ea5-84e5-5acd6f8c7677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:53.659495 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b5132-3c66-4ea5-84e5-5acd6f8c7677 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:53.659780 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b5132-3c66-4ea5-84e5-5acd6f8c7677 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:53.660053 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b5132-3c66-4ea5-84e5-5acd6f8c7677 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:53.660800 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b5132-3c66-4ea5-84e5-5acd6f8c7677 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:53.661144 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b5132-3c66-4ea5-84e5-5acd6f8c7677 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:53.662747 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b5132-3c66-4ea5-84e5-5acd6f8c7677 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:53.666731 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 941/1887] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:53 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:29:53.667668 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d13b9-ee0d-4a5a-8e8f-6d1e54e522b5 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:53.674803 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 947/1888] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:29:53.677484 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d13b9-ee0d-4a5a-8e8f-6d1e54e522b5 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:53.678710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b5132-3c66-4ea5-84e5-5acd6f8c7677 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:53.682117 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b8f2d-c34c-4a64-932d-ad5c7d4b0a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:53.682754 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b8f2d-c34c-4a64-932d-ad5c7d4b0a99 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:53.683034 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b8f2d-c34c-4a64-932d-ad5c7d4b0a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:53.683300 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b8f2d-c34c-4a64-932d-ad5c7d4b0a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:53.684013 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b8f2d-c34c-4a64-932d-ad5c7d4b0a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:53.685616 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b8f2d-c34c-4a64-932d-ad5c7d4b0a99 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:53.688913 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b5132-3c66-4ea5-84e5-5acd6f8c7677 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:53.693660 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d5137-535c-44ba-98c5-889acf7eb537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:53.694286 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d5137-535c-44ba-98c5-889acf7eb537 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:53.694576 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d5137-535c-44ba-98c5-889acf7eb537 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:53.694854 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d5137-535c-44ba-98c5-889acf7eb537 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:53.695533 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d5137-535c-44ba-98c5-889acf7eb537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:53.695648 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 942/1889] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:53 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:29:53.697559 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d5137-535c-44ba-98c5-889acf7eb537 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:53.699540 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b8f2d-c34c-4a64-932d-ad5c7d4b0a99 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:53.709393 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b8f2d-c34c-4a64-932d-ad5c7d4b0a99 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:53.714105 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f326c9-0465-46b9-a1d1-f13aac1476da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:53.714953 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f326c9-0465-46b9-a1d1-f13aac1476da admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:53.715229 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f326c9-0465-46b9-a1d1-f13aac1476da admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:53.715503 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f326c9-0465-46b9-a1d1-f13aac1476da admin admin] PATH_INFO: `/v3/projects/246ee080ec4d4573903bdd704c84ed65/users/fa48baa8567f4af9a06c503ae4af8beb/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:53.724690 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 948/1890] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:53 2021] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:29:53.728771 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d5137-535c-44ba-98c5-889acf7eb537 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:53.730475 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f326c9-0465-46b9-a1d1-f13aac1476da admin admin] RBAC: Authorizing `identity:create_grant(project_id=246ee080ec4d4573903bdd704c84ed65, user_id=fa48baa8567f4af9a06c503ae4af8beb, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:53.733371 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f326c9-0465-46b9-a1d1-f13aac1476da admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:53.747918 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 943/1891] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:53 2021] PUT /identity/v3/projects/246ee080ec4d4573903bdd704c84ed65/users/fa48baa8567f4af9a06c503ae4af8beb/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:53.758203 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d21ee6-51e4-42cc-858f-5a276bbd0d13 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:53.758706 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d21ee6-51e4-42cc-858f-5a276bbd0d13 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:53.759078 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d21ee6-51e4-42cc-858f-5a276bbd0d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:53.788721 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-90d21ee6-51e4-42cc-858f-5a276bbd0d13 None None] MFA Rules not processed for user `fa48baa8567f4af9a06c503ae4af8beb`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:53.790139 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-90d21ee6-51e4-42cc-858f-5a276bbd0d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:53.795316 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d5137-535c-44ba-98c5-889acf7eb537 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:53.858255 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 944/1892] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:53 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:53.861516 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54782a13-068a-450f-aaea-21cb3a9da2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:53.862366 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54782a13-068a-450f-aaea-21cb3a9da2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:53.862812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54782a13-068a-450f-aaea-21cb3a9da2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:53.863225 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54782a13-068a-450f-aaea-21cb3a9da2c9 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:53.864166 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54782a13-068a-450f-aaea-21cb3a9da2c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:53.866237 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54782a13-068a-450f-aaea-21cb3a9da2c9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:53.868437 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d21ee6-51e4-42cc-858f-5a276bbd0d13 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:53.869806 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-90d21ee6-51e4-42cc-858f-5a276bbd0d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:53.887815 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 949/1893] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:53 2021] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:53.892231 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54782a13-068a-450f-aaea-21cb3a9da2c9 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:53.902524 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54782a13-068a-450f-aaea-21cb3a9da2c9 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:53.908419 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4fa7d-a125-40b6-b8c5-5fcbeb15cf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:53.909705 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4fa7d-a125-40b6-b8c5-5fcbeb15cf75 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:53.909705 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4fa7d-a125-40b6-b8c5-5fcbeb15cf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:53.910461 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4fa7d-a125-40b6-b8c5-5fcbeb15cf75 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:53.910982 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4fa7d-a125-40b6-b8c5-5fcbeb15cf75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:53.912802 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4fa7d-a125-40b6-b8c5-5fcbeb15cf75 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:53.925930 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 950/1894] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:53 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:29:53.929780 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4fa7d-a125-40b6-b8c5-5fcbeb15cf75 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:53.942514 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d21ee6-51e4-42cc-858f-5a276bbd0d13 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:53.945122 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4fa7d-a125-40b6-b8c5-5fcbeb15cf75 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:53.946519 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73a502-e337-4dad-a6b7-0f82344a3e34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:53.947376 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73a502-e337-4dad-a6b7-0f82344a3e34 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:53.947773 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73a502-e337-4dad-a6b7-0f82344a3e34 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:53.948140 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73a502-e337-4dad-a6b7-0f82344a3e34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:53.951028 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad55b3-cac6-45dd-a8ea-c8ecd3617eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:53.952430 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad55b3-cac6-45dd-a8ea-c8ecd3617eeb admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:53.952870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad55b3-cac6-45dd-a8ea-c8ecd3617eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:53.953198 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad55b3-cac6-45dd-a8ea-c8ecd3617eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:53.953914 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad55b3-cac6-45dd-a8ea-c8ecd3617eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:53.955507 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad55b3-cac6-45dd-a8ea-c8ecd3617eeb admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:53.966407 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 951/1895] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:53 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:29:53.969287 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73a502-e337-4dad-a6b7-0f82344a3e34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:53.971464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73a502-e337-4dad-a6b7-0f82344a3e34 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:53.976585 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad55b3-cac6-45dd-a8ea-c8ecd3617eeb admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:53.981626 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 945/1896] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:53 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:29:53.989716 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad55b3-cac6-45dd-a8ea-c8ecd3617eeb admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:53.995560 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d4d0f-f76a-491e-852d-4910301d6cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:53.996440 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d4d0f-f76a-491e-852d-4910301d6cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:53.996717 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d4d0f-f76a-491e-852d-4910301d6cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:53.997043 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d4d0f-f76a-491e-852d-4910301d6cfa admin admin] PATH_INFO: `/v3/projects/f2bf993cb42a4863bd0a65593a288ba1/users/4de3e5a100e0420687ce36c7a6115f82/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:54.011765 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d4d0f-f76a-491e-852d-4910301d6cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2bf993cb42a4863bd0a65593a288ba1, user_id=4de3e5a100e0420687ce36c7a6115f82, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:54.015065 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d4d0f-f76a-491e-852d-4910301d6cfa admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:54.031003 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 952/1897] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:53 2021] PUT /identity/v3/projects/f2bf993cb42a4863bd0a65593a288ba1/users/4de3e5a100e0420687ce36c7a6115f82/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:29:54.042302 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afd279-52f4-4144-8b9a-e416795edf85 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:54.042584 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afd279-52f4-4144-8b9a-e416795edf85 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:54.042855 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afd279-52f4-4144-8b9a-e416795edf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:54.073715 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-22afd279-52f4-4144-8b9a-e416795edf85 None None] MFA Rules not processed for user `4de3e5a100e0420687ce36c7a6115f82`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:54.073715 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-22afd279-52f4-4144-8b9a-e416795edf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:54.136206 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 946/1898] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:54 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:54.147031 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d4d0f-f76a-491e-852d-4910301d6cfa admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:54.149010 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-5e8d4d0f-f76a-491e-852d-4910301d6cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:54.210583 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d4d0f-f76a-491e-852d-4910301d6cfa admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:54.215425 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79758c55-8d26-4b4c-b113-5919d4ec6278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:54.216152 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79758c55-8d26-4b4c-b113-5919d4ec6278 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:54.216476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79758c55-8d26-4b4c-b113-5919d4ec6278 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:54.216910 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79758c55-8d26-4b4c-b113-5919d4ec6278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:54.230128 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79758c55-8d26-4b4c-b113-5919d4ec6278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:54.230128 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79758c55-8d26-4b4c-b113-5919d4ec6278 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:54.239155 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 953/1899] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:54 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:54.260759 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afd279-52f4-4144-8b9a-e416795edf85 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:54.330374 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afd279-52f4-4144-8b9a-e416795edf85 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:54.335719 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466df05-4c7b-46fe-902a-b14de3ddeea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:54.336595 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466df05-4c7b-46fe-902a-b14de3ddeea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:54.336900 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466df05-4c7b-46fe-902a-b14de3ddeea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:54.337218 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466df05-4c7b-46fe-902a-b14de3ddeea7 admin admin] PATH_INFO: `/v3/users/4de3e5a100e0420687ce36c7a6115f82` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:54.338465 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466df05-4c7b-46fe-902a-b14de3ddeea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4de3e5a100e0420687ce36c7a6115f82)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:54.340375 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466df05-4c7b-46fe-902a-b14de3ddeea7 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:54.397693 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-c466df05-4c7b-46fe-902a-b14de3ddeea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4de3e5a100e0420687ce36c7a6115f82'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:54.413428 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-c466df05-4c7b-46fe-902a-b14de3ddeea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4de3e5a100e0420687ce36c7a6115f82'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:54.414483 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-c466df05-4c7b-46fe-902a-b14de3ddeea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4de3e5a100e0420687ce36c7a6115f82'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:54.422653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-c466df05-4c7b-46fe-902a-b14de3ddeea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4de3e5a100e0420687ce36c7a6115f82'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:54.430784 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-c466df05-4c7b-46fe-902a-b14de3ddeea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4de3e5a100e0420687ce36c7a6115f82'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:54.437124 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 947/1900] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:54 2021] DELETE /identity/v3/users/4de3e5a100e0420687ce36c7a6115f82 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:54.441655 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d25c0-e5e0-455e-8cb5-0677002d25a3 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:54.442044 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d25c0-e5e0-455e-8cb5-0677002d25a3 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:54.442476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d25c0-e5e0-455e-8cb5-0677002d25a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:54.462842 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-7a1d25c0-e5e0-455e-8cb5-0677002d25a3 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:54.464193 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7a1d25c0-e5e0-455e-8cb5-0677002d25a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:54.525617 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 954/1901] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:29:54.535773 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466df05-4c7b-46fe-902a-b14de3ddeea7 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:54.537188 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-c466df05-4c7b-46fe-902a-b14de3ddeea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:54.593572 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466df05-4c7b-46fe-902a-b14de3ddeea7 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:54.597483 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7721e-73d2-4f14-96c4-43a31502a7d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:54.598123 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7721e-73d2-4f14-96c4-43a31502a7d6 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:54.598402 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7721e-73d2-4f14-96c4-43a31502a7d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:54.598687 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7721e-73d2-4f14-96c4-43a31502a7d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:54.608589 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7721e-73d2-4f14-96c4-43a31502a7d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:54.610060 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7721e-73d2-4f14-96c4-43a31502a7d6 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:54.619595 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 948/1902] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:29:54.903183 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d25c0-e5e0-455e-8cb5-0677002d25a3 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:54.904614 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7a1d25c0-e5e0-455e-8cb5-0677002d25a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:54.916165 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d25c0-e5e0-455e-8cb5-0677002d25a3 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:54.920860 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da06178-5df7-41a9-ba36-133242895eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:54.921748 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da06178-5df7-41a9-ba36-133242895eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:54.922030 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da06178-5df7-41a9-ba36-133242895eed admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:54.922307 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da06178-5df7-41a9-ba36-133242895eed admin admin] PATH_INFO: `/v3/projects/f2bf993cb42a4863bd0a65593a288ba1` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:54.923524 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da06178-5df7-41a9-ba36-133242895eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2bf993cb42a4863bd0a65593a288ba1)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:54.925449 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da06178-5df7-41a9-ba36-133242895eed admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:54.969566 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5da06178-5df7-41a9-ba36-133242895eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2bf993cb42a4863bd0a65593a288ba1', 'request_id': 'req-5da06178-5df7-41a9-ba36-133242895eed'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:54.976392 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5da06178-5df7-41a9-ba36-133242895eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2bf993cb42a4863bd0a65593a288ba1', 'request_id': 'req-5da06178-5df7-41a9-ba36-133242895eed'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:54.982623 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5da06178-5df7-41a9-ba36-133242895eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2bf993cb42a4863bd0a65593a288ba1', 'request_id': 'req-5da06178-5df7-41a9-ba36-133242895eed'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:54.993375 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5da06178-5df7-41a9-ba36-133242895eed admin admin] The token cache is being invalidate because project f2bf993cb42a4863bd0a65593a288ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:54.993664 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5da06178-5df7-41a9-ba36-133242895eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:54.994322 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5da06178-5df7-41a9-ba36-133242895eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:54.995827 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 955/1903] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:54 2021] DELETE /identity/v3/projects/f2bf993cb42a4863bd0a65593a288ba1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:55.001988 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a6d6d-d517-42e0-a57c-44e172899c5c None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:55.002279 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a6d6d-d517-42e0-a57c-44e172899c5c None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:55.002559 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a6d6d-d517-42e0-a57c-44e172899c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:55.019352 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-787a6d6d-d517-42e0-a57c-44e172899c5c None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:55.020526 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-787a6d6d-d517-42e0-a57c-44e172899c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:55.084938 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 949/1904] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:55.088202 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c583e7-c3b1-4739-8cfc-73622099283d None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:55.088528 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c583e7-c3b1-4739-8cfc-73622099283d None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:55.088751 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c583e7-c3b1-4739-8cfc-73622099283d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:55.107395 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-27c583e7-c3b1-4739-8cfc-73622099283d None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:55.108637 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-27c583e7-c3b1-4739-8cfc-73622099283d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:55.116818 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 956/1905] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:55.125170 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a6d6d-d517-42e0-a57c-44e172899c5c None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:55.138808 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a6d6d-d517-42e0-a57c-44e172899c5c None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:55.144075 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead86807-bc5f-4596-933a-0f8d33093345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:55.144736 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead86807-bc5f-4596-933a-0f8d33093345 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:55.145059 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead86807-bc5f-4596-933a-0f8d33093345 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:55.145333 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead86807-bc5f-4596-933a-0f8d33093345 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:55.146058 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead86807-bc5f-4596-933a-0f8d33093345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:55.146386 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead86807-bc5f-4596-933a-0f8d33093345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:55.147993 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead86807-bc5f-4596-933a-0f8d33093345 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:55.159442 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 950/1906] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:55.163723 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c583e7-c3b1-4739-8cfc-73622099283d None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:55.172775 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c583e7-c3b1-4739-8cfc-73622099283d None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:55.179588 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c09ca-1624-47b7-aa0b-ee414a927ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:55.180254 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c09ca-1624-47b7-aa0b-ee414a927ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:55.180539 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c09ca-1624-47b7-aa0b-ee414a927ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:55.180847 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c09ca-1624-47b7-aa0b-ee414a927ed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:55.181538 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c09ca-1624-47b7-aa0b-ee414a927ed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:55.183521 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c09ca-1624-47b7-aa0b-ee414a927ed8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:55.213718 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 957/1907] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:55 2021] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:55.214821 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead86807-bc5f-4596-933a-0f8d33093345 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:55.225141 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead86807-bc5f-4596-933a-0f8d33093345 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:55.282500 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f5974-03b1-449e-ae88-80fa48c278e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:55.283164 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f5974-03b1-449e-ae88-80fa48c278e3 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:55.283443 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f5974-03b1-449e-ae88-80fa48c278e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:55.283716 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f5974-03b1-449e-ae88-80fa48c278e3 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:55.284387 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f5974-03b1-449e-ae88-80fa48c278e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:55.286386 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f5974-03b1-449e-ae88-80fa48c278e3 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:55.310427 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 951/1908] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:55 2021] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:55.312282 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c09ca-1624-47b7-aa0b-ee414a927ed8 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:55.322314 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c09ca-1624-47b7-aa0b-ee414a927ed8 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:55.326983 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb9094-a7c9-4eef-8d91-01aa067e7b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:55.327642 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb9094-a7c9-4eef-8d91-01aa067e7b4d admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:55.327925 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb9094-a7c9-4eef-8d91-01aa067e7b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:55.328213 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb9094-a7c9-4eef-8d91-01aa067e7b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:55.329029 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb9094-a7c9-4eef-8d91-01aa067e7b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:55.330681 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb9094-a7c9-4eef-8d91-01aa067e7b4d admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:55.340930 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 958/1909] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:55.344952 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f5974-03b1-449e-ae88-80fa48c278e3 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:55.355008 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f5974-03b1-449e-ae88-80fa48c278e3 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:55.360251 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69c4aa-da69-46e4-b695-2fb7fe38d596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:55.360938 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69c4aa-da69-46e4-b695-2fb7fe38d596 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:55.361227 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69c4aa-da69-46e4-b695-2fb7fe38d596 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:55.361504 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69c4aa-da69-46e4-b695-2fb7fe38d596 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:55.362227 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69c4aa-da69-46e4-b695-2fb7fe38d596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:55.363812 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69c4aa-da69-46e4-b695-2fb7fe38d596 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:55.373397 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 952/1910] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:55 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:55.377847 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb9094-a7c9-4eef-8d91-01aa067e7b4d admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:55.387444 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb9094-a7c9-4eef-8d91-01aa067e7b4d admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:55.392199 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc6e67-7551-4b50-a14b-615ed3dc4b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:55.393108 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc6e67-7551-4b50-a14b-615ed3dc4b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:55.393398 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc6e67-7551-4b50-a14b-615ed3dc4b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:55.393672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc6e67-7551-4b50-a14b-615ed3dc4b2f admin admin] PATH_INFO: `/v3/projects/a5a6ccd591fb4108ac68fe28f530354a/users/1197cbb46ef741b1a2abc34f146eaea4/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:55.408393 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc6e67-7551-4b50-a14b-615ed3dc4b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a6ccd591fb4108ac68fe28f530354a, user_id=1197cbb46ef741b1a2abc34f146eaea4, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:55.411064 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc6e67-7551-4b50-a14b-615ed3dc4b2f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:55.423719 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 959/1911] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:55 2021] PUT /identity/v3/projects/a5a6ccd591fb4108ac68fe28f530354a/users/1197cbb46ef741b1a2abc34f146eaea4/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:29:55.433842 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78083861-c182-4b9d-b3f4-424d19444fb8 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:55.434137 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78083861-c182-4b9d-b3f4-424d19444fb8 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:55.434419 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78083861-c182-4b9d-b3f4-424d19444fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:55.460433 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-78083861-c182-4b9d-b3f4-424d19444fb8 None None] MFA Rules not processed for user `1197cbb46ef741b1a2abc34f146eaea4`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:55.461762 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-78083861-c182-4b9d-b3f4-424d19444fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:55.524527 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 953/1912] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:55 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:55.534283 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc6e67-7551-4b50-a14b-615ed3dc4b2f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:55.536014 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-30dc6e67-7551-4b50-a14b-615ed3dc4b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:55.590925 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc6e67-7551-4b50-a14b-615ed3dc4b2f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:55.594619 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b671a7b-1071-4f3b-967b-c515d9437fe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:55.595549 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b671a7b-1071-4f3b-967b-c515d9437fe7 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:55.595793 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b671a7b-1071-4f3b-967b-c515d9437fe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:55.596071 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b671a7b-1071-4f3b-967b-c515d9437fe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:55.607627 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b671a7b-1071-4f3b-967b-c515d9437fe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:55.609590 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b671a7b-1071-4f3b-967b-c515d9437fe7 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:55.618555 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 960/1913] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:55 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:56.269358 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78083861-c182-4b9d-b3f4-424d19444fb8 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:56.270884 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-78083861-c182-4b9d-b3f4-424d19444fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:56.360510 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78083861-c182-4b9d-b3f4-424d19444fb8 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:56.366628 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe0805-13bd-4b54-a630-df73c1f6e556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:56.367716 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe0805-13bd-4b54-a630-df73c1f6e556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:56.368147 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe0805-13bd-4b54-a630-df73c1f6e556 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:56.368586 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe0805-13bd-4b54-a630-df73c1f6e556 admin admin] PATH_INFO: `/v3/users/64f312e2adc643cf9d6a98f2c4112f4c` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:56.370207 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe0805-13bd-4b54-a630-df73c1f6e556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64f312e2adc643cf9d6a98f2c4112f4c)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:56.372630 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe0805-13bd-4b54-a630-df73c1f6e556 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:56.429348 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-eebe0805-13bd-4b54-a630-df73c1f6e556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64f312e2adc643cf9d6a98f2c4112f4c'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:56.443232 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-eebe0805-13bd-4b54-a630-df73c1f6e556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64f312e2adc643cf9d6a98f2c4112f4c'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:56.444397 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-eebe0805-13bd-4b54-a630-df73c1f6e556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64f312e2adc643cf9d6a98f2c4112f4c'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:56.456123 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-eebe0805-13bd-4b54-a630-df73c1f6e556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64f312e2adc643cf9d6a98f2c4112f4c'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:56.463652 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-eebe0805-13bd-4b54-a630-df73c1f6e556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64f312e2adc643cf9d6a98f2c4112f4c'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:56.477367 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 954/1914] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:56 2021] DELETE /identity/v3/users/64f312e2adc643cf9d6a98f2c4112f4c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:56.482766 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c09d4-0034-4e98-ac37-afbdc6182cab None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:56.484430 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c09d4-0034-4e98-ac37-afbdc6182cab None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:56.485182 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c09d4-0034-4e98-ac37-afbdc6182cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:56.509021 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-571c09d4-0034-4e98-ac37-afbdc6182cab None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:56.510261 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-571c09d4-0034-4e98-ac37-afbdc6182cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:56.582358 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 961/1915] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:29:56.594742 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe0805-13bd-4b54-a630-df73c1f6e556 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:56.598743 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-eebe0805-13bd-4b54-a630-df73c1f6e556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:56.660050 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe0805-13bd-4b54-a630-df73c1f6e556 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:56.664061 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a15b6d-2041-4452-ae70-1e07435da364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:56.664722 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a15b6d-2041-4452-ae70-1e07435da364 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:56.665170 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a15b6d-2041-4452-ae70-1e07435da364 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:56.665349 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a15b6d-2041-4452-ae70-1e07435da364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:56.675900 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a15b6d-2041-4452-ae70-1e07435da364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:56.677333 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a15b6d-2041-4452-ae70-1e07435da364 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:56.702069 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 955/1916] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:57.073997 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c09d4-0034-4e98-ac37-afbdc6182cab None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:57.075626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-571c09d4-0034-4e98-ac37-afbdc6182cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:57.088716 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c09d4-0034-4e98-ac37-afbdc6182cab None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:57.093972 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055da7d-d8cf-430a-a98a-8250d5057cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:57.101634 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055da7d-d8cf-430a-a98a-8250d5057cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:57.101922 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055da7d-d8cf-430a-a98a-8250d5057cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:57.102331 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055da7d-d8cf-430a-a98a-8250d5057cb2 admin admin] PATH_INFO: `/v3/projects/50306e36b5ca40a5b1f7908ccc805e4f` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:57.103752 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055da7d-d8cf-430a-a98a-8250d5057cb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50306e36b5ca40a5b1f7908ccc805e4f)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:57.105695 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055da7d-d8cf-430a-a98a-8250d5057cb2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:57.155840 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c055da7d-d8cf-430a-a98a-8250d5057cb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50306e36b5ca40a5b1f7908ccc805e4f', 'request_id': 'req-c055da7d-d8cf-430a-a98a-8250d5057cb2'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:57.163539 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c055da7d-d8cf-430a-a98a-8250d5057cb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50306e36b5ca40a5b1f7908ccc805e4f', 'request_id': 'req-c055da7d-d8cf-430a-a98a-8250d5057cb2'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:57.169007 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c055da7d-d8cf-430a-a98a-8250d5057cb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50306e36b5ca40a5b1f7908ccc805e4f', 'request_id': 'req-c055da7d-d8cf-430a-a98a-8250d5057cb2'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:57.179687 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c055da7d-d8cf-430a-a98a-8250d5057cb2 admin admin] The token cache is being invalidate because project 50306e36b5ca40a5b1f7908ccc805e4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:57.179978 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c055da7d-d8cf-430a-a98a-8250d5057cb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:57.180620 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c055da7d-d8cf-430a-a98a-8250d5057cb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:57.182375 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 962/1917] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:57 2021] DELETE /identity/v3/projects/50306e36b5ca40a5b1f7908ccc805e4f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:57.186847 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a15b6d-2041-4452-ae70-1e07435da364 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:57.196318 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a15b6d-2041-4452-ae70-1e07435da364 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:57.251597 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b82989-9777-44da-bd16-d9dcda33a5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:57.252474 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b82989-9777-44da-bd16-d9dcda33a5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:57.252757 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b82989-9777-44da-bd16-d9dcda33a5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:57.253072 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b82989-9777-44da-bd16-d9dcda33a5d7 admin admin] PATH_INFO: `/v3/users/bf25bf47186e4778a5262c718c8ed467` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:57.254281 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b82989-9777-44da-bd16-d9dcda33a5d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf25bf47186e4778a5262c718c8ed467)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:57.256230 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b82989-9777-44da-bd16-d9dcda33a5d7 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:57.302997 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-04b82989-9777-44da-bd16-d9dcda33a5d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf25bf47186e4778a5262c718c8ed467'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:57.315830 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-04b82989-9777-44da-bd16-d9dcda33a5d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf25bf47186e4778a5262c718c8ed467'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:57.316568 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-04b82989-9777-44da-bd16-d9dcda33a5d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf25bf47186e4778a5262c718c8ed467'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:57.327719 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-04b82989-9777-44da-bd16-d9dcda33a5d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf25bf47186e4778a5262c718c8ed467'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:57.337447 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-04b82989-9777-44da-bd16-d9dcda33a5d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf25bf47186e4778a5262c718c8ed467'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:57.343864 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 956/1918] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:57 2021] DELETE /identity/v3/users/bf25bf47186e4778a5262c718c8ed467 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:29:57.490621 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055da7d-d8cf-430a-a98a-8250d5057cb2 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:57.493443 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c055da7d-d8cf-430a-a98a-8250d5057cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:57.575778 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055da7d-d8cf-430a-a98a-8250d5057cb2 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:57.632920 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971f7cd-8a4f-4411-921f-3ca008cde74f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:57.633581 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971f7cd-8a4f-4411-921f-3ca008cde74f service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:57.633865 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971f7cd-8a4f-4411-921f-3ca008cde74f service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:57.634139 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971f7cd-8a4f-4411-921f-3ca008cde74f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:57.636325 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-6971f7cd-8a4f-4411-921f-3ca008cde74f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:57.705101 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971f7cd-8a4f-4411-921f-3ca008cde74f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:57.707162 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971f7cd-8a4f-4411-921f-3ca008cde74f service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:57.718862 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 963/1919] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:57 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:29:57.900787 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b82989-9777-44da-bd16-d9dcda33a5d7 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:57.902256 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-04b82989-9777-44da-bd16-d9dcda33a5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:58.019467 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b82989-9777-44da-bd16-d9dcda33a5d7 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:58.025531 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0824ade-5018-4a7c-80ff-d2e1dd934c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:58.026719 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0824ade-5018-4a7c-80ff-d2e1dd934c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:58.027179 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0824ade-5018-4a7c-80ff-d2e1dd934c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:58.027618 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0824ade-5018-4a7c-80ff-d2e1dd934c93 admin admin] PATH_INFO: `/v3/projects/f1ec34fe1e944d268837a66109a4b1b6` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:58.029363 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0824ade-5018-4a7c-80ff-d2e1dd934c93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1ec34fe1e944d268837a66109a4b1b6)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:58.033408 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0824ade-5018-4a7c-80ff-d2e1dd934c93 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:58.099121 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e0824ade-5018-4a7c-80ff-d2e1dd934c93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1ec34fe1e944d268837a66109a4b1b6', 'request_id': 'req-e0824ade-5018-4a7c-80ff-d2e1dd934c93'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:58.108825 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e0824ade-5018-4a7c-80ff-d2e1dd934c93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1ec34fe1e944d268837a66109a4b1b6', 'request_id': 'req-e0824ade-5018-4a7c-80ff-d2e1dd934c93'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:58.118509 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e0824ade-5018-4a7c-80ff-d2e1dd934c93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1ec34fe1e944d268837a66109a4b1b6', 'request_id': 'req-e0824ade-5018-4a7c-80ff-d2e1dd934c93'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:58.138045 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e0824ade-5018-4a7c-80ff-d2e1dd934c93 admin admin] The token cache is being invalidate because project f1ec34fe1e944d268837a66109a4b1b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:58.139684 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e0824ade-5018-4a7c-80ff-d2e1dd934c93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:58.142215 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e0824ade-5018-4a7c-80ff-d2e1dd934c93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:58.146485 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 957/1920] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:57 2021] DELETE /identity/v3/projects/f1ec34fe1e944d268837a66109a4b1b6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:58.155707 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c776b4c-348c-4db0-bd8a-6cb89f83b827 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:58.156207 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c776b4c-348c-4db0-bd8a-6cb89f83b827 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:58.156621 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c776b4c-348c-4db0-bd8a-6cb89f83b827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:58.198965 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-0c776b4c-348c-4db0-bd8a-6cb89f83b827 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:58.200352 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-0c776b4c-348c-4db0-bd8a-6cb89f83b827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:58.310116 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 964/1921] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:58.311634 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe14977-6ebc-4df3-a8c4-97541094441b None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:58.312269 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe14977-6ebc-4df3-a8c4-97541094441b None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:58.312728 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe14977-6ebc-4df3-a8c4-97541094441b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:58.341405 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-fbe14977-6ebc-4df3-a8c4-97541094441b None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:58.343459 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-fbe14977-6ebc-4df3-a8c4-97541094441b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:58.363227 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 958/1922] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:29:58.367871 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c776b4c-348c-4db0-bd8a-6cb89f83b827 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:58.385045 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c776b4c-348c-4db0-bd8a-6cb89f83b827 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:58.391502 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea76a36-1332-4bad-82ec-a7ae3eb22e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:58.391502 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea76a36-1332-4bad-82ec-a7ae3eb22e68 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:58.391682 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea76a36-1332-4bad-82ec-a7ae3eb22e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:58.391918 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea76a36-1332-4bad-82ec-a7ae3eb22e68 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:58.392573 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea76a36-1332-4bad-82ec-a7ae3eb22e68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:29:58.392910 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea76a36-1332-4bad-82ec-a7ae3eb22e68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:58.394713 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea76a36-1332-4bad-82ec-a7ae3eb22e68 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:58.410101 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 965/1923] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:29:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:29:58.414130 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe14977-6ebc-4df3-a8c4-97541094441b None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:58.428646 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe14977-6ebc-4df3-a8c4-97541094441b None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:58.437722 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c58007-9dd2-482c-b580-0cc06fca9c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:58.438460 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c58007-9dd2-482c-b580-0cc06fca9c4a admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:58.438760 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c58007-9dd2-482c-b580-0cc06fca9c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:58.439033 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c58007-9dd2-482c-b580-0cc06fca9c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:58.439835 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c58007-9dd2-482c-b580-0cc06fca9c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:58.441953 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c58007-9dd2-482c-b580-0cc06fca9c4a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:58.452572 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea76a36-1332-4bad-82ec-a7ae3eb22e68 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:58.454321 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-6ea76a36-1332-4bad-82ec-a7ae3eb22e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:58.468310 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea76a36-1332-4bad-82ec-a7ae3eb22e68 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:58.473492 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8dafcd-6ebd-400c-95f4-b80c68bee85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:58.474726 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8dafcd-6ebd-400c-95f4-b80c68bee85a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:58.475015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8dafcd-6ebd-400c-95f4-b80c68bee85a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:58.475289 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8dafcd-6ebd-400c-95f4-b80c68bee85a admin admin] PATH_INFO: `/v3/users/dd79cf34364e4759ac71d50527be63a3` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:58.476506 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8dafcd-6ebd-400c-95f4-b80c68bee85a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd79cf34364e4759ac71d50527be63a3)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:58.478427 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8dafcd-6ebd-400c-95f4-b80c68bee85a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:58.488192 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 959/1924] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:58 2021] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:58.489251 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c58007-9dd2-482c-b580-0cc06fca9c4a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:58.539973 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-af8dafcd-6ebd-400c-95f4-b80c68bee85a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd79cf34364e4759ac71d50527be63a3'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:58.541143 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-af8dafcd-6ebd-400c-95f4-b80c68bee85a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd79cf34364e4759ac71d50527be63a3'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:58.552986 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-af8dafcd-6ebd-400c-95f4-b80c68bee85a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd79cf34364e4759ac71d50527be63a3'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:58.554053 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-af8dafcd-6ebd-400c-95f4-b80c68bee85a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd79cf34364e4759ac71d50527be63a3'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:58.564485 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c58007-9dd2-482c-b580-0cc06fca9c4a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:58.568827 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-af8dafcd-6ebd-400c-95f4-b80c68bee85a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd79cf34364e4759ac71d50527be63a3'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:58.571524 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17880bdf-08f6-4495-96ac-6368fef05072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:58.572360 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17880bdf-08f6-4495-96ac-6368fef05072 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:58.572811 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17880bdf-08f6-4495-96ac-6368fef05072 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:58.573128 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17880bdf-08f6-4495-96ac-6368fef05072 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:58.573970 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17880bdf-08f6-4495-96ac-6368fef05072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:58.577935 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17880bdf-08f6-4495-96ac-6368fef05072 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:58.590276 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 966/1925] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:58 2021] DELETE /identity/v3/users/dd79cf34364e4759ac71d50527be63a3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:58.596071 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a8c11-ec0d-40ad-a3fb-e5cc78560afa None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:58.596387 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a8c11-ec0d-40ad-a3fb-e5cc78560afa None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:58.596680 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a8c11-ec0d-40ad-a3fb-e5cc78560afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:58.612297 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 960/1926] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:58 2021] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:58.617194 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17880bdf-08f6-4495-96ac-6368fef05072 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:58.619461 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-17880bdf-08f6-4495-96ac-6368fef05072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:58.619749 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-7a5a8c11-ec0d-40ad-a3fb-e5cc78560afa None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:58.620941 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7a5a8c11-ec0d-40ad-a3fb-e5cc78560afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:58.637097 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17880bdf-08f6-4495-96ac-6368fef05072 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:58.694813 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 967/1927] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:58.704741 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a8c11-ec0d-40ad-a3fb-e5cc78560afa None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:58.706782 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7a5a8c11-ec0d-40ad-a3fb-e5cc78560afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:58.722131 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe582519-f61a-4167-9b50-d919319ff37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:58.722807 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe582519-f61a-4167-9b50-d919319ff37c admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:58.723091 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe582519-f61a-4167-9b50-d919319ff37c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:58.723367 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe582519-f61a-4167-9b50-d919319ff37c admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:58.724095 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe582519-f61a-4167-9b50-d919319ff37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:58.725734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe582519-f61a-4167-9b50-d919319ff37c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:58.736024 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 961/1928] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:58 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:58.739815 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe582519-f61a-4167-9b50-d919319ff37c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:58.748904 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe582519-f61a-4167-9b50-d919319ff37c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:58.753605 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c89f6-51d1-434b-b5bf-b6d9a7e891e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:58.754231 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c89f6-51d1-434b-b5bf-b6d9a7e891e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:58.754513 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c89f6-51d1-434b-b5bf-b6d9a7e891e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:58.754786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c89f6-51d1-434b-b5bf-b6d9a7e891e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:58.755486 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c89f6-51d1-434b-b5bf-b6d9a7e891e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:58.757052 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c89f6-51d1-434b-b5bf-b6d9a7e891e0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:58.763040 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a8c11-ec0d-40ad-a3fb-e5cc78560afa None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:58.766530 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 962/1929] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:58 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:58.766710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b94407-428a-48b1-88bb-2936c9df6375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:58.767352 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b94407-428a-48b1-88bb-2936c9df6375 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:58.767634 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b94407-428a-48b1-88bb-2936c9df6375 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:58.767907 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b94407-428a-48b1-88bb-2936c9df6375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:58.770414 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c89f6-51d1-434b-b5bf-b6d9a7e891e0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:58.777019 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b94407-428a-48b1-88bb-2936c9df6375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:58.778440 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b94407-428a-48b1-88bb-2936c9df6375 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:58.781886 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c89f6-51d1-434b-b5bf-b6d9a7e891e0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:58.786564 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94126b18-0bfb-4c28-a574-d4be3d6b2fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:58.787443 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94126b18-0bfb-4c28-a574-d4be3d6b2fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:58.787722 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94126b18-0bfb-4c28-a574-d4be3d6b2fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:58.787999 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94126b18-0bfb-4c28-a574-d4be3d6b2fb3 admin admin] PATH_INFO: `/v3/projects/e945c1104b7b45a49d5f51ac38675276/users/cec5c7a363c64b839599e567ad5814f9/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:58.788211 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 968/1930] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:29:58.802919 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94126b18-0bfb-4c28-a574-d4be3d6b2fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e945c1104b7b45a49d5f51ac38675276, user_id=cec5c7a363c64b839599e567ad5814f9, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:58.805611 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94126b18-0bfb-4c28-a574-d4be3d6b2fb3 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:58.818842 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 963/1931] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:58 2021] PUT /identity/v3/projects/e945c1104b7b45a49d5f51ac38675276/users/cec5c7a363c64b839599e567ad5814f9/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:58.828974 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f893b-becd-4c02-b383-83fec739ce98 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:58.829224 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f893b-becd-4c02-b383-83fec739ce98 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:58.829509 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f893b-becd-4c02-b383-83fec739ce98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:58.858439 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-fb5f893b-becd-4c02-b383-83fec739ce98 None None] MFA Rules not processed for user `cec5c7a363c64b839599e567ad5814f9`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:58.859775 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-fb5f893b-becd-4c02-b383-83fec739ce98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:58.924159 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 969/1932] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:58 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:29:58.928619 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94126b18-0bfb-4c28-a574-d4be3d6b2fb3 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:58.992326 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94126b18-0bfb-4c28-a574-d4be3d6b2fb3 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:58.997983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6e676-7db0-4b27-b407-b4cc11279eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:58.999174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6e676-7db0-4b27-b407-b4cc11279eac admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:58.999460 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6e676-7db0-4b27-b407-b4cc11279eac admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:58.999734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6e676-7db0-4b27-b407-b4cc11279eac admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:59.000619 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6e676-7db0-4b27-b407-b4cc11279eac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:59.002383 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6e676-7db0-4b27-b407-b4cc11279eac admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:59.029610 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 964/1933] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:58 2021] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:29:59.033817 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f893b-becd-4c02-b383-83fec739ce98 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:59.044251 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f893b-becd-4c02-b383-83fec739ce98 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:59.100949 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b78f17-7158-489b-be69-193ac13a65db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:59.101626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b78f17-7158-489b-be69-193ac13a65db admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:59.101945 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b78f17-7158-489b-be69-193ac13a65db admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:59.102187 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b78f17-7158-489b-be69-193ac13a65db admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:59.102886 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b78f17-7158-489b-be69-193ac13a65db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:59.104899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b78f17-7158-489b-be69-193ac13a65db admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:59.106942 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6e676-7db0-4b27-b407-b4cc11279eac admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:59.109483 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-1bd6e676-7db0-4b27-b407-b4cc11279eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:59.122600 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6e676-7db0-4b27-b407-b4cc11279eac admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:59.127490 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 970/1934] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:59 2021] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:59.129982 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f20391-849b-480c-a032-70a2bdd9d995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:59.131360 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b78f17-7158-489b-be69-193ac13a65db admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:59.131482 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f20391-849b-480c-a032-70a2bdd9d995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:59.131931 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f20391-849b-480c-a032-70a2bdd9d995 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:59.132383 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f20391-849b-480c-a032-70a2bdd9d995 admin admin] PATH_INFO: `/v3/projects/b862fe945de24a30bd57be689fc55212` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:59.133854 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f20391-849b-480c-a032-70a2bdd9d995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b862fe945de24a30bd57be689fc55212)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:59.135998 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f20391-849b-480c-a032-70a2bdd9d995 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:59.142582 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b78f17-7158-489b-be69-193ac13a65db admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:59.148088 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db5c82-cad4-4deb-b539-11e47c6d57e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:59.149605 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db5c82-cad4-4deb-b539-11e47c6d57e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:59.149605 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db5c82-cad4-4deb-b539-11e47c6d57e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:59.149837 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db5c82-cad4-4deb-b539-11e47c6d57e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:59.150936 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db5c82-cad4-4deb-b539-11e47c6d57e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:59.153057 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db5c82-cad4-4deb-b539-11e47c6d57e4 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:59.166527 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 971/1935] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:59 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:29:59.167609 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db5c82-cad4-4deb-b539-11e47c6d57e4 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:59.178225 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db5c82-cad4-4deb-b539-11e47c6d57e4 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:59.185862 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99d0e4-0be2-4121-8957-110940269c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:59.186704 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99d0e4-0be2-4121-8957-110940269c93 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:59.187054 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99d0e4-0be2-4121-8957-110940269c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:59.187402 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99d0e4-0be2-4121-8957-110940269c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:59.188257 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99d0e4-0be2-4121-8957-110940269c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:59.190057 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99d0e4-0be2-4121-8957-110940269c93 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:59.201098 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-68f20391-849b-480c-a032-70a2bdd9d995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b862fe945de24a30bd57be689fc55212', 'request_id': 'req-68f20391-849b-480c-a032-70a2bdd9d995'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:59.204762 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 972/1936] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:59 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:59.205642 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99d0e4-0be2-4121-8957-110940269c93 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:59.215540 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-68f20391-849b-480c-a032-70a2bdd9d995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b862fe945de24a30bd57be689fc55212', 'request_id': 'req-68f20391-849b-480c-a032-70a2bdd9d995'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:59.215887 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99d0e4-0be2-4121-8957-110940269c93 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:59.227615 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-68f20391-849b-480c-a032-70a2bdd9d995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b862fe945de24a30bd57be689fc55212', 'request_id': 'req-68f20391-849b-480c-a032-70a2bdd9d995'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:59.238550 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-68f20391-849b-480c-a032-70a2bdd9d995 admin admin] The token cache is being invalidate because project b862fe945de24a30bd57be689fc55212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:59.238931 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-68f20391-849b-480c-a032-70a2bdd9d995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:59.239654 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-68f20391-849b-480c-a032-70a2bdd9d995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:59.241325 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 965/1937] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:59 2021] DELETE /identity/v3/projects/b862fe945de24a30bd57be689fc55212 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:29:59.245555 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f20391-849b-480c-a032-70a2bdd9d995 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:59.247004 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-68f20391-849b-480c-a032-70a2bdd9d995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:59.276111 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6cb86-adde-4366-a4cc-0903b32041c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:59.277131 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6cb86-adde-4366-a4cc-0903b32041c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:59.277378 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6cb86-adde-4366-a4cc-0903b32041c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:59.277571 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6cb86-adde-4366-a4cc-0903b32041c1 admin admin] PATH_INFO: `/v3/projects/dd5b95935a5445848545622692d6d72d/users/9e59c15599e74c2193bc771ad82cc079/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:59.293917 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6cb86-adde-4366-a4cc-0903b32041c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5b95935a5445848545622692d6d72d, user_id=9e59c15599e74c2193bc771ad82cc079, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:59.296613 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff6cb86-adde-4366-a4cc-0903b32041c1 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:59.313089 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 973/1938] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:59 2021] PUT /identity/v3/projects/dd5b95935a5445848545622692d6d72d/users/9e59c15599e74c2193bc771ad82cc079/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:29:59.316523 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f20391-849b-480c-a032-70a2bdd9d995 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:59.323414 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704444bf-4385-471f-92d9-1f0ed5e6b60c None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:59.323718 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704444bf-4385-471f-92d9-1f0ed5e6b60c None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:59.323994 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704444bf-4385-471f-92d9-1f0ed5e6b60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:59.351530 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-704444bf-4385-471f-92d9-1f0ed5e6b60c None None] MFA Rules not processed for user `9e59c15599e74c2193bc771ad82cc079`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:59.352669 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-704444bf-4385-471f-92d9-1f0ed5e6b60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:59.389534 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198e39a-0645-41b4-a07f-08baab791dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:59.390418 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198e39a-0645-41b4-a07f-08baab791dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:59.390695 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198e39a-0645-41b4-a07f-08baab791dba admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:59.390970 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198e39a-0645-41b4-a07f-08baab791dba admin admin] PATH_INFO: `/v3/users/182816725b6444feb4394de04b9f310f` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:59.392168 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198e39a-0645-41b4-a07f-08baab791dba admin admin] RBAC: Authorizing `identity:delete_user(user_id=182816725b6444feb4394de04b9f310f)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:59.394128 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198e39a-0645-41b4-a07f-08baab791dba admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:59.419378 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 974/1939] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:59 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:29:59.424375 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704444bf-4385-471f-92d9-1f0ed5e6b60c None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:59.426126 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-704444bf-4385-471f-92d9-1f0ed5e6b60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:59.440490 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d198e39a-0645-41b4-a07f-08baab791dba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '182816725b6444feb4394de04b9f310f'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:59.441182 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704444bf-4385-471f-92d9-1f0ed5e6b60c None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:59.446301 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44aac4-2755-4c8b-a517-4ae18d835f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:59.446964 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44aac4-2755-4c8b-a517-4ae18d835f46 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:59.447249 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44aac4-2755-4c8b-a517-4ae18d835f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:59.447526 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44aac4-2755-4c8b-a517-4ae18d835f46 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:59.448271 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44aac4-2755-4c8b-a517-4ae18d835f46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:59.450236 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44aac4-2755-4c8b-a517-4ae18d835f46 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:59.453010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d198e39a-0645-41b4-a07f-08baab791dba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '182816725b6444feb4394de04b9f310f'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:59.453708 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d198e39a-0645-41b4-a07f-08baab791dba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '182816725b6444feb4394de04b9f310f'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:59.461392 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d198e39a-0645-41b4-a07f-08baab791dba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '182816725b6444feb4394de04b9f310f'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:59.469332 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d198e39a-0645-41b4-a07f-08baab791dba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '182816725b6444feb4394de04b9f310f'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:59.476414 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 966/1940] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:29:59 2021] DELETE /identity/v3/users/182816725b6444feb4394de04b9f310f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:29:59.486646 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 975/1941] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:29:59 2021] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:29:59.487793 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198e39a-0645-41b4-a07f-08baab791dba admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:59.489267 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d198e39a-0645-41b4-a07f-08baab791dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:59.552741 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198e39a-0645-41b4-a07f-08baab791dba admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:59.609623 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019945ef-7c78-46e3-a834-20920f4ac115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:59.610228 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019945ef-7c78-46e3-a834-20920f4ac115 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:59.610512 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019945ef-7c78-46e3-a834-20920f4ac115 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:59.610792 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019945ef-7c78-46e3-a834-20920f4ac115 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:59.611514 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019945ef-7c78-46e3-a834-20920f4ac115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:59.613462 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019945ef-7c78-46e3-a834-20920f4ac115 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:59.635094 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 967/1942] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:29:59 2021] POST /identity/v3/users => generated 300 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:29:59.638528 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44aac4-2755-4c8b-a517-4ae18d835f46 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:59.648906 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44aac4-2755-4c8b-a517-4ae18d835f46 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:59.653763 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec60a80-fa9f-40b0-99e1-c7adbba46f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:59.654431 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec60a80-fa9f-40b0-99e1-c7adbba46f99 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:59.655243 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec60a80-fa9f-40b0-99e1-c7adbba46f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:59.655523 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec60a80-fa9f-40b0-99e1-c7adbba46f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:59.656259 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec60a80-fa9f-40b0-99e1-c7adbba46f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:59.657887 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec60a80-fa9f-40b0-99e1-c7adbba46f99 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:59.668279 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 976/1943] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:59 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:29:59.672527 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019945ef-7c78-46e3-a834-20920f4ac115 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:59.682712 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019945ef-7c78-46e3-a834-20920f4ac115 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:59.687962 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f286b3-f9ae-44b9-a3fb-ef7f231e31f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:59.688924 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f286b3-f9ae-44b9-a3fb-ef7f231e31f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:59.689315 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f286b3-f9ae-44b9-a3fb-ef7f231e31f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:59.689659 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f286b3-f9ae-44b9-a3fb-ef7f231e31f1 admin admin] PATH_INFO: `/v3/projects/e6de50d6ace14f8d9ba0c3ea50ab4462/users/08dd467006ab48a18ef6c6ecafa472f8/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:59.705497 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f286b3-f9ae-44b9-a3fb-ef7f231e31f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6de50d6ace14f8d9ba0c3ea50ab4462, user_id=08dd467006ab48a18ef6c6ecafa472f8, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:59.708415 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f286b3-f9ae-44b9-a3fb-ef7f231e31f1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:59.728328 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 968/1944] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:59 2021] PUT /identity/v3/projects/e6de50d6ace14f8d9ba0c3ea50ab4462/users/08dd467006ab48a18ef6c6ecafa472f8/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:29:59.728975 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec60a80-fa9f-40b0-99e1-c7adbba46f99 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:59.740398 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec60a80-fa9f-40b0-99e1-c7adbba46f99 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:59.813727 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d4203-286a-46f0-949b-bfc1dbd51855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:59.814405 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d4203-286a-46f0-949b-bfc1dbd51855 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:59.814721 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d4203-286a-46f0-949b-bfc1dbd51855 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:59.814959 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d4203-286a-46f0-949b-bfc1dbd51855 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:59.815285 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f286b3-f9ae-44b9-a3fb-ef7f231e31f1 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:59.815687 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d4203-286a-46f0-949b-bfc1dbd51855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:59.817283 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b7f286b3-f9ae-44b9-a3fb-ef7f231e31f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:59.817405 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d4203-286a-46f0-949b-bfc1dbd51855 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:59.828921 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 977/1945] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:29:59 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:29:59.831575 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f286b3-f9ae-44b9-a3fb-ef7f231e31f1 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:59.832782 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d4203-286a-46f0-949b-bfc1dbd51855 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:59.837096 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6ea49-bfdc-40af-baa3-224a94884006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:59.838166 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6ea49-bfdc-40af-baa3-224a94884006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:59.838525 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6ea49-bfdc-40af-baa3-224a94884006 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:59.838879 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6ea49-bfdc-40af-baa3-224a94884006 admin admin] PATH_INFO: `/v3/projects/b8aa1569ecc749a7b147b0ac23a2d764` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:59.840163 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6ea49-bfdc-40af-baa3-224a94884006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8aa1569ecc749a7b147b0ac23a2d764)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:59.842293 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6ea49-bfdc-40af-baa3-224a94884006 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:59.845727 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d4203-286a-46f0-949b-bfc1dbd51855 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:29:59.851564 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651975d4-0b4b-48c5-8be3-36b64463cdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:29:59.852754 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651975d4-0b4b-48c5-8be3-36b64463cdf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:59.853158 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651975d4-0b4b-48c5-8be3-36b64463cdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:59.853535 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651975d4-0b4b-48c5-8be3-36b64463cdf0 admin admin] PATH_INFO: `/v3/projects/e6de50d6ace14f8d9ba0c3ea50ab4462/users/08dd467006ab48a18ef6c6ecafa472f8/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:59.858477 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651975d4-0b4b-48c5-8be3-36b64463cdf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6de50d6ace14f8d9ba0c3ea50ab4462, user_id=08dd467006ab48a18ef6c6ecafa472f8, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:29:59.861217 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651975d4-0b4b-48c5-8be3-36b64463cdf0 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:29:59.881220 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 978/1946] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:29:59 2021] PUT /identity/v3/projects/e6de50d6ace14f8d9ba0c3ea50ab4462/users/08dd467006ab48a18ef6c6ecafa472f8/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:29:59.891568 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-3cb6ea49-bfdc-40af-baa3-224a94884006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8aa1569ecc749a7b147b0ac23a2d764', 'request_id': 'req-3cb6ea49-bfdc-40af-baa3-224a94884006'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:59.892464 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87180d3-a270-4a83-afdd-3c1a5f06df13 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:59.892760 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87180d3-a270-4a83-afdd-3c1a5f06df13 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:59.893072 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87180d3-a270-4a83-afdd-3c1a5f06df13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:59.898332 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-3cb6ea49-bfdc-40af-baa3-224a94884006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8aa1569ecc749a7b147b0ac23a2d764', 'request_id': 'req-3cb6ea49-bfdc-40af-baa3-224a94884006'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:59.906015 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-3cb6ea49-bfdc-40af-baa3-224a94884006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8aa1569ecc749a7b147b0ac23a2d764', 'request_id': 'req-3cb6ea49-bfdc-40af-baa3-224a94884006'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:59.916078 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-3cb6ea49-bfdc-40af-baa3-224a94884006 admin admin] The token cache is being invalidate because project b8aa1569ecc749a7b147b0ac23a2d764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:29:59.916368 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-3cb6ea49-bfdc-40af-baa3-224a94884006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:59.917158 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-3cb6ea49-bfdc-40af-baa3-224a94884006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:29:59.918731 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 969/1947] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:29:59 2021] DELETE /identity/v3/projects/b8aa1569ecc749a7b147b0ac23a2d764 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:29:59.919084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-a87180d3-a270-4a83-afdd-3c1a5f06df13 None None] MFA Rules not processed for user `08dd467006ab48a18ef6c6ecafa472f8`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:59.920402 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a87180d3-a270-4a83-afdd-3c1a5f06df13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:59.924321 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c961d-f860-4895-8604-00577e24e881 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:29:59.924629 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c961d-f860-4895-8604-00577e24e881 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:29:59.924926 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c961d-f860-4895-8604-00577e24e881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:29:59.941996 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-795c961d-f860-4895-8604-00577e24e881 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:29:59.943160 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-795c961d-f860-4895-8604-00577e24e881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:29:59.985918 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 979/1948] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:59 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:29:59.995791 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87180d3-a270-4a83-afdd-3c1a5f06df13 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:29:59.997355 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a87180d3-a270-4a83-afdd-3c1a5f06df13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:00.001812 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 970/1949] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:29:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:30:00.009337 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e42a3-9e38-4b0c-a374-500de83411b3 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:00.009630 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e42a3-9e38-4b0c-a374-500de83411b3 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:00.009910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e42a3-9e38-4b0c-a374-500de83411b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:00.027365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-220e42a3-9e38-4b0c-a374-500de83411b3 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:00.028555 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-220e42a3-9e38-4b0c-a374-500de83411b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:00.036439 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 971/1950] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:30:00.040427 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e42a3-9e38-4b0c-a374-500de83411b3 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:00.049636 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e42a3-9e38-4b0c-a374-500de83411b3 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:00.052961 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87180d3-a270-4a83-afdd-3c1a5f06df13 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:00.054217 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d987c2c-7a6a-459f-b2e1-e382526dd179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:00.054849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d987c2c-7a6a-459f-b2e1-e382526dd179 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:00.055133 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d987c2c-7a6a-459f-b2e1-e382526dd179 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:00.055407 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d987c2c-7a6a-459f-b2e1-e382526dd179 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:00.056116 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d987c2c-7a6a-459f-b2e1-e382526dd179 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:30:00.056420 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d987c2c-7a6a-459f-b2e1-e382526dd179 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:00.056820 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8161ef3-637f-44e3-989f-d7c3891902da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:00.057496 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8161ef3-637f-44e3-989f-d7c3891902da service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:00.057803 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8161ef3-637f-44e3-989f-d7c3891902da service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:00.058060 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d987c2c-7a6a-459f-b2e1-e382526dd179 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:00.058155 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8161ef3-637f-44e3-989f-d7c3891902da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:00.067693 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8161ef3-637f-44e3-989f-d7c3891902da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:00.069147 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8161ef3-637f-44e3-989f-d7c3891902da service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:00.070146 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 972/1951] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:30:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:30:00.074331 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d987c2c-7a6a-459f-b2e1-e382526dd179 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:00.078507 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 980/1952] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:29:59 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:30:00.083519 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d987c2c-7a6a-459f-b2e1-e382526dd179 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:00.088585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0a107-f8cf-4d24-95a8-00a685e1b3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:00.089335 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0a107-f8cf-4d24-95a8-00a685e1b3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:00.089715 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0a107-f8cf-4d24-95a8-00a685e1b3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:00.090106 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0a107-f8cf-4d24-95a8-00a685e1b3a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:00.090912 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0a107-f8cf-4d24-95a8-00a685e1b3a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:00.092869 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0a107-f8cf-4d24-95a8-00a685e1b3a9 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:00.118822 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 973/1953] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:30:00 2021] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:30:00.122692 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8161ef3-637f-44e3-989f-d7c3891902da service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:00.133834 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8161ef3-637f-44e3-989f-d7c3891902da service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:00.190642 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9d1d7-9e19-423c-8179-4de026977ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:00.191356 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9d1d7-9e19-423c-8179-4de026977ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:00.191638 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9d1d7-9e19-423c-8179-4de026977ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:00.191916 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9d1d7-9e19-423c-8179-4de026977ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:00.192619 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9d1d7-9e19-423c-8179-4de026977ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:00.194799 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9d1d7-9e19-423c-8179-4de026977ef7 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:00.217870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 981/1954] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:30:00 2021] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:30:00.222350 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0a107-f8cf-4d24-95a8-00a685e1b3a9 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:00.234957 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0a107-f8cf-4d24-95a8-00a685e1b3a9 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:00.240401 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11ae61-afbb-4431-bf0e-d6849e2ab2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:00.241211 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11ae61-afbb-4431-bf0e-d6849e2ab2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:00.241605 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11ae61-afbb-4431-bf0e-d6849e2ab2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:00.242108 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11ae61-afbb-4431-bf0e-d6849e2ab2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:00.243059 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11ae61-afbb-4431-bf0e-d6849e2ab2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:00.245231 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11ae61-afbb-4431-bf0e-d6849e2ab2e1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:00.259281 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 974/1955] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:00 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:30:00.263491 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9d1d7-9e19-423c-8179-4de026977ef7 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:00.273755 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9d1d7-9e19-423c-8179-4de026977ef7 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:00.279338 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb9f87-b9ce-4554-9477-54e4a3080dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:00.280554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb9f87-b9ce-4554-9477-54e4a3080dee admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:00.280841 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb9f87-b9ce-4554-9477-54e4a3080dee admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:00.281389 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb9f87-b9ce-4554-9477-54e4a3080dee admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:00.282122 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb9f87-b9ce-4554-9477-54e4a3080dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:00.283708 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb9f87-b9ce-4554-9477-54e4a3080dee admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:00.298012 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 982/1956] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:00 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:30:00.299309 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11ae61-afbb-4431-bf0e-d6849e2ab2e1 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:00.309659 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11ae61-afbb-4431-bf0e-d6849e2ab2e1 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:00.314737 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199fb2b-05e4-4147-9645-f4165be8a1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:00.315728 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199fb2b-05e4-4147-9645-f4165be8a1c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:00.316248 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199fb2b-05e4-4147-9645-f4165be8a1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:00.316382 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199fb2b-05e4-4147-9645-f4165be8a1c5 admin admin] PATH_INFO: `/v3/projects/e40081f5f1e04fcb8149f7e119d6c584/users/0f4669851091485d885dd7de4e7a0223/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:00.330902 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199fb2b-05e4-4147-9645-f4165be8a1c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40081f5f1e04fcb8149f7e119d6c584, user_id=0f4669851091485d885dd7de4e7a0223, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:00.333601 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199fb2b-05e4-4147-9645-f4165be8a1c5 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:00.359740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 975/1957] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:00 2021] PUT /identity/v3/projects/e40081f5f1e04fcb8149f7e119d6c584/users/0f4669851091485d885dd7de4e7a0223/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:30:00.361509 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd5463-05af-4f1e-963e-129f68bbbf45 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:00.361748 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd5463-05af-4f1e-963e-129f68bbbf45 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:00.362032 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd5463-05af-4f1e-963e-129f68bbbf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:00.391687 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-40dd5463-05af-4f1e-963e-129f68bbbf45 None None] MFA Rules not processed for user `0f4669851091485d885dd7de4e7a0223`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:00.393058 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-40dd5463-05af-4f1e-963e-129f68bbbf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:00.472413 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 983/1958] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:00 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:00.472778 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199fb2b-05e4-4147-9645-f4165be8a1c5 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:00.547201 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199fb2b-05e4-4147-9645-f4165be8a1c5 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:00.552829 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683400b7-c208-4003-8eda-5dd3b03f0844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:00.553535 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683400b7-c208-4003-8eda-5dd3b03f0844 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:00.553819 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683400b7-c208-4003-8eda-5dd3b03f0844 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:00.554091 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683400b7-c208-4003-8eda-5dd3b03f0844 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:00.554803 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683400b7-c208-4003-8eda-5dd3b03f0844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:00.556788 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683400b7-c208-4003-8eda-5dd3b03f0844 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:00.584992 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 976/1959] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:30:00 2021] POST /identity/v3/projects => generated 389 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:30:00.586119 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd5463-05af-4f1e-963e-129f68bbbf45 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:00.597022 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd5463-05af-4f1e-963e-129f68bbbf45 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:00.611778 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683400b7-c208-4003-8eda-5dd3b03f0844 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:00.651625 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e25e9b-a4ba-42e6-ad9f-0bc86e29998b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:00.652330 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e25e9b-a4ba-42e6-ad9f-0bc86e29998b admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:00.652615 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e25e9b-a4ba-42e6-ad9f-0bc86e29998b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:00.652918 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e25e9b-a4ba-42e6-ad9f-0bc86e29998b admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:00.653618 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e25e9b-a4ba-42e6-ad9f-0bc86e29998b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:00.655550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e25e9b-a4ba-42e6-ad9f-0bc86e29998b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:00.663085 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683400b7-c208-4003-8eda-5dd3b03f0844 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:00.666774 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5962dda-840a-4d21-a46d-0caceb7d79e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:00.667416 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5962dda-840a-4d21-a46d-0caceb7d79e0 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:00.667699 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5962dda-840a-4d21-a46d-0caceb7d79e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:00.667975 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5962dda-840a-4d21-a46d-0caceb7d79e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:00.670111 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-c5962dda-840a-4d21-a46d-0caceb7d79e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:00.676072 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 984/1960] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:30:00 2021] POST /identity/v3/users => generated 301 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:30:00.685085 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e25e9b-a4ba-42e6-ad9f-0bc86e29998b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:00.696166 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e25e9b-a4ba-42e6-ad9f-0bc86e29998b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:00.700818 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b69e5-7e4d-413b-98a4-5e83d713e1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:00.701534 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b69e5-7e4d-413b-98a4-5e83d713e1dd admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:00.701816 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b69e5-7e4d-413b-98a4-5e83d713e1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:00.702089 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b69e5-7e4d-413b-98a4-5e83d713e1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:00.702798 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b69e5-7e4d-413b-98a4-5e83d713e1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:00.704360 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b69e5-7e4d-413b-98a4-5e83d713e1dd admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:00.714058 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 985/1961] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:00 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:30:00.718136 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b69e5-7e4d-413b-98a4-5e83d713e1dd admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:00.727653 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b69e5-7e4d-413b-98a4-5e83d713e1dd admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:00.731108 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5962dda-840a-4d21-a46d-0caceb7d79e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:00.732252 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae080c63-6ca6-4591-b4ba-645f0c373645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:00.732554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5962dda-840a-4d21-a46d-0caceb7d79e0 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:00.733644 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae080c63-6ca6-4591-b4ba-645f0c373645 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:00.733926 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae080c63-6ca6-4591-b4ba-645f0c373645 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:00.734200 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae080c63-6ca6-4591-b4ba-645f0c373645 admin admin] PATH_INFO: `/v3/projects/eff38b1f989e483fa3e426cadc590f5d/users/9793a9d6164c467bb10abee45aef8a21/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:00.742086 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 977/1962] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:00 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:30:00.749216 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae080c63-6ca6-4591-b4ba-645f0c373645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff38b1f989e483fa3e426cadc590f5d, user_id=9793a9d6164c467bb10abee45aef8a21, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:00.751812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae080c63-6ca6-4591-b4ba-645f0c373645 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:00.764511 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 986/1963] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:00 2021] PUT /identity/v3/projects/eff38b1f989e483fa3e426cadc590f5d/users/9793a9d6164c467bb10abee45aef8a21/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:00.768636 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5962dda-840a-4d21-a46d-0caceb7d79e0 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:00.781496 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5962dda-840a-4d21-a46d-0caceb7d79e0 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:00.844152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a4fb0-30ff-4206-9ffd-3a6b28541ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:00.844818 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a4fb0-30ff-4206-9ffd-3a6b28541ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:00.845125 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a4fb0-30ff-4206-9ffd-3a6b28541ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:00.845653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a4fb0-30ff-4206-9ffd-3a6b28541ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:00.846371 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a4fb0-30ff-4206-9ffd-3a6b28541ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:00.848097 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a4fb0-30ff-4206-9ffd-3a6b28541ef8 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:00.858655 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 978/1964] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:00 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:30:00.862948 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae080c63-6ca6-4591-b4ba-645f0c373645 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:00.874137 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae080c63-6ca6-4591-b4ba-645f0c373645 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:00.879230 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21af0e4-6600-4ccd-a5aa-7ac535b77339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:00.880547 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21af0e4-6600-4ccd-a5aa-7ac535b77339 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:00.881049 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21af0e4-6600-4ccd-a5aa-7ac535b77339 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:00.881328 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21af0e4-6600-4ccd-a5aa-7ac535b77339 admin admin] PATH_INFO: `/v3/projects/eff38b1f989e483fa3e426cadc590f5d/users/9793a9d6164c467bb10abee45aef8a21/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:00.883921 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21af0e4-6600-4ccd-a5aa-7ac535b77339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff38b1f989e483fa3e426cadc590f5d, user_id=9793a9d6164c467bb10abee45aef8a21, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:00.886558 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21af0e4-6600-4ccd-a5aa-7ac535b77339 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:00.900928 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 987/1965] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:00 2021] PUT /identity/v3/projects/eff38b1f989e483fa3e426cadc590f5d/users/9793a9d6164c467bb10abee45aef8a21/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:00.911568 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb156ad8-ecd1-4a2f-b15a-93a7740fa28f None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:00.911857 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb156ad8-ecd1-4a2f-b15a-93a7740fa28f None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:00.912132 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb156ad8-ecd1-4a2f-b15a-93a7740fa28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:00.942229 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-cb156ad8-ecd1-4a2f-b15a-93a7740fa28f None None] MFA Rules not processed for user `9793a9d6164c467bb10abee45aef8a21`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:00.943405 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-cb156ad8-ecd1-4a2f-b15a-93a7740fa28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:01.030885 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 979/1966] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:00 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:01.047341 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21af0e4-6600-4ccd-a5aa-7ac535b77339 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:01.109511 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21af0e4-6600-4ccd-a5aa-7ac535b77339 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:01.113245 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd1693-7e5a-4457-87e3-94000bf7bb9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:01.113826 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd1693-7e5a-4457-87e3-94000bf7bb9c service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:01.114108 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd1693-7e5a-4457-87e3-94000bf7bb9c service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:01.114384 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd1693-7e5a-4457-87e3-94000bf7bb9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:01.123028 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd1693-7e5a-4457-87e3-94000bf7bb9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:01.125022 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd1693-7e5a-4457-87e3-94000bf7bb9c service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:01.134291 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 988/1967] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:01 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:01.249921 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb156ad8-ecd1-4a2f-b15a-93a7740fa28f None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:01.309246 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb156ad8-ecd1-4a2f-b15a-93a7740fa28f None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:01.314315 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67182cf0-efd6-4570-af99-57698fc1b922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:01.315167 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67182cf0-efd6-4570-af99-57698fc1b922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:01.315447 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67182cf0-efd6-4570-af99-57698fc1b922 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:01.315718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67182cf0-efd6-4570-af99-57698fc1b922 admin admin] PATH_INFO: `/v3/users/0f4669851091485d885dd7de4e7a0223` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:01.316900 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67182cf0-efd6-4570-af99-57698fc1b922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f4669851091485d885dd7de4e7a0223)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:01.318969 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67182cf0-efd6-4570-af99-57698fc1b922 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:01.361267 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-67182cf0-efd6-4570-af99-57698fc1b922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f4669851091485d885dd7de4e7a0223'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:01.373121 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-67182cf0-efd6-4570-af99-57698fc1b922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f4669851091485d885dd7de4e7a0223'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:01.374503 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-67182cf0-efd6-4570-af99-57698fc1b922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f4669851091485d885dd7de4e7a0223'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:01.381813 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-67182cf0-efd6-4570-af99-57698fc1b922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f4669851091485d885dd7de4e7a0223'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:01.388772 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-67182cf0-efd6-4570-af99-57698fc1b922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f4669851091485d885dd7de4e7a0223'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:01.394976 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 980/1968] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:30:01 2021] DELETE /identity/v3/users/0f4669851091485d885dd7de4e7a0223 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:01.399450 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e6201-f106-4b46-9468-ae2102ef2400 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:01.399835 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e6201-f106-4b46-9468-ae2102ef2400 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:01.400185 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e6201-f106-4b46-9468-ae2102ef2400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:01.418943 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-fe3e6201-f106-4b46-9468-ae2102ef2400 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:01.420715 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-fe3e6201-f106-4b46-9468-ae2102ef2400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:01.484658 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 989/1969] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:01.494813 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67182cf0-efd6-4570-af99-57698fc1b922 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:01.496315 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-67182cf0-efd6-4570-af99-57698fc1b922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:01.552031 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67182cf0-efd6-4570-af99-57698fc1b922 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:01.555759 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac13e66-4df1-4b5e-9833-691120c11dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:01.556402 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac13e66-4df1-4b5e-9833-691120c11dec service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:01.556682 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac13e66-4df1-4b5e-9833-691120c11dec service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:01.556996 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac13e66-4df1-4b5e-9833-691120c11dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:01.566403 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac13e66-4df1-4b5e-9833-691120c11dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:01.567860 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac13e66-4df1-4b5e-9833-691120c11dec service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:01.577479 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 981/1970] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:01.917013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e6201-f106-4b46-9468-ae2102ef2400 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:01.918448 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-fe3e6201-f106-4b46-9468-ae2102ef2400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:01.930507 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e6201-f106-4b46-9468-ae2102ef2400 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:01.935099 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88e029-5a06-405a-898d-9017e536dcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:01.935955 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88e029-5a06-405a-898d-9017e536dcd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:01.936237 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88e029-5a06-405a-898d-9017e536dcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:01.936517 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88e029-5a06-405a-898d-9017e536dcd9 admin admin] PATH_INFO: `/v3/projects/e40081f5f1e04fcb8149f7e119d6c584` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:01.937732 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88e029-5a06-405a-898d-9017e536dcd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e40081f5f1e04fcb8149f7e119d6c584)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:01.939704 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88e029-5a06-405a-898d-9017e536dcd9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:01.984833 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-0b88e029-5a06-405a-898d-9017e536dcd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e40081f5f1e04fcb8149f7e119d6c584', 'request_id': 'req-0b88e029-5a06-405a-898d-9017e536dcd9'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:01.991013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-0b88e029-5a06-405a-898d-9017e536dcd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e40081f5f1e04fcb8149f7e119d6c584', 'request_id': 'req-0b88e029-5a06-405a-898d-9017e536dcd9'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:01.996660 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-0b88e029-5a06-405a-898d-9017e536dcd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e40081f5f1e04fcb8149f7e119d6c584', 'request_id': 'req-0b88e029-5a06-405a-898d-9017e536dcd9'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:02.007035 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-0b88e029-5a06-405a-898d-9017e536dcd9 admin admin] The token cache is being invalidate because project e40081f5f1e04fcb8149f7e119d6c584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:30:02.007318 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-0b88e029-5a06-405a-898d-9017e536dcd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:02.007928 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-0b88e029-5a06-405a-898d-9017e536dcd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:02.009460 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 990/1971] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:30:01 2021] DELETE /identity/v3/projects/e40081f5f1e04fcb8149f7e119d6c584 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:02.013400 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac13e66-4df1-4b5e-9833-691120c11dec service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:02.022626 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac13e66-4df1-4b5e-9833-691120c11dec service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:02.077170 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404448e-c297-4b7c-94ab-ef4b39e43572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:02.078053 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404448e-c297-4b7c-94ab-ef4b39e43572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:02.078340 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404448e-c297-4b7c-94ab-ef4b39e43572 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:02.078619 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404448e-c297-4b7c-94ab-ef4b39e43572 admin admin] PATH_INFO: `/v3/users/9793a9d6164c467bb10abee45aef8a21` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:02.079827 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404448e-c297-4b7c-94ab-ef4b39e43572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9793a9d6164c467bb10abee45aef8a21)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:02.081932 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404448e-c297-4b7c-94ab-ef4b39e43572 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:02.130434 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-6404448e-c297-4b7c-94ab-ef4b39e43572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9793a9d6164c467bb10abee45aef8a21'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:02.142362 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-6404448e-c297-4b7c-94ab-ef4b39e43572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9793a9d6164c467bb10abee45aef8a21'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:02.143041 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-6404448e-c297-4b7c-94ab-ef4b39e43572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9793a9d6164c467bb10abee45aef8a21'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:02.151372 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-6404448e-c297-4b7c-94ab-ef4b39e43572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9793a9d6164c467bb10abee45aef8a21'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:02.158506 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-6404448e-c297-4b7c-94ab-ef4b39e43572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9793a9d6164c467bb10abee45aef8a21'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:02.164581 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 982/1972] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:30:02 2021] DELETE /identity/v3/users/9793a9d6164c467bb10abee45aef8a21 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:02.432515 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88e029-5a06-405a-898d-9017e536dcd9 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:02.433989 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-0b88e029-5a06-405a-898d-9017e536dcd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:02.454242 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88e029-5a06-405a-898d-9017e536dcd9 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:02.508870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61cec8-4199-42fc-a178-80851c16574d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:02.509757 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61cec8-4199-42fc-a178-80851c16574d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:02.510044 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61cec8-4199-42fc-a178-80851c16574d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:02.510321 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61cec8-4199-42fc-a178-80851c16574d admin admin] PATH_INFO: `/v3/projects/eff38b1f989e483fa3e426cadc590f5d` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:02.511494 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61cec8-4199-42fc-a178-80851c16574d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eff38b1f989e483fa3e426cadc590f5d)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:02.513403 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a61cec8-4199-42fc-a178-80851c16574d admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:02.561995 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-7a61cec8-4199-42fc-a178-80851c16574d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eff38b1f989e483fa3e426cadc590f5d', 'request_id': 'req-7a61cec8-4199-42fc-a178-80851c16574d'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:02.570079 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-7a61cec8-4199-42fc-a178-80851c16574d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eff38b1f989e483fa3e426cadc590f5d', 'request_id': 'req-7a61cec8-4199-42fc-a178-80851c16574d'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:02.575318 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-7a61cec8-4199-42fc-a178-80851c16574d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eff38b1f989e483fa3e426cadc590f5d', 'request_id': 'req-7a61cec8-4199-42fc-a178-80851c16574d'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:02.586160 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-7a61cec8-4199-42fc-a178-80851c16574d admin admin] The token cache is being invalidate because project eff38b1f989e483fa3e426cadc590f5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:30:02.586450 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-7a61cec8-4199-42fc-a178-80851c16574d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:02.587092 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-7a61cec8-4199-42fc-a178-80851c16574d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:02.588645 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 991/1973] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:30:02 2021] DELETE /identity/v3/projects/eff38b1f989e483fa3e426cadc590f5d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:02.595766 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56e0f1-946c-4723-916d-9d28f99552b7 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:02.596123 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56e0f1-946c-4723-916d-9d28f99552b7 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:02.596489 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56e0f1-946c-4723-916d-9d28f99552b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:02.614672 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-1b56e0f1-946c-4723-916d-9d28f99552b7 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:02.615865 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-1b56e0f1-946c-4723-916d-9d28f99552b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:02.673347 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 983/1974] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:02.682260 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdec444-c01d-49d3-808e-1e7337c8059d None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:02.682550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdec444-c01d-49d3-808e-1e7337c8059d None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:02.682859 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdec444-c01d-49d3-808e-1e7337c8059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:02.701283 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-5fdec444-c01d-49d3-808e-1e7337c8059d None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:02.702532 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-5fdec444-c01d-49d3-808e-1e7337c8059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:02.710240 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 992/1975] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:02.714323 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56e0f1-946c-4723-916d-9d28f99552b7 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:02.724463 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56e0f1-946c-4723-916d-9d28f99552b7 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:02.728970 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661aeb9-e6e9-4d90-8eb6-38c1a03c9d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:02.729616 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661aeb9-e6e9-4d90-8eb6-38c1a03c9d99 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:02.729892 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661aeb9-e6e9-4d90-8eb6-38c1a03c9d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:02.730164 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661aeb9-e6e9-4d90-8eb6-38c1a03c9d99 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:02.730878 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661aeb9-e6e9-4d90-8eb6-38c1a03c9d99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:30:02.731180 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661aeb9-e6e9-4d90-8eb6-38c1a03c9d99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:02.732835 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f661aeb9-e6e9-4d90-8eb6-38c1a03c9d99 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:02.744491 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 984/1976] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:30:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:30:02.748564 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdec444-c01d-49d3-808e-1e7337c8059d None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:02.757492 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdec444-c01d-49d3-808e-1e7337c8059d None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:02.762196 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb159fe-b222-404f-948e-84c0348b4fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:02.762846 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb159fe-b222-404f-948e-84c0348b4fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:02.763135 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb159fe-b222-404f-948e-84c0348b4fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:02.763409 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb159fe-b222-404f-948e-84c0348b4fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:02.764126 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb159fe-b222-404f-948e-84c0348b4fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:02.766026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb159fe-b222-404f-948e-84c0348b4fa2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:02.791520 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 993/1977] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:30:02 2021] POST /identity/v3/projects => generated 367 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:30:02.798760 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661aeb9-e6e9-4d90-8eb6-38c1a03c9d99 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:02.809083 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661aeb9-e6e9-4d90-8eb6-38c1a03c9d99 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:02.863594 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bedd0-d7a4-437f-9d83-346a0acce47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:02.864271 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bedd0-d7a4-437f-9d83-346a0acce47e admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:02.864553 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bedd0-d7a4-437f-9d83-346a0acce47e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:02.864832 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bedd0-d7a4-437f-9d83-346a0acce47e admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:02.865555 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5bedd0-d7a4-437f-9d83-346a0acce47e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:02.867465 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5bedd0-d7a4-437f-9d83-346a0acce47e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:02.893336 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 985/1978] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:30:02 2021] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:30:02.897320 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb159fe-b222-404f-948e-84c0348b4fa2 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:02.907783 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb159fe-b222-404f-948e-84c0348b4fa2 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:02.912966 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af05aa-8193-4970-92ad-d7157ab6e25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:02.913759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af05aa-8193-4970-92ad-d7157ab6e25f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:02.914045 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af05aa-8193-4970-92ad-d7157ab6e25f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:02.914385 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af05aa-8193-4970-92ad-d7157ab6e25f admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:02.915201 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af05aa-8193-4970-92ad-d7157ab6e25f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:02.916963 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af05aa-8193-4970-92ad-d7157ab6e25f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:02.929298 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 994/1979] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:02 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:30:02.938697 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bedd0-d7a4-437f-9d83-346a0acce47e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:02.948390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bedd0-d7a4-437f-9d83-346a0acce47e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:02.953600 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6794d-5bab-4fec-93a7-df01fe5726a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:02.954267 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6794d-5bab-4fec-93a7-df01fe5726a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:02.954549 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6794d-5bab-4fec-93a7-df01fe5726a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:02.954829 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6794d-5bab-4fec-93a7-df01fe5726a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:02.955559 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6794d-5bab-4fec-93a7-df01fe5726a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:02.957193 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6794d-5bab-4fec-93a7-df01fe5726a1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:02.967138 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 986/1980] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:02 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:30:02.971462 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af05aa-8193-4970-92ad-d7157ab6e25f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:02.981032 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af05aa-8193-4970-92ad-d7157ab6e25f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:02.986036 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4daecf-4c24-4a2c-8330-97d709b8b487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:02.986907 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4daecf-4c24-4a2c-8330-97d709b8b487 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:02.987184 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4daecf-4c24-4a2c-8330-97d709b8b487 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:02.987455 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4daecf-4c24-4a2c-8330-97d709b8b487 admin admin] PATH_INFO: `/v3/projects/38cf0652e1fe4180a4118048486addcd/users/47ab437e51384b108fdee01c1bc9c7af/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:03.001664 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4daecf-4c24-4a2c-8330-97d709b8b487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38cf0652e1fe4180a4118048486addcd, user_id=47ab437e51384b108fdee01c1bc9c7af, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:03.004640 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4daecf-4c24-4a2c-8330-97d709b8b487 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:03.016334 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 995/1981] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:02 2021] PUT /identity/v3/projects/38cf0652e1fe4180a4118048486addcd/users/47ab437e51384b108fdee01c1bc9c7af/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:03.026356 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34ee1d-b4a3-4b07-85c4-8ca444d7fe40 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:03.026836 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34ee1d-b4a3-4b07-85c4-8ca444d7fe40 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:03.026922 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34ee1d-b4a3-4b07-85c4-8ca444d7fe40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:03.052847 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-1c34ee1d-b4a3-4b07-85c4-8ca444d7fe40 None None] MFA Rules not processed for user `47ab437e51384b108fdee01c1bc9c7af`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:03.054043 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-1c34ee1d-b4a3-4b07-85c4-8ca444d7fe40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:03.113816 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 987/1982] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:03 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:30:03.118129 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4daecf-4c24-4a2c-8330-97d709b8b487 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:03.179089 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4daecf-4c24-4a2c-8330-97d709b8b487 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:03.183715 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bad62c-1556-402d-9582-52c1afacfa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:03.184367 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bad62c-1556-402d-9582-52c1afacfa72 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:03.184653 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bad62c-1556-402d-9582-52c1afacfa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:03.184967 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bad62c-1556-402d-9582-52c1afacfa72 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:03.185686 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bad62c-1556-402d-9582-52c1afacfa72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:03.187564 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bad62c-1556-402d-9582-52c1afacfa72 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:03.215197 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 996/1983] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:30:03 2021] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:30:03.216423 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34ee1d-b4a3-4b07-85c4-8ca444d7fe40 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:03.228427 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34ee1d-b4a3-4b07-85c4-8ca444d7fe40 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:03.283148 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c550d4a-fb76-4196-b6fe-46653973a762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:03.283828 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c550d4a-fb76-4196-b6fe-46653973a762 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:03.284140 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c550d4a-fb76-4196-b6fe-46653973a762 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:03.284420 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c550d4a-fb76-4196-b6fe-46653973a762 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:03.285212 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c550d4a-fb76-4196-b6fe-46653973a762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:03.287234 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c550d4a-fb76-4196-b6fe-46653973a762 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:03.310636 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 988/1984] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:30:03 2021] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:30:03.311821 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bad62c-1556-402d-9582-52c1afacfa72 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:03.321967 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bad62c-1556-402d-9582-52c1afacfa72 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:03.326611 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea864a-6a4a-4cbb-b484-4e6a6d02caf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:03.327272 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea864a-6a4a-4cbb-b484-4e6a6d02caf8 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:03.327554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea864a-6a4a-4cbb-b484-4e6a6d02caf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:03.327824 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea864a-6a4a-4cbb-b484-4e6a6d02caf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:03.328565 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea864a-6a4a-4cbb-b484-4e6a6d02caf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:03.330206 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea864a-6a4a-4cbb-b484-4e6a6d02caf8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:03.340385 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 997/1985] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:03 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:30:03.344912 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c550d4a-fb76-4196-b6fe-46653973a762 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:03.354814 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c550d4a-fb76-4196-b6fe-46653973a762 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:03.359956 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02356626-13f6-400b-849d-d1540b814cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:03.360830 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02356626-13f6-400b-849d-d1540b814cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:03.361148 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02356626-13f6-400b-849d-d1540b814cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:03.361425 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02356626-13f6-400b-849d-d1540b814cbd admin admin] PATH_INFO: `/v3/projects/afcf63208e6f4d949c6f4c64f296c88a/users/943fd8129c774870a76bba86e0042395/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:03.375231 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02356626-13f6-400b-849d-d1540b814cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=afcf63208e6f4d949c6f4c64f296c88a, user_id=943fd8129c774870a76bba86e0042395, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:03.377907 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02356626-13f6-400b-849d-d1540b814cbd admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:03.390130 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 989/1986] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:03 2021] PUT /identity/v3/projects/afcf63208e6f4d949c6f4c64f296c88a/users/943fd8129c774870a76bba86e0042395/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:30:03.393986 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea864a-6a4a-4cbb-b484-4e6a6d02caf8 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:03.403700 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea864a-6a4a-4cbb-b484-4e6a6d02caf8 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:03.456784 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e410ccb-9da6-4ba1-bffa-a2795cba892f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:03.457408 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e410ccb-9da6-4ba1-bffa-a2795cba892f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:03.457693 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e410ccb-9da6-4ba1-bffa-a2795cba892f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:03.457973 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e410ccb-9da6-4ba1-bffa-a2795cba892f admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:03.458710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e410ccb-9da6-4ba1-bffa-a2795cba892f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:03.460285 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e410ccb-9da6-4ba1-bffa-a2795cba892f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:03.471015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 998/1987] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:03 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:30:03.476252 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02356626-13f6-400b-849d-d1540b814cbd admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:03.487319 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02356626-13f6-400b-849d-d1540b814cbd admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:03.491973 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf70171-707e-474a-b157-01d2d4233cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:03.492866 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf70171-707e-474a-b157-01d2d4233cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:03.493171 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf70171-707e-474a-b157-01d2d4233cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:03.493444 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf70171-707e-474a-b157-01d2d4233cd5 admin admin] PATH_INFO: `/v3/projects/afcf63208e6f4d949c6f4c64f296c88a/users/943fd8129c774870a76bba86e0042395/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:03.495376 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf70171-707e-474a-b157-01d2d4233cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afcf63208e6f4d949c6f4c64f296c88a, user_id=943fd8129c774870a76bba86e0042395, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:03.498028 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf70171-707e-474a-b157-01d2d4233cd5 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:03.507696 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 990/1988] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:03 2021] PUT /identity/v3/projects/afcf63208e6f4d949c6f4c64f296c88a/users/943fd8129c774870a76bba86e0042395/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:30:03.517586 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec02bf0-5cc6-4b3b-8e78-92d2724f80d7 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:03.517875 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec02bf0-5cc6-4b3b-8e78-92d2724f80d7 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:03.518152 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec02bf0-5cc6-4b3b-8e78-92d2724f80d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:03.543512 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-8ec02bf0-5cc6-4b3b-8e78-92d2724f80d7 None None] MFA Rules not processed for user `943fd8129c774870a76bba86e0042395`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:03.544703 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8ec02bf0-5cc6-4b3b-8e78-92d2724f80d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:03.610546 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 999/1989] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:03 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:03.620853 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf70171-707e-474a-b157-01d2d4233cd5 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:03.622600 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-faf70171-707e-474a-b157-01d2d4233cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:03.676589 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf70171-707e-474a-b157-01d2d4233cd5 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:03.680189 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31469f09-7365-439a-8ac5-c85dfdf0956c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:03.680818 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31469f09-7365-439a-8ac5-c85dfdf0956c service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:03.681143 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31469f09-7365-439a-8ac5-c85dfdf0956c service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:03.681417 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31469f09-7365-439a-8ac5-c85dfdf0956c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:03.690099 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31469f09-7365-439a-8ac5-c85dfdf0956c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:03.691813 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31469f09-7365-439a-8ac5-c85dfdf0956c service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:03.701141 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 991/1990] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:03 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:03.780512 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec02bf0-5cc6-4b3b-8e78-92d2724f80d7 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:03.789716 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec02bf0-5cc6-4b3b-8e78-92d2724f80d7 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:03.793356 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f9314-2616-4d26-b4a3-c1b083e2f319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:03.794001 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f9314-2616-4d26-b4a3-c1b083e2f319 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:03.794291 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f9314-2616-4d26-b4a3-c1b083e2f319 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:03.794569 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f9314-2616-4d26-b4a3-c1b083e2f319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:03.849669 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f9314-2616-4d26-b4a3-c1b083e2f319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:03.851095 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f9314-2616-4d26-b4a3-c1b083e2f319 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:03.859902 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1000/1991] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:03 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:09.939384 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a43e7f-acae-4bb3-b28c-1328083253c1 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:09.939992 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a43e7f-acae-4bb3-b28c-1328083253c1 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:09.939992 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a43e7f-acae-4bb3-b28c-1328083253c1 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:09.941919 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 992/1992] 10.222.0.32 () {54 vars in 921 bytes} [Wed Sep 15 02:30:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:30:09.948397 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e187dba-d902-473e-8de6-511e3e3e6278 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:09.948942 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e187dba-d902-473e-8de6-511e3e3e6278 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:09.949023 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e187dba-d902-473e-8de6-511e3e3e6278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:09.968589 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-1e187dba-d902-473e-8de6-511e3e3e6278 None None] MFA Rules not processed for user `797b76e6f16d428198e7f7f05c9c0fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:09.970327 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-1e187dba-d902-473e-8de6-511e3e3e6278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:10.050778 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1001/1993] 10.222.0.32 () {58 vars in 1019 bytes} [Wed Sep 15 02:30:09 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:30:10.065923 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a43e7f-acae-4bb3-b28c-1328083253c1 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:10.067746 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-23a43e7f-acae-4bb3-b28c-1328083253c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:10.085360 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a43e7f-acae-4bb3-b28c-1328083253c1 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:10.091397 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0bbb0-7b45-4a99-ba35-3e1d878ca30c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:10.092053 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0bbb0-7b45-4a99-ba35-3e1d878ca30c service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:10.092335 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0bbb0-7b45-4a99-ba35-3e1d878ca30c service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:10.093261 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0bbb0-7b45-4a99-ba35-3e1d878ca30c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:10.103358 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0bbb0-7b45-4a99-ba35-3e1d878ca30c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:10.105144 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0bbb0-7b45-4a99-ba35-3e1d878ca30c service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:10.116840 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 993/1994] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:10 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:10.269232 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e187dba-d902-473e-8de6-511e3e3e6278 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:10.271651 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-1e187dba-d902-473e-8de6-511e3e3e6278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:10.349894 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e187dba-d902-473e-8de6-511e3e3e6278 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:10.355009 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740da7b-5e00-482e-bce5-c92701829217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:10.355921 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740da7b-5e00-482e-bce5-c92701829217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:10.356269 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740da7b-5e00-482e-bce5-c92701829217 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:10.356554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740da7b-5e00-482e-bce5-c92701829217 admin admin] PATH_INFO: `/v3/users/fa48baa8567f4af9a06c503ae4af8beb` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:10.357756 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740da7b-5e00-482e-bce5-c92701829217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa48baa8567f4af9a06c503ae4af8beb)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:10.359807 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740da7b-5e00-482e-bce5-c92701829217 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:10.418990 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9740da7b-5e00-482e-bce5-c92701829217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa48baa8567f4af9a06c503ae4af8beb'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:10.419771 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9740da7b-5e00-482e-bce5-c92701829217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa48baa8567f4af9a06c503ae4af8beb'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:10.428412 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9740da7b-5e00-482e-bce5-c92701829217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa48baa8567f4af9a06c503ae4af8beb'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:10.429292 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9740da7b-5e00-482e-bce5-c92701829217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa48baa8567f4af9a06c503ae4af8beb'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:10.441402 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9740da7b-5e00-482e-bce5-c92701829217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa48baa8567f4af9a06c503ae4af8beb'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:10.459808 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1002/1995] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:30:10 2021] DELETE /identity/v3/users/fa48baa8567f4af9a06c503ae4af8beb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:10.459907 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c10a9d-5e9e-40b3-be8a-d95e1e657307 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:10.459907 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c10a9d-5e9e-40b3-be8a-d95e1e657307 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:10.459907 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c10a9d-5e9e-40b3-be8a-d95e1e657307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:10.479349 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-b4c10a9d-5e9e-40b3-be8a-d95e1e657307 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:10.480610 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b4c10a9d-5e9e-40b3-be8a-d95e1e657307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:10.676811 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 994/1996] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:10.691673 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740da7b-5e00-482e-bce5-c92701829217 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:10.693605 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-9740da7b-5e00-482e-bce5-c92701829217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:10.756094 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740da7b-5e00-482e-bce5-c92701829217 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:10.761123 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53769e-5515-4ff2-9b3f-db6eab883f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:10.761799 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53769e-5515-4ff2-9b3f-db6eab883f16 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:10.762105 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53769e-5515-4ff2-9b3f-db6eab883f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:10.762387 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53769e-5515-4ff2-9b3f-db6eab883f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:10.774444 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53769e-5515-4ff2-9b3f-db6eab883f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:10.776150 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53769e-5515-4ff2-9b3f-db6eab883f16 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:10.789886 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1003/1997] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:11.159955 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c10a9d-5e9e-40b3-be8a-d95e1e657307 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:11.161460 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b4c10a9d-5e9e-40b3-be8a-d95e1e657307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:11.175094 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c10a9d-5e9e-40b3-be8a-d95e1e657307 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:11.179590 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768c02e-1d95-4118-b08b-87ff8d38f0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:11.180440 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768c02e-1d95-4118-b08b-87ff8d38f0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:11.180712 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768c02e-1d95-4118-b08b-87ff8d38f0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:11.181013 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768c02e-1d95-4118-b08b-87ff8d38f0ce admin admin] PATH_INFO: `/v3/projects/246ee080ec4d4573903bdd704c84ed65` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:11.182500 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768c02e-1d95-4118-b08b-87ff8d38f0ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=246ee080ec4d4573903bdd704c84ed65)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:11.184251 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768c02e-1d95-4118-b08b-87ff8d38f0ce admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:11.230534 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2768c02e-1d95-4118-b08b-87ff8d38f0ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '246ee080ec4d4573903bdd704c84ed65', 'request_id': 'req-2768c02e-1d95-4118-b08b-87ff8d38f0ce'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:11.236859 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2768c02e-1d95-4118-b08b-87ff8d38f0ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '246ee080ec4d4573903bdd704c84ed65', 'request_id': 'req-2768c02e-1d95-4118-b08b-87ff8d38f0ce'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:11.243782 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2768c02e-1d95-4118-b08b-87ff8d38f0ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '246ee080ec4d4573903bdd704c84ed65', 'request_id': 'req-2768c02e-1d95-4118-b08b-87ff8d38f0ce'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:11.253961 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2768c02e-1d95-4118-b08b-87ff8d38f0ce admin admin] The token cache is being invalidate because project 246ee080ec4d4573903bdd704c84ed65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:30:11.254244 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2768c02e-1d95-4118-b08b-87ff8d38f0ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:11.254861 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2768c02e-1d95-4118-b08b-87ff8d38f0ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:11.256370 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 995/1998] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:30:11 2021] DELETE /identity/v3/projects/246ee080ec4d4573903bdd704c84ed65 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:11.261946 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99c707-24bb-478b-abe9-ee105ef25ebd None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:11.262439 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99c707-24bb-478b-abe9-ee105ef25ebd None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:11.262532 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99c707-24bb-478b-abe9-ee105ef25ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:11.279608 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-3d99c707-24bb-478b-abe9-ee105ef25ebd None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:11.280772 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-3d99c707-24bb-478b-abe9-ee105ef25ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:11.339013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1004/1999] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:11.346996 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619ab32-e00f-4eac-8c14-549341deea34 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:11.347366 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619ab32-e00f-4eac-8c14-549341deea34 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:11.347653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619ab32-e00f-4eac-8c14-549341deea34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:11.366475 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-4619ab32-e00f-4eac-8c14-549341deea34 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:11.367677 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4619ab32-e00f-4eac-8c14-549341deea34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:11.376313 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 996/2000] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:11.380458 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99c707-24bb-478b-abe9-ee105ef25ebd None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:11.390063 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99c707-24bb-478b-abe9-ee105ef25ebd None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:11.394766 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353303c-5be8-46ff-85dd-eb24cfe75247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:11.395460 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353303c-5be8-46ff-85dd-eb24cfe75247 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:11.395742 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353303c-5be8-46ff-85dd-eb24cfe75247 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:11.396014 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353303c-5be8-46ff-85dd-eb24cfe75247 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:11.396740 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353303c-5be8-46ff-85dd-eb24cfe75247 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:30:11.397076 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353303c-5be8-46ff-85dd-eb24cfe75247 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:11.398785 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353303c-5be8-46ff-85dd-eb24cfe75247 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:11.414972 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1005/2001] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:30:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:30:11.416371 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619ab32-e00f-4eac-8c14-549341deea34 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:11.427769 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619ab32-e00f-4eac-8c14-549341deea34 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:11.441333 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c3ec4-3dda-4cd1-b65c-8ca72acbafa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:11.442003 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c3ec4-3dda-4cd1-b65c-8ca72acbafa8 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:11.442285 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c3ec4-3dda-4cd1-b65c-8ca72acbafa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:11.442563 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c3ec4-3dda-4cd1-b65c-8ca72acbafa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:11.443268 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c3ec4-3dda-4cd1-b65c-8ca72acbafa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:11.445185 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c3ec4-3dda-4cd1-b65c-8ca72acbafa8 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:11.470549 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 997/2002] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:30:11 2021] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:30:11.474619 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353303c-5be8-46ff-85dd-eb24cfe75247 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:11.485197 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353303c-5be8-46ff-85dd-eb24cfe75247 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:11.536657 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f1eb6-4672-4c44-b2c6-856e936c85d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:11.537345 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f1eb6-4672-4c44-b2c6-856e936c85d8 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:11.537625 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f1eb6-4672-4c44-b2c6-856e936c85d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:11.537898 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f1eb6-4672-4c44-b2c6-856e936c85d8 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:11.538578 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f1eb6-4672-4c44-b2c6-856e936c85d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:11.540457 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f1eb6-4672-4c44-b2c6-856e936c85d8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:11.559505 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1006/2003] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:30:11 2021] POST /identity/v3/users => generated 287 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:30:11.563661 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c3ec4-3dda-4cd1-b65c-8ca72acbafa8 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:11.574198 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c3ec4-3dda-4cd1-b65c-8ca72acbafa8 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:11.578787 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb615625-6028-4706-8b1d-c03d5ccb1659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:11.579441 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb615625-6028-4706-8b1d-c03d5ccb1659 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:11.579721 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb615625-6028-4706-8b1d-c03d5ccb1659 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:11.579995 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb615625-6028-4706-8b1d-c03d5ccb1659 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:11.580713 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb615625-6028-4706-8b1d-c03d5ccb1659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:11.582328 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb615625-6028-4706-8b1d-c03d5ccb1659 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:11.592234 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 998/2004] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:11 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:30:11.596797 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f1eb6-4672-4c44-b2c6-856e936c85d8 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:11.606565 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f1eb6-4672-4c44-b2c6-856e936c85d8 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:11.611726 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ac517-f8b3-43b2-b924-1a7c7d6dbdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:11.612374 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ac517-f8b3-43b2-b924-1a7c7d6dbdfe admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:11.612657 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ac517-f8b3-43b2-b924-1a7c7d6dbdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:11.612962 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ac517-f8b3-43b2-b924-1a7c7d6dbdfe admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:11.613708 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ac517-f8b3-43b2-b924-1a7c7d6dbdfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:11.615535 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ac517-f8b3-43b2-b924-1a7c7d6dbdfe admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:11.625225 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1007/2005] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:11 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:30:11.629080 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb615625-6028-4706-8b1d-c03d5ccb1659 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:11.638548 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb615625-6028-4706-8b1d-c03d5ccb1659 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:11.643086 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54485847-4abc-4fd1-8852-a59c7ec09bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:11.643975 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54485847-4abc-4fd1-8852-a59c7ec09bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:11.644259 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54485847-4abc-4fd1-8852-a59c7ec09bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:11.644532 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54485847-4abc-4fd1-8852-a59c7ec09bf8 admin admin] PATH_INFO: `/v3/projects/e095af2da2b34e03b63dbdf57a25389d/users/3879810326344546ba8e000419b9f253/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:11.658722 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54485847-4abc-4fd1-8852-a59c7ec09bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e095af2da2b34e03b63dbdf57a25389d, user_id=3879810326344546ba8e000419b9f253, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:11.661370 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54485847-4abc-4fd1-8852-a59c7ec09bf8 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:11.673973 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 999/2006] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:11 2021] PUT /identity/v3/projects/e095af2da2b34e03b63dbdf57a25389d/users/3879810326344546ba8e000419b9f253/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:11.684661 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726a003-39ab-477e-ae56-ca7c0583c03a None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:11.684984 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726a003-39ab-477e-ae56-ca7c0583c03a None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:11.685263 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726a003-39ab-477e-ae56-ca7c0583c03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:11.710299 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-2726a003-39ab-477e-ae56-ca7c0583c03a None None] MFA Rules not processed for user `3879810326344546ba8e000419b9f253`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:11.711491 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-2726a003-39ab-477e-ae56-ca7c0583c03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:11.774224 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1008/2007] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:11 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:11.784381 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54485847-4abc-4fd1-8852-a59c7ec09bf8 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:11.786075 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-54485847-4abc-4fd1-8852-a59c7ec09bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:11.839655 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54485847-4abc-4fd1-8852-a59c7ec09bf8 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:11.843910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3593b-9ceb-4e58-802e-5b15615aefd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:11.844501 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3593b-9ceb-4e58-802e-5b15615aefd4 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:11.844781 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3593b-9ceb-4e58-802e-5b15615aefd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:11.845335 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3593b-9ceb-4e58-802e-5b15615aefd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:11.854414 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3593b-9ceb-4e58-802e-5b15615aefd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:11.855846 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3593b-9ceb-4e58-802e-5b15615aefd4 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:11.864871 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1000/2008] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:11 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:17.503810 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726a003-39ab-477e-ae56-ca7c0583c03a None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:17.508407 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726a003-39ab-477e-ae56-ca7c0583c03a None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:17.509968 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335814fd-b359-497b-81f3-de71d3105ca1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:17.510419 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed091d06-2e98-45c7-8775-9a9dce5cccbc None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:17.510889 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335814fd-b359-497b-81f3-de71d3105ca1 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:17.510985 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed091d06-2e98-45c7-8775-9a9dce5cccbc None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:17.511083 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335814fd-b359-497b-81f3-de71d3105ca1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:17.511172 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335814fd-b359-497b-81f3-de71d3105ca1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:17.511548 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed091d06-2e98-45c7-8775-9a9dce5cccbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:17.515558 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-335814fd-b359-497b-81f3-de71d3105ca1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:17.529958 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-ed091d06-2e98-45c7-8775-9a9dce5cccbc None None] MFA Rules not processed for user `3879810326344546ba8e000419b9f253`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:17.531186 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ed091d06-2e98-45c7-8775-9a9dce5cccbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:17.538290 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1001/2009] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:17 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:17.576181 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335814fd-b359-497b-81f3-de71d3105ca1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:17.578273 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335814fd-b359-497b-81f3-de71d3105ca1 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:17.588154 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1009/2010] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:17 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:17.732717 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed091d06-2e98-45c7-8775-9a9dce5cccbc None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:17.734799 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ed091d06-2e98-45c7-8775-9a9dce5cccbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:17.808913 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed091d06-2e98-45c7-8775-9a9dce5cccbc None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:17.814685 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf5d0a-962e-4a76-a1d5-f947450f5de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:17.815658 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf5d0a-962e-4a76-a1d5-f947450f5de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:17.816040 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf5d0a-962e-4a76-a1d5-f947450f5de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:17.816415 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf5d0a-962e-4a76-a1d5-f947450f5de0 admin admin] PATH_INFO: `/v3/users/1197cbb46ef741b1a2abc34f146eaea4` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:17.817933 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf5d0a-962e-4a76-a1d5-f947450f5de0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1197cbb46ef741b1a2abc34f146eaea4)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:17.820079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf5d0a-962e-4a76-a1d5-f947450f5de0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:17.891399 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2eaf5d0a-962e-4a76-a1d5-f947450f5de0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1197cbb46ef741b1a2abc34f146eaea4'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:17.903873 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2eaf5d0a-962e-4a76-a1d5-f947450f5de0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1197cbb46ef741b1a2abc34f146eaea4'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:17.905393 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2eaf5d0a-962e-4a76-a1d5-f947450f5de0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1197cbb46ef741b1a2abc34f146eaea4'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:17.914666 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2eaf5d0a-962e-4a76-a1d5-f947450f5de0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1197cbb46ef741b1a2abc34f146eaea4'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:17.923988 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2eaf5d0a-962e-4a76-a1d5-f947450f5de0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1197cbb46ef741b1a2abc34f146eaea4'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:17.931943 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1002/2011] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:30:17 2021] DELETE /identity/v3/users/1197cbb46ef741b1a2abc34f146eaea4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:17.936272 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93376130-1e6c-4266-a99e-79005658ff78 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:17.937384 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93376130-1e6c-4266-a99e-79005658ff78 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:17.937731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93376130-1e6c-4266-a99e-79005658ff78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:17.956584 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-93376130-1e6c-4266-a99e-79005658ff78 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:17.957607 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-93376130-1e6c-4266-a99e-79005658ff78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:18.054948 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1010/2012] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:18.066418 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf5d0a-962e-4a76-a1d5-f947450f5de0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:18.068101 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-2eaf5d0a-962e-4a76-a1d5-f947450f5de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:18.185528 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf5d0a-962e-4a76-a1d5-f947450f5de0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:18.204456 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92aa39-324b-4b69-81d7-96e3e51cc45d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:18.205326 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92aa39-324b-4b69-81d7-96e3e51cc45d service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:18.205671 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92aa39-324b-4b69-81d7-96e3e51cc45d service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:18.206089 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92aa39-324b-4b69-81d7-96e3e51cc45d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:18.232360 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92aa39-324b-4b69-81d7-96e3e51cc45d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:18.234353 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92aa39-324b-4b69-81d7-96e3e51cc45d service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:18.247450 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1003/2013] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:18.358092 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93376130-1e6c-4266-a99e-79005658ff78 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:18.359677 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-93376130-1e6c-4266-a99e-79005658ff78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:18.379271 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93376130-1e6c-4266-a99e-79005658ff78 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:18.387659 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1e372-c05c-4ef6-b674-919ae7050e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:18.388681 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1e372-c05c-4ef6-b674-919ae7050e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:18.389040 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1e372-c05c-4ef6-b674-919ae7050e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:18.389423 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1e372-c05c-4ef6-b674-919ae7050e59 admin admin] PATH_INFO: `/v3/users/47ab437e51384b108fdee01c1bc9c7af` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:18.391387 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1e372-c05c-4ef6-b674-919ae7050e59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47ab437e51384b108fdee01c1bc9c7af)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:18.393496 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1e372-c05c-4ef6-b674-919ae7050e59 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:18.498669 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-00e1e372-c05c-4ef6-b674-919ae7050e59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47ab437e51384b108fdee01c1bc9c7af'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:18.500411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-00e1e372-c05c-4ef6-b674-919ae7050e59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47ab437e51384b108fdee01c1bc9c7af'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:18.509989 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-00e1e372-c05c-4ef6-b674-919ae7050e59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47ab437e51384b108fdee01c1bc9c7af'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:18.511077 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-00e1e372-c05c-4ef6-b674-919ae7050e59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47ab437e51384b108fdee01c1bc9c7af'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:18.526780 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-00e1e372-c05c-4ef6-b674-919ae7050e59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47ab437e51384b108fdee01c1bc9c7af'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:18.551124 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1011/2014] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:30:18 2021] DELETE /identity/v3/users/47ab437e51384b108fdee01c1bc9c7af => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:18.555855 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fb967-0121-4740-90b4-973b259c2890 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:18.557280 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fb967-0121-4740-90b4-973b259c2890 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:18.558197 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fb967-0121-4740-90b4-973b259c2890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:18.580369 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-d84fb967-0121-4740-90b4-973b259c2890 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:18.581631 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d84fb967-0121-4740-90b4-973b259c2890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:18.640789 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1004/2015] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:18.650312 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1e372-c05c-4ef6-b674-919ae7050e59 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:18.651723 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-00e1e372-c05c-4ef6-b674-919ae7050e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:18.695076 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fb967-0121-4740-90b4-973b259c2890 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:18.696754 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d84fb967-0121-4740-90b4-973b259c2890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:18.711260 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fb967-0121-4740-90b4-973b259c2890 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:18.711694 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1e372-c05c-4ef6-b674-919ae7050e59 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:18.716375 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a9e71-75f3-4c67-9962-dbef3fcbd3ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:18.716575 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a3837b-3b33-484f-ab88-5cbd5283d15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:18.717071 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a9e71-75f3-4c67-9962-dbef3fcbd3ec service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:18.717358 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a9e71-75f3-4c67-9962-dbef3fcbd3ec service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:18.717687 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3837b-3b33-484f-ab88-5cbd5283d15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:18.717801 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a9e71-75f3-4c67-9962-dbef3fcbd3ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:18.717967 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3837b-3b33-484f-ab88-5cbd5283d15e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:18.718237 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a3837b-3b33-484f-ab88-5cbd5283d15e admin admin] PATH_INFO: `/v3/projects/a5a6ccd591fb4108ac68fe28f530354a` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:18.719946 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3837b-3b33-484f-ab88-5cbd5283d15e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5a6ccd591fb4108ac68fe28f530354a)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:18.721937 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a3837b-3b33-484f-ab88-5cbd5283d15e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:18.727891 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a9e71-75f3-4c67-9962-dbef3fcbd3ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:18.729331 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a9e71-75f3-4c67-9962-dbef3fcbd3ec service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:18.739369 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1012/2016] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:18.768011 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e9a3837b-3b33-484f-ab88-5cbd5283d15e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5a6ccd591fb4108ac68fe28f530354a', 'request_id': 'req-e9a3837b-3b33-484f-ab88-5cbd5283d15e'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:18.774076 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e9a3837b-3b33-484f-ab88-5cbd5283d15e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5a6ccd591fb4108ac68fe28f530354a', 'request_id': 'req-e9a3837b-3b33-484f-ab88-5cbd5283d15e'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:18.781322 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e9a3837b-3b33-484f-ab88-5cbd5283d15e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5a6ccd591fb4108ac68fe28f530354a', 'request_id': 'req-e9a3837b-3b33-484f-ab88-5cbd5283d15e'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:18.791424 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e9a3837b-3b33-484f-ab88-5cbd5283d15e admin admin] The token cache is being invalidate because project a5a6ccd591fb4108ac68fe28f530354a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:30:18.791704 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e9a3837b-3b33-484f-ab88-5cbd5283d15e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:18.792350 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e9a3837b-3b33-484f-ab88-5cbd5283d15e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:18.793937 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1005/2017] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:30:18 2021] DELETE /identity/v3/projects/a5a6ccd591fb4108ac68fe28f530354a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:18.801724 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bd31e-c0d2-4d63-af49-85861c77764f None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:18.802019 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bd31e-c0d2-4d63-af49-85861c77764f None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:18.802297 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bd31e-c0d2-4d63-af49-85861c77764f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:18.822901 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-a14bd31e-c0d2-4d63-af49-85861c77764f None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:18.824084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a14bd31e-c0d2-4d63-af49-85861c77764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:19.001505 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1013/2018] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:19.010740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7564ee-5c8a-4692-8c2b-977262fef99a None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:19.011114 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7564ee-5c8a-4692-8c2b-977262fef99a None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:19.011391 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7564ee-5c8a-4692-8c2b-977262fef99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:19.022197 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bd31e-c0d2-4d63-af49-85861c77764f None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:19.023579 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a14bd31e-c0d2-4d63-af49-85861c77764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:19.032110 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-7c7564ee-5c8a-4692-8c2b-977262fef99a None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:19.033321 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-7c7564ee-5c8a-4692-8c2b-977262fef99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:19.036534 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bd31e-c0d2-4d63-af49-85861c77764f None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:19.042189 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0e0c9-4161-4f06-9fbe-ebdd547c51d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:19.042335 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1006/2019] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:19.042894 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0e0c9-4161-4f06-9fbe-ebdd547c51d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:19.043175 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0e0c9-4161-4f06-9fbe-ebdd547c51d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:19.043444 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0e0c9-4161-4f06-9fbe-ebdd547c51d7 admin admin] PATH_INFO: `/v3/projects/38cf0652e1fe4180a4118048486addcd` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:19.044856 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0e0c9-4161-4f06-9fbe-ebdd547c51d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38cf0652e1fe4180a4118048486addcd)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:19.046246 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7564ee-5c8a-4692-8c2b-977262fef99a None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:19.047938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0e0c9-4161-4f06-9fbe-ebdd547c51d7 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:19.055834 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7564ee-5c8a-4692-8c2b-977262fef99a None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:19.065655 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c04ad-72a8-4e9a-b375-88e221f6368d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:19.066430 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c04ad-72a8-4e9a-b375-88e221f6368d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:19.066780 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c04ad-72a8-4e9a-b375-88e221f6368d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:19.067122 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c04ad-72a8-4e9a-b375-88e221f6368d admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:19.067955 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c04ad-72a8-4e9a-b375-88e221f6368d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:30:19.068359 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c04ad-72a8-4e9a-b375-88e221f6368d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:19.070159 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c04ad-72a8-4e9a-b375-88e221f6368d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:19.083110 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1007/2020] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:30:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:30:19.087361 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c04ad-72a8-4e9a-b375-88e221f6368d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:19.097460 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c04ad-72a8-4e9a-b375-88e221f6368d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:19.105878 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-f1b0e0c9-4161-4f06-9fbe-ebdd547c51d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38cf0652e1fe4180a4118048486addcd', 'request_id': 'req-f1b0e0c9-4161-4f06-9fbe-ebdd547c51d7'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:19.113986 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-f1b0e0c9-4161-4f06-9fbe-ebdd547c51d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38cf0652e1fe4180a4118048486addcd', 'request_id': 'req-f1b0e0c9-4161-4f06-9fbe-ebdd547c51d7'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:19.120123 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-f1b0e0c9-4161-4f06-9fbe-ebdd547c51d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38cf0652e1fe4180a4118048486addcd', 'request_id': 'req-f1b0e0c9-4161-4f06-9fbe-ebdd547c51d7'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:19.134279 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-f1b0e0c9-4161-4f06-9fbe-ebdd547c51d7 admin admin] The token cache is being invalidate because project 38cf0652e1fe4180a4118048486addcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:30:19.134589 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-f1b0e0c9-4161-4f06-9fbe-ebdd547c51d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:19.135347 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-f1b0e0c9-4161-4f06-9fbe-ebdd547c51d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:19.139960 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1014/2021] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:30:19 2021] DELETE /identity/v3/projects/38cf0652e1fe4180a4118048486addcd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:30:19.141778 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0e0c9-4161-4f06-9fbe-ebdd547c51d7 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:19.143113 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-f1b0e0c9-4161-4f06-9fbe-ebdd547c51d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:19.153536 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c16aab-0fda-4638-9e16-60029ebcf156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:19.154309 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c16aab-0fda-4638-9e16-60029ebcf156 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:19.154659 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c16aab-0fda-4638-9e16-60029ebcf156 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:19.155529 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c16aab-0fda-4638-9e16-60029ebcf156 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:19.156280 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c16aab-0fda-4638-9e16-60029ebcf156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:19.158290 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c16aab-0fda-4638-9e16-60029ebcf156 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:19.188800 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1008/2022] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:30:19 2021] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:30:19.190136 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c16aab-0fda-4638-9e16-60029ebcf156 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:19.191789 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d1c16aab-0fda-4638-9e16-60029ebcf156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:19.224723 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0e0c9-4161-4f06-9fbe-ebdd547c51d7 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:19.266551 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c16aab-0fda-4638-9e16-60029ebcf156 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:19.271459 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a4c12-c856-4cdd-a2ed-a417649b8ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:19.272160 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a4c12-c856-4cdd-a2ed-a417649b8ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:19.273519 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a4c12-c856-4cdd-a2ed-a417649b8ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:19.273519 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a4c12-c856-4cdd-a2ed-a417649b8ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:19.274312 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a4c12-c856-4cdd-a2ed-a417649b8ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:19.276259 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a4c12-c856-4cdd-a2ed-a417649b8ec3 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:19.292331 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cda5d-16b3-497e-b120-c30a732af8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:19.293244 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cda5d-16b3-497e-b120-c30a732af8b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:19.293522 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cda5d-16b3-497e-b120-c30a732af8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:19.293795 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cda5d-16b3-497e-b120-c30a732af8b6 admin admin] PATH_INFO: `/v3/users/943fd8129c774870a76bba86e0042395` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:19.295188 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cda5d-16b3-497e-b120-c30a732af8b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=943fd8129c774870a76bba86e0042395)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:19.297223 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2cda5d-16b3-497e-b120-c30a732af8b6 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:19.304038 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1009/2023] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:30:19 2021] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:30:19.308442 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a4c12-c856-4cdd-a2ed-a417649b8ec3 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:19.320229 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a4c12-c856-4cdd-a2ed-a417649b8ec3 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:19.325771 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad5ccd-db1b-4d05-9b9a-b32a0d98d800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:19.326585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad5ccd-db1b-4d05-9b9a-b32a0d98d800 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:19.327736 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad5ccd-db1b-4d05-9b9a-b32a0d98d800 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:19.328170 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad5ccd-db1b-4d05-9b9a-b32a0d98d800 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:19.328991 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad5ccd-db1b-4d05-9b9a-b32a0d98d800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:19.330747 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad5ccd-db1b-4d05-9b9a-b32a0d98d800 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:19.341235 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1010/2024] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:19 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:30:19.346884 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad5ccd-db1b-4d05-9b9a-b32a0d98d800 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:19.358184 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad5ccd-db1b-4d05-9b9a-b32a0d98d800 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:19.363776 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1657e2-cf97-488a-bcc1-ca35706dae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:19.364377 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ce2cda5d-16b3-497e-b120-c30a732af8b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '943fd8129c774870a76bba86e0042395'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:19.364554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1657e2-cf97-488a-bcc1-ca35706dae1d admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:19.365023 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1657e2-cf97-488a-bcc1-ca35706dae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:19.365172 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ce2cda5d-16b3-497e-b120-c30a732af8b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '943fd8129c774870a76bba86e0042395'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:19.365490 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1657e2-cf97-488a-bcc1-ca35706dae1d admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:19.366698 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1657e2-cf97-488a-bcc1-ca35706dae1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:19.368376 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1657e2-cf97-488a-bcc1-ca35706dae1d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:19.373710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ce2cda5d-16b3-497e-b120-c30a732af8b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '943fd8129c774870a76bba86e0042395'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:19.375122 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ce2cda5d-16b3-497e-b120-c30a732af8b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '943fd8129c774870a76bba86e0042395'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:19.379922 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1011/2025] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:19 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:30:19.384189 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1657e2-cf97-488a-bcc1-ca35706dae1d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:19.385901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-eb1657e2-cf97-488a-bcc1-ca35706dae1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:19.388608 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ce2cda5d-16b3-497e-b120-c30a732af8b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '943fd8129c774870a76bba86e0042395'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:19.401021 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1657e2-cf97-488a-bcc1-ca35706dae1d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:19.401759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1015/2026] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:30:19 2021] DELETE /identity/v3/users/943fd8129c774870a76bba86e0042395 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:19.462009 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609eeab-17da-40bf-b58c-220227769c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:19.463047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609eeab-17da-40bf-b58c-220227769c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:19.463332 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609eeab-17da-40bf-b58c-220227769c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:19.463609 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609eeab-17da-40bf-b58c-220227769c50 admin admin] PATH_INFO: `/v3/projects/8e744d217341431594415d27dc677212/users/04a00a7c706f455492d87c2d6419823d/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:19.480435 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609eeab-17da-40bf-b58c-220227769c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e744d217341431594415d27dc677212, user_id=04a00a7c706f455492d87c2d6419823d, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:19.483360 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609eeab-17da-40bf-b58c-220227769c50 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:19.498282 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1012/2027] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:19 2021] PUT /identity/v3/projects/8e744d217341431594415d27dc677212/users/04a00a7c706f455492d87c2d6419823d/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:30:19.504132 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aea43-2ff9-442d-8c0c-98bb0ce02476 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:19.504500 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aea43-2ff9-442d-8c0c-98bb0ce02476 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:19.504847 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0aea43-2ff9-442d-8c0c-98bb0ce02476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:19.523164 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-7a0aea43-2ff9-442d-8c0c-98bb0ce02476 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:19.524321 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7a0aea43-2ff9-442d-8c0c-98bb0ce02476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:19.587173 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1016/2028] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:19.595665 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609eeab-17da-40bf-b58c-220227769c50 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:19.597569 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-1609eeab-17da-40bf-b58c-220227769c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:19.653018 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609eeab-17da-40bf-b58c-220227769c50 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:19.656953 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518f533-0759-4aee-a794-0e372dacee9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:19.657550 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518f533-0759-4aee-a794-0e372dacee9f service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:19.657952 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518f533-0759-4aee-a794-0e372dacee9f service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:19.658235 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518f533-0759-4aee-a794-0e372dacee9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:19.668074 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518f533-0759-4aee-a794-0e372dacee9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:19.669302 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518f533-0759-4aee-a794-0e372dacee9f service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:19.679686 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1013/2029] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:19.781387 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0aea43-2ff9-442d-8c0c-98bb0ce02476 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:19.783274 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7a0aea43-2ff9-442d-8c0c-98bb0ce02476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:19.795431 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0aea43-2ff9-442d-8c0c-98bb0ce02476 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:19.800282 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe35661-73dc-4390-b3a4-9183c6f18189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:19.801177 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe35661-73dc-4390-b3a4-9183c6f18189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:19.801456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe35661-73dc-4390-b3a4-9183c6f18189 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:19.802004 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe35661-73dc-4390-b3a4-9183c6f18189 admin admin] PATH_INFO: `/v3/projects/afcf63208e6f4d949c6f4c64f296c88a` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:19.803566 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe35661-73dc-4390-b3a4-9183c6f18189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afcf63208e6f4d949c6f4c64f296c88a)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:19.805695 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe35661-73dc-4390-b3a4-9183c6f18189 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:19.854995 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-7fe35661-73dc-4390-b3a4-9183c6f18189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afcf63208e6f4d949c6f4c64f296c88a', 'request_id': 'req-7fe35661-73dc-4390-b3a4-9183c6f18189'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:19.862372 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-7fe35661-73dc-4390-b3a4-9183c6f18189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afcf63208e6f4d949c6f4c64f296c88a', 'request_id': 'req-7fe35661-73dc-4390-b3a4-9183c6f18189'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:19.869118 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-7fe35661-73dc-4390-b3a4-9183c6f18189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afcf63208e6f4d949c6f4c64f296c88a', 'request_id': 'req-7fe35661-73dc-4390-b3a4-9183c6f18189'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:19.882168 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-7fe35661-73dc-4390-b3a4-9183c6f18189 admin admin] The token cache is being invalidate because project afcf63208e6f4d949c6f4c64f296c88a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:30:19.882558 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-7fe35661-73dc-4390-b3a4-9183c6f18189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:19.883224 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-7fe35661-73dc-4390-b3a4-9183c6f18189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:19.884781 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1017/2030] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:30:19 2021] DELETE /identity/v3/projects/afcf63208e6f4d949c6f4c64f296c88a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:19.891622 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68d950-574f-45bd-8178-6a444e2652f6 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:19.891910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68d950-574f-45bd-8178-6a444e2652f6 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:19.892186 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68d950-574f-45bd-8178-6a444e2652f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:19.910089 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-7a68d950-574f-45bd-8178-6a444e2652f6 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:19.911290 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-7a68d950-574f-45bd-8178-6a444e2652f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:19.970222 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1014/2031] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:19.977732 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8e552-e85f-4af6-bded-aac1976f5a8f None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:19.978135 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8e552-e85f-4af6-bded-aac1976f5a8f None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:19.978544 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8e552-e85f-4af6-bded-aac1976f5a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:19.998628 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-11b8e552-e85f-4af6-bded-aac1976f5a8f None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:20.000431 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-11b8e552-e85f-4af6-bded-aac1976f5a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:20.010498 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1018/2032] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:20.015506 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68d950-574f-45bd-8178-6a444e2652f6 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:20.025965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68d950-574f-45bd-8178-6a444e2652f6 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:20.030821 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1810d0-8c6a-4ab4-9a3c-2647bad43c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:20.031484 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1810d0-8c6a-4ab4-9a3c-2647bad43c91 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:20.031764 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1810d0-8c6a-4ab4-9a3c-2647bad43c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:20.032192 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1810d0-8c6a-4ab4-9a3c-2647bad43c91 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:20.032984 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1810d0-8c6a-4ab4-9a3c-2647bad43c91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:30:20.033286 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1810d0-8c6a-4ab4-9a3c-2647bad43c91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:20.034879 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1810d0-8c6a-4ab4-9a3c-2647bad43c91 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:20.048046 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1015/2033] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:30:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:30:20.052012 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8e552-e85f-4af6-bded-aac1976f5a8f None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:20.062236 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8e552-e85f-4af6-bded-aac1976f5a8f None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:20.067281 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211662af-f03f-449b-97ff-145854bb0b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:20.068021 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211662af-f03f-449b-97ff-145854bb0b21 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:20.068374 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211662af-f03f-449b-97ff-145854bb0b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:20.068856 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211662af-f03f-449b-97ff-145854bb0b21 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:20.069647 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211662af-f03f-449b-97ff-145854bb0b21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:20.071608 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211662af-f03f-449b-97ff-145854bb0b21 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:20.098610 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1019/2034] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:30:20 2021] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:30:20.102702 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1810d0-8c6a-4ab4-9a3c-2647bad43c91 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:20.113313 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1810d0-8c6a-4ab4-9a3c-2647bad43c91 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:20.169156 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849de54-70d6-4d65-b4df-e4342cb64980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:20.169835 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849de54-70d6-4d65-b4df-e4342cb64980 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:20.170120 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849de54-70d6-4d65-b4df-e4342cb64980 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:20.170396 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849de54-70d6-4d65-b4df-e4342cb64980 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:20.171609 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849de54-70d6-4d65-b4df-e4342cb64980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:20.173557 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849de54-70d6-4d65-b4df-e4342cb64980 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:20.194156 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1016/2035] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:30:20 2021] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:30:20.198132 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211662af-f03f-449b-97ff-145854bb0b21 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:20.208271 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211662af-f03f-449b-97ff-145854bb0b21 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:20.212912 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa910f-797f-4392-a503-2f9b593bbff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:20.213610 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa910f-797f-4392-a503-2f9b593bbff1 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:20.213944 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa910f-797f-4392-a503-2f9b593bbff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:20.214233 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa910f-797f-4392-a503-2f9b593bbff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:20.215097 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa910f-797f-4392-a503-2f9b593bbff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:20.216553 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa910f-797f-4392-a503-2f9b593bbff1 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:20.233688 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849de54-70d6-4d65-b4df-e4342cb64980 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:20.234921 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1020/2036] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:20 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:30:20.256434 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849de54-70d6-4d65-b4df-e4342cb64980 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:20.279610 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940505d-d7cc-47e0-ae82-c180f508592c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:20.280316 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940505d-d7cc-47e0-ae82-c180f508592c admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:20.280611 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940505d-d7cc-47e0-ae82-c180f508592c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:20.280932 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940505d-d7cc-47e0-ae82-c180f508592c admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:20.281653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940505d-d7cc-47e0-ae82-c180f508592c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:20.285623 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940505d-d7cc-47e0-ae82-c180f508592c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:20.303574 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1017/2037] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:20 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:30:20.309763 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa910f-797f-4392-a503-2f9b593bbff1 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:20.330272 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa910f-797f-4392-a503-2f9b593bbff1 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:20.353429 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f302a2d-e5e1-4b52-bca5-5e3ca696ba99 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:20.353938 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f302a2d-e5e1-4b52-bca5-5e3ca696ba99 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:20.355095 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f302a2d-e5e1-4b52-bca5-5e3ca696ba99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:20.358571 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7a269-67e2-417e-977c-c673571da1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:20.361565 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7a269-67e2-417e-977c-c673571da1cc admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:20.361923 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7a269-67e2-417e-977c-c673571da1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:20.362274 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7a269-67e2-417e-977c-c673571da1cc admin admin] PATH_INFO: `/v3/projects/937cafa2ddd247a4b56fb1f4d915b6ba/users/257eb0a43dad490a988d37150655c50a/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:20.404682 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-0f302a2d-e5e1-4b52-bca5-5e3ca696ba99 None None] MFA Rules not processed for user `04a00a7c706f455492d87c2d6419823d`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:20.405889 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7a269-67e2-417e-977c-c673571da1cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=937cafa2ddd247a4b56fb1f4d915b6ba, user_id=257eb0a43dad490a988d37150655c50a, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:20.409046 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7a269-67e2-417e-977c-c673571da1cc admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:20.409981 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-0f302a2d-e5e1-4b52-bca5-5e3ca696ba99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:20.438134 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1021/2038] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:20 2021] PUT /identity/v3/projects/937cafa2ddd247a4b56fb1f4d915b6ba/users/257eb0a43dad490a988d37150655c50a/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:20.443883 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786aea18-9ccf-4471-b033-f4560b30e8b5 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:20.444407 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786aea18-9ccf-4471-b033-f4560b30e8b5 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:20.444939 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786aea18-9ccf-4471-b033-f4560b30e8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:20.487607 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-786aea18-9ccf-4471-b033-f4560b30e8b5 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:20.489750 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-786aea18-9ccf-4471-b033-f4560b30e8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:20.532842 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1018/2039] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:20 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:30:20.543756 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f302a2d-e5e1-4b52-bca5-5e3ca696ba99 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:20.546761 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-0f302a2d-e5e1-4b52-bca5-5e3ca696ba99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:20.620517 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f302a2d-e5e1-4b52-bca5-5e3ca696ba99 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:20.646456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1022/2040] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:30:20.666194 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786aea18-9ccf-4471-b033-f4560b30e8b5 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:20.671480 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-786aea18-9ccf-4471-b033-f4560b30e8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:20.748307 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666a326-af63-4ef0-8a05-4278b475b02b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:20.749624 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666a326-af63-4ef0-8a05-4278b475b02b service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:20.750062 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666a326-af63-4ef0-8a05-4278b475b02b service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:20.750828 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666a326-af63-4ef0-8a05-4278b475b02b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:20.829482 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786aea18-9ccf-4471-b033-f4560b30e8b5 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:20.838294 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac2fe2-9bd3-4d68-a4ae-25331b2e9189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:20.839066 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac2fe2-9bd3-4d68-a4ae-25331b2e9189 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:20.839346 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac2fe2-9bd3-4d68-a4ae-25331b2e9189 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:20.839613 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac2fe2-9bd3-4d68-a4ae-25331b2e9189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:20.857242 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac2fe2-9bd3-4d68-a4ae-25331b2e9189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:20.859792 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac2fe2-9bd3-4d68-a4ae-25331b2e9189 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:20.866181 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666a326-af63-4ef0-8a05-4278b475b02b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:20.867817 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1666a326-af63-4ef0-8a05-4278b475b02b service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:20.882891 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1023/2041] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:20.893949 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1019/2042] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:20 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:21.552497 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f768263-201c-46fe-a7f2-16e0623f56fe None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:21.552854 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f768263-201c-46fe-a7f2-16e0623f56fe None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:21.553160 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f768263-201c-46fe-a7f2-16e0623f56fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:21.584270 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-5f768263-201c-46fe-a7f2-16e0623f56fe None None] MFA Rules not processed for user `257eb0a43dad490a988d37150655c50a`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:21.585510 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-5f768263-201c-46fe-a7f2-16e0623f56fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:21.669393 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1024/2043] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:21 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:21.674575 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666a326-af63-4ef0-8a05-4278b475b02b service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:21.695957 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666a326-af63-4ef0-8a05-4278b475b02b service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:21.701201 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30874172-d6db-469f-b959-5f906ad8d1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:21.701908 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30874172-d6db-469f-b959-5f906ad8d1cc admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:21.702368 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30874172-d6db-469f-b959-5f906ad8d1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:21.702649 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30874172-d6db-469f-b959-5f906ad8d1cc admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:21.703395 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30874172-d6db-469f-b959-5f906ad8d1cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:21.705346 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30874172-d6db-469f-b959-5f906ad8d1cc admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:21.735528 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1020/2044] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:30:21 2021] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:30:21.736708 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f768263-201c-46fe-a7f2-16e0623f56fe None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:21.746963 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f768263-201c-46fe-a7f2-16e0623f56fe None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:21.802050 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8b3c9-9f10-4457-9ba7-35cbd3dbd29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:21.802755 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8b3c9-9f10-4457-9ba7-35cbd3dbd29f admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:21.803034 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8b3c9-9f10-4457-9ba7-35cbd3dbd29f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:21.803311 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8b3c9-9f10-4457-9ba7-35cbd3dbd29f admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:21.804020 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8b3c9-9f10-4457-9ba7-35cbd3dbd29f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:21.806024 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8b3c9-9f10-4457-9ba7-35cbd3dbd29f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:21.827071 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1025/2045] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:30:21 2021] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:30:21.831100 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30874172-d6db-469f-b959-5f906ad8d1cc admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:21.843518 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30874172-d6db-469f-b959-5f906ad8d1cc admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:21.849756 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab585cf8-86cf-4b98-96da-6690d70f3951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:21.850489 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab585cf8-86cf-4b98-96da-6690d70f3951 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:21.850860 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab585cf8-86cf-4b98-96da-6690d70f3951 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:21.851199 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab585cf8-86cf-4b98-96da-6690d70f3951 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:21.851993 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab585cf8-86cf-4b98-96da-6690d70f3951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:21.853689 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab585cf8-86cf-4b98-96da-6690d70f3951 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:21.867813 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1021/2046] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:21 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:30:21.869025 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8b3c9-9f10-4457-9ba7-35cbd3dbd29f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:21.878894 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8b3c9-9f10-4457-9ba7-35cbd3dbd29f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:21.883665 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17c6f1-33a2-4221-8838-e7469db4ec55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:21.884639 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17c6f1-33a2-4221-8838-e7469db4ec55 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:21.885025 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17c6f1-33a2-4221-8838-e7469db4ec55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:21.885370 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17c6f1-33a2-4221-8838-e7469db4ec55 admin admin] PATH_INFO: `/v3/projects/2bd34824cbfa4dafb8f1f5f3ef8b83ea/users/004d3ba8be64422c8c0731fd3e92b656/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:21.900905 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17c6f1-33a2-4221-8838-e7469db4ec55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd34824cbfa4dafb8f1f5f3ef8b83ea, user_id=004d3ba8be64422c8c0731fd3e92b656, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:21.903861 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17c6f1-33a2-4221-8838-e7469db4ec55 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:21.920463 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1026/2047] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:21 2021] PUT /identity/v3/projects/2bd34824cbfa4dafb8f1f5f3ef8b83ea/users/004d3ba8be64422c8c0731fd3e92b656/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:30:21.925128 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab585cf8-86cf-4b98-96da-6690d70f3951 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:21.935404 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab585cf8-86cf-4b98-96da-6690d70f3951 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:21.996938 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bb468-b41f-4060-a5b2-2b7a74095480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:21.997678 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bb468-b41f-4060-a5b2-2b7a74095480 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:21.998025 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bb468-b41f-4060-a5b2-2b7a74095480 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:21.998379 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bb468-b41f-4060-a5b2-2b7a74095480 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:21.999208 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24bb468-b41f-4060-a5b2-2b7a74095480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:22.000846 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24bb468-b41f-4060-a5b2-2b7a74095480 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:22.011400 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1022/2048] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:21 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:30:22.015700 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17c6f1-33a2-4221-8838-e7469db4ec55 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:22.026170 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17c6f1-33a2-4221-8838-e7469db4ec55 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:22.031445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c2729-6e06-4311-92e8-bbbf1284dc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:22.032326 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c2729-6e06-4311-92e8-bbbf1284dc1e admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:22.032601 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c2729-6e06-4311-92e8-bbbf1284dc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:22.032870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c2729-6e06-4311-92e8-bbbf1284dc1e admin admin] PATH_INFO: `/v3/projects/2bd34824cbfa4dafb8f1f5f3ef8b83ea/users/004d3ba8be64422c8c0731fd3e92b656/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:22.034832 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c2729-6e06-4311-92e8-bbbf1284dc1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd34824cbfa4dafb8f1f5f3ef8b83ea, user_id=004d3ba8be64422c8c0731fd3e92b656, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:22.037462 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c2729-6e06-4311-92e8-bbbf1284dc1e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:22.048450 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1027/2049] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:22 2021] PUT /identity/v3/projects/2bd34824cbfa4dafb8f1f5f3ef8b83ea/users/004d3ba8be64422c8c0731fd3e92b656/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:22.730208 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f105d55-0fcf-4837-b3ab-702fe9a7cafe None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:22.730686 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f105d55-0fcf-4837-b3ab-702fe9a7cafe None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:22.730769 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f105d55-0fcf-4837-b3ab-702fe9a7cafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:22.767289 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-2f105d55-0fcf-4837-b3ab-702fe9a7cafe None None] MFA Rules not processed for user `004d3ba8be64422c8c0731fd3e92b656`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:22.768818 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-2f105d55-0fcf-4837-b3ab-702fe9a7cafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:22.849004 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1023/2050] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:22 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:22.860904 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c2729-6e06-4311-92e8-bbbf1284dc1e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:22.862789 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-992c2729-6e06-4311-92e8-bbbf1284dc1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:22.920036 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c2729-6e06-4311-92e8-bbbf1284dc1e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:22.923684 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cf536-2cfe-4db6-afa1-ab3bd80d516b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:22.924323 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cf536-2cfe-4db6-afa1-ab3bd80d516b service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:22.924604 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cf536-2cfe-4db6-afa1-ab3bd80d516b service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:22.924890 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cf536-2cfe-4db6-afa1-ab3bd80d516b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:22.979778 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cf536-2cfe-4db6-afa1-ab3bd80d516b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:22.981242 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cf536-2cfe-4db6-afa1-ab3bd80d516b service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:22.990170 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1028/2051] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:22 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:25.438281 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f105d55-0fcf-4837-b3ab-702fe9a7cafe None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:25.449378 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f105d55-0fcf-4837-b3ab-702fe9a7cafe None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:25.454313 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8d83c-ba95-4465-97d9-841ed35791d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:25.455075 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8d83c-ba95-4465-97d9-841ed35791d7 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:25.455432 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8d83c-ba95-4465-97d9-841ed35791d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:25.455781 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8d83c-ba95-4465-97d9-841ed35791d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:25.469246 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8d83c-ba95-4465-97d9-841ed35791d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:25.473940 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af8d83c-ba95-4465-97d9-841ed35791d7 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:25.476496 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a0e85-3dd4-4f39-a095-cbcbc33ea5a7 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:25.477330 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a0e85-3dd4-4f39-a095-cbcbc33ea5a7 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:25.477755 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a0e85-3dd4-4f39-a095-cbcbc33ea5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:25.485270 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1024/2052] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:25 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:25.510710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-6c5a0e85-3dd4-4f39-a095-cbcbc33ea5a7 None None] MFA Rules not processed for user `04a00a7c706f455492d87c2d6419823d`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:25.511887 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-6c5a0e85-3dd4-4f39-a095-cbcbc33ea5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:25.585015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1029/2053] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:25 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:26.582369 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8d83c-ba95-4465-97d9-841ed35791d7 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:26.584699 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-1af8d83c-ba95-4465-97d9-841ed35791d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:26.775006 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8d83c-ba95-4465-97d9-841ed35791d7 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:26.782518 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71147751-619a-4945-b9a0-06a996c32c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:26.783555 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71147751-619a-4945-b9a0-06a996c32c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:26.783988 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71147751-619a-4945-b9a0-06a996c32c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:26.784414 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71147751-619a-4945-b9a0-06a996c32c64 admin admin] PATH_INFO: `/v3/users/cec5c7a363c64b839599e567ad5814f9` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:26.785829 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71147751-619a-4945-b9a0-06a996c32c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec5c7a363c64b839599e567ad5814f9)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:26.789326 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71147751-619a-4945-b9a0-06a996c32c64 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:26.864542 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-71147751-619a-4945-b9a0-06a996c32c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec5c7a363c64b839599e567ad5814f9'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:26.902370 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-71147751-619a-4945-b9a0-06a996c32c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec5c7a363c64b839599e567ad5814f9'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:26.906194 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-71147751-619a-4945-b9a0-06a996c32c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec5c7a363c64b839599e567ad5814f9'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:26.923957 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-71147751-619a-4945-b9a0-06a996c32c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec5c7a363c64b839599e567ad5814f9'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:26.947494 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-71147751-619a-4945-b9a0-06a996c32c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec5c7a363c64b839599e567ad5814f9'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:26.956930 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1025/2054] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:30:26 2021] DELETE /identity/v3/users/cec5c7a363c64b839599e567ad5814f9 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:26.974368 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9de8a9-3dd9-421b-ae0b-ce56a6611973 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:26.974940 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9de8a9-3dd9-421b-ae0b-ce56a6611973 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:26.974940 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9de8a9-3dd9-421b-ae0b-ce56a6611973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:27.017421 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-5c9de8a9-3dd9-421b-ae0b-ce56a6611973 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:27.018941 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-5c9de8a9-3dd9-421b-ae0b-ce56a6611973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:27.089658 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1030/2055] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:27.101057 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71147751-619a-4945-b9a0-06a996c32c64 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:27.104539 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-71147751-619a-4945-b9a0-06a996c32c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:27.181264 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71147751-619a-4945-b9a0-06a996c32c64 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:27.189057 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd388a0-3de1-4634-92da-85c9eef49709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:27.189879 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd388a0-3de1-4634-92da-85c9eef49709 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:27.190169 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd388a0-3de1-4634-92da-85c9eef49709 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:27.190836 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd388a0-3de1-4634-92da-85c9eef49709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:27.202522 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd388a0-3de1-4634-92da-85c9eef49709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:27.204759 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd388a0-3de1-4634-92da-85c9eef49709 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:27.227592 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1026/2056] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:28.065498 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9de8a9-3dd9-421b-ae0b-ce56a6611973 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:28.067183 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-5c9de8a9-3dd9-421b-ae0b-ce56a6611973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:28.080529 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9de8a9-3dd9-421b-ae0b-ce56a6611973 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:28.085419 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2477833-775f-4e3c-9f29-b09d39f798ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:28.086271 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2477833-775f-4e3c-9f29-b09d39f798ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:28.086548 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2477833-775f-4e3c-9f29-b09d39f798ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:28.086817 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2477833-775f-4e3c-9f29-b09d39f798ce admin admin] PATH_INFO: `/v3/projects/e945c1104b7b45a49d5f51ac38675276` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:28.088030 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2477833-775f-4e3c-9f29-b09d39f798ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=e945c1104b7b45a49d5f51ac38675276)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:28.089952 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2477833-775f-4e3c-9f29-b09d39f798ce admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:28.135016 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a2477833-775f-4e3c-9f29-b09d39f798ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e945c1104b7b45a49d5f51ac38675276', 'request_id': 'req-a2477833-775f-4e3c-9f29-b09d39f798ce'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:28.143013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a2477833-775f-4e3c-9f29-b09d39f798ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e945c1104b7b45a49d5f51ac38675276', 'request_id': 'req-a2477833-775f-4e3c-9f29-b09d39f798ce'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:28.148743 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a2477833-775f-4e3c-9f29-b09d39f798ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e945c1104b7b45a49d5f51ac38675276', 'request_id': 'req-a2477833-775f-4e3c-9f29-b09d39f798ce'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:28.159828 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a2477833-775f-4e3c-9f29-b09d39f798ce admin admin] The token cache is being invalidate because project e945c1104b7b45a49d5f51ac38675276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:30:28.160119 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a2477833-775f-4e3c-9f29-b09d39f798ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:28.160758 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a2477833-775f-4e3c-9f29-b09d39f798ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:28.162301 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1031/2057] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:30:28 2021] DELETE /identity/v3/projects/e945c1104b7b45a49d5f51ac38675276 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:28.166356 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd388a0-3de1-4634-92da-85c9eef49709 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:28.177273 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd388a0-3de1-4634-92da-85c9eef49709 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:28.242147 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da07b1-bc55-42af-ab8d-45c7a7ee331a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:28.244308 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da07b1-bc55-42af-ab8d-45c7a7ee331a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:28.244308 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da07b1-bc55-42af-ab8d-45c7a7ee331a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:28.244308 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da07b1-bc55-42af-ab8d-45c7a7ee331a admin admin] PATH_INFO: `/v3/users/9e59c15599e74c2193bc771ad82cc079` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:28.245894 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da07b1-bc55-42af-ab8d-45c7a7ee331a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e59c15599e74c2193bc771ad82cc079)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:28.248126 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da07b1-bc55-42af-ab8d-45c7a7ee331a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:28.317320 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-07da07b1-bc55-42af-ab8d-45c7a7ee331a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e59c15599e74c2193bc771ad82cc079'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:28.329176 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-07da07b1-bc55-42af-ab8d-45c7a7ee331a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e59c15599e74c2193bc771ad82cc079'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:28.329886 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-07da07b1-bc55-42af-ab8d-45c7a7ee331a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e59c15599e74c2193bc771ad82cc079'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:28.339101 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-07da07b1-bc55-42af-ab8d-45c7a7ee331a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e59c15599e74c2193bc771ad82cc079'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:28.347821 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-07da07b1-bc55-42af-ab8d-45c7a7ee331a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e59c15599e74c2193bc771ad82cc079'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:28.354552 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1027/2058] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:30:28 2021] DELETE /identity/v3/users/9e59c15599e74c2193bc771ad82cc079 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:28.687935 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2477833-775f-4e3c-9f29-b09d39f798ce admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:28.689586 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a2477833-775f-4e3c-9f29-b09d39f798ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:28.703846 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2477833-775f-4e3c-9f29-b09d39f798ce admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:28.777359 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7e64e-fc2a-49f6-9eeb-5e563db4cbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:28.778226 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7e64e-fc2a-49f6-9eeb-5e563db4cbb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:28.778507 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7e64e-fc2a-49f6-9eeb-5e563db4cbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:28.778783 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7e64e-fc2a-49f6-9eeb-5e563db4cbb5 admin admin] PATH_INFO: `/v3/projects/dd5b95935a5445848545622692d6d72d` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:28.780036 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7e64e-fc2a-49f6-9eeb-5e563db4cbb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5b95935a5445848545622692d6d72d)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:28.781948 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7e64e-fc2a-49f6-9eeb-5e563db4cbb5 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:28.835780 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-3db7e64e-fc2a-49f6-9eeb-5e563db4cbb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5b95935a5445848545622692d6d72d', 'request_id': 'req-3db7e64e-fc2a-49f6-9eeb-5e563db4cbb5'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:28.844056 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-3db7e64e-fc2a-49f6-9eeb-5e563db4cbb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5b95935a5445848545622692d6d72d', 'request_id': 'req-3db7e64e-fc2a-49f6-9eeb-5e563db4cbb5'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:28.850333 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-3db7e64e-fc2a-49f6-9eeb-5e563db4cbb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5b95935a5445848545622692d6d72d', 'request_id': 'req-3db7e64e-fc2a-49f6-9eeb-5e563db4cbb5'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:28.861803 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-3db7e64e-fc2a-49f6-9eeb-5e563db4cbb5 admin admin] The token cache is being invalidate because project dd5b95935a5445848545622692d6d72d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:30:28.862180 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-3db7e64e-fc2a-49f6-9eeb-5e563db4cbb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:28.862917 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-3db7e64e-fc2a-49f6-9eeb-5e563db4cbb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:28.864527 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1032/2059] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:30:28 2021] DELETE /identity/v3/projects/dd5b95935a5445848545622692d6d72d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:28.868649 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da07b1-bc55-42af-ab8d-45c7a7ee331a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:28.870252 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-07da07b1-bc55-42af-ab8d-45c7a7ee331a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:28.885373 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da07b1-bc55-42af-ab8d-45c7a7ee331a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:28.954902 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd75f9c-7948-4b84-ba40-f56a59b10ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:28.955964 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd75f9c-7948-4b84-ba40-f56a59b10ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:28.956372 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd75f9c-7948-4b84-ba40-f56a59b10ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:28.956722 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd75f9c-7948-4b84-ba40-f56a59b10ba6 admin admin] PATH_INFO: `/v3/users/08dd467006ab48a18ef6c6ecafa472f8` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:28.958120 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd75f9c-7948-4b84-ba40-f56a59b10ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08dd467006ab48a18ef6c6ecafa472f8)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:28.960228 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd75f9c-7948-4b84-ba40-f56a59b10ba6 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:29.017959 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5cd75f9c-7948-4b84-ba40-f56a59b10ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08dd467006ab48a18ef6c6ecafa472f8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:29.029752 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5cd75f9c-7948-4b84-ba40-f56a59b10ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08dd467006ab48a18ef6c6ecafa472f8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:29.030458 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5cd75f9c-7948-4b84-ba40-f56a59b10ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08dd467006ab48a18ef6c6ecafa472f8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:29.043145 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5cd75f9c-7948-4b84-ba40-f56a59b10ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08dd467006ab48a18ef6c6ecafa472f8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:29.053016 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5cd75f9c-7948-4b84-ba40-f56a59b10ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08dd467006ab48a18ef6c6ecafa472f8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:29.062760 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1028/2060] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:30:28 2021] DELETE /identity/v3/users/08dd467006ab48a18ef6c6ecafa472f8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:29.356239 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7e64e-fc2a-49f6-9eeb-5e563db4cbb5 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:29.358969 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-3db7e64e-fc2a-49f6-9eeb-5e563db4cbb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:29.380290 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7e64e-fc2a-49f6-9eeb-5e563db4cbb5 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:29.442390 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26c09f-9047-4235-bf55-3b3aee69ffce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:29.443277 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26c09f-9047-4235-bf55-3b3aee69ffce admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:29.443557 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26c09f-9047-4235-bf55-3b3aee69ffce admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:29.443837 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26c09f-9047-4235-bf55-3b3aee69ffce admin admin] PATH_INFO: `/v3/projects/e6de50d6ace14f8d9ba0c3ea50ab4462` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:29.445056 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26c09f-9047-4235-bf55-3b3aee69ffce admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6de50d6ace14f8d9ba0c3ea50ab4462)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:29.446943 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26c09f-9047-4235-bf55-3b3aee69ffce admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:29.499695 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-dd26c09f-9047-4235-bf55-3b3aee69ffce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6de50d6ace14f8d9ba0c3ea50ab4462', 'request_id': 'req-dd26c09f-9047-4235-bf55-3b3aee69ffce'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:29.506818 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-dd26c09f-9047-4235-bf55-3b3aee69ffce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6de50d6ace14f8d9ba0c3ea50ab4462', 'request_id': 'req-dd26c09f-9047-4235-bf55-3b3aee69ffce'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:29.512149 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-dd26c09f-9047-4235-bf55-3b3aee69ffce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6de50d6ace14f8d9ba0c3ea50ab4462', 'request_id': 'req-dd26c09f-9047-4235-bf55-3b3aee69ffce'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:29.522725 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-dd26c09f-9047-4235-bf55-3b3aee69ffce admin admin] The token cache is being invalidate because project e6de50d6ace14f8d9ba0c3ea50ab4462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:30:29.523010 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-dd26c09f-9047-4235-bf55-3b3aee69ffce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:29.523642 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-dd26c09f-9047-4235-bf55-3b3aee69ffce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:29.525191 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1033/2061] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:30:29 2021] DELETE /identity/v3/projects/e6de50d6ace14f8d9ba0c3ea50ab4462 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:29.532488 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17623e8f-9afd-4912-a115-13956dce2c1b None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:29.532995 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17623e8f-9afd-4912-a115-13956dce2c1b None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:29.533214 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17623e8f-9afd-4912-a115-13956dce2c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:29.551166 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-17623e8f-9afd-4912-a115-13956dce2c1b None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:29.552469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-17623e8f-9afd-4912-a115-13956dce2c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:29.617874 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1029/2062] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:29.626593 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930e63a-7ab8-444a-984d-d2d2f765547a None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:29.626970 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930e63a-7ab8-444a-984d-d2d2f765547a None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:29.627310 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930e63a-7ab8-444a-984d-d2d2f765547a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:29.645152 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-1930e63a-7ab8-444a-984d-d2d2f765547a None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:29.646441 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-1930e63a-7ab8-444a-984d-d2d2f765547a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:29.654386 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1034/2063] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:29.659366 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17623e8f-9afd-4912-a115-13956dce2c1b None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:29.668734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17623e8f-9afd-4912-a115-13956dce2c1b None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:29.673963 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30478a35-dcb3-4557-a41e-953b50718eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:29.674612 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30478a35-dcb3-4557-a41e-953b50718eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:29.674894 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30478a35-dcb3-4557-a41e-953b50718eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:29.675170 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30478a35-dcb3-4557-a41e-953b50718eb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:29.675890 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30478a35-dcb3-4557-a41e-953b50718eb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:30:29.676193 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30478a35-dcb3-4557-a41e-953b50718eb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:29.677829 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30478a35-dcb3-4557-a41e-953b50718eb8 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:29.689947 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1030/2064] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:30:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:30:29.694332 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930e63a-7ab8-444a-984d-d2d2f765547a None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:29.703301 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930e63a-7ab8-444a-984d-d2d2f765547a None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:29.707991 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc26e6d-c335-49d4-81d8-9e92ff4e8732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:29.708647 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc26e6d-c335-49d4-81d8-9e92ff4e8732 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:29.708957 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc26e6d-c335-49d4-81d8-9e92ff4e8732 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:29.709234 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc26e6d-c335-49d4-81d8-9e92ff4e8732 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:29.709966 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc26e6d-c335-49d4-81d8-9e92ff4e8732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:29.711894 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc26e6d-c335-49d4-81d8-9e92ff4e8732 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:29.737665 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1035/2065] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:30:29 2021] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:30:29.741849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30478a35-dcb3-4557-a41e-953b50718eb8 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:29.751744 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30478a35-dcb3-4557-a41e-953b50718eb8 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:29.806939 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2550d8-a5c6-4266-a2cf-1abd0defe303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:29.807684 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2550d8-a5c6-4266-a2cf-1abd0defe303 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:29.807990 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2550d8-a5c6-4266-a2cf-1abd0defe303 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:29.808253 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2550d8-a5c6-4266-a2cf-1abd0defe303 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:29.808990 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2550d8-a5c6-4266-a2cf-1abd0defe303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:29.810966 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2550d8-a5c6-4266-a2cf-1abd0defe303 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:29.831968 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1031/2066] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:30:29 2021] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:30:29.836145 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc26e6d-c335-49d4-81d8-9e92ff4e8732 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:29.848777 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc26e6d-c335-49d4-81d8-9e92ff4e8732 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:29.854246 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15ad63-1ef9-4225-83a8-211149618384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:29.854855 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15ad63-1ef9-4225-83a8-211149618384 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:29.855141 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15ad63-1ef9-4225-83a8-211149618384 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:29.855417 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15ad63-1ef9-4225-83a8-211149618384 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:29.856154 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15ad63-1ef9-4225-83a8-211149618384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:29.857846 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15ad63-1ef9-4225-83a8-211149618384 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:29.869025 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1036/2067] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:29 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:30:29.873336 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2550d8-a5c6-4266-a2cf-1abd0defe303 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:29.883302 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2550d8-a5c6-4266-a2cf-1abd0defe303 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:29.887964 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9efc6-cbcd-4c69-8ad6-8741b48ff15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:29.888618 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9efc6-cbcd-4c69-8ad6-8741b48ff15b admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:29.888932 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9efc6-cbcd-4c69-8ad6-8741b48ff15b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:29.889710 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9efc6-cbcd-4c69-8ad6-8741b48ff15b admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:29.890435 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9efc6-cbcd-4c69-8ad6-8741b48ff15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:29.892033 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e9efc6-cbcd-4c69-8ad6-8741b48ff15b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:29.901774 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1032/2068] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:29 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:30:29.906676 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15ad63-1ef9-4225-83a8-211149618384 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:29.917657 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15ad63-1ef9-4225-83a8-211149618384 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:29.922355 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d14449-d609-4a2c-a955-62b049ec3fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:29.923238 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d14449-d609-4a2c-a955-62b049ec3fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:29.923517 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d14449-d609-4a2c-a955-62b049ec3fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:29.923786 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d14449-d609-4a2c-a955-62b049ec3fa1 admin admin] PATH_INFO: `/v3/projects/55495be5df614b668ebd91c4cbe055a9/users/f831060f947640659b7e3d94f22fe6aa/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:29.938962 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d14449-d609-4a2c-a955-62b049ec3fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55495be5df614b668ebd91c4cbe055a9, user_id=f831060f947640659b7e3d94f22fe6aa, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:29.941734 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d14449-d609-4a2c-a955-62b049ec3fa1 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:29.955594 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1037/2069] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:29 2021] PUT /identity/v3/projects/55495be5df614b668ebd91c4cbe055a9/users/f831060f947640659b7e3d94f22fe6aa/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:29.968213 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef53d98-2d37-49d6-b632-f24e94540e8f None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:29.968595 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef53d98-2d37-49d6-b632-f24e94540e8f None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:29.969025 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef53d98-2d37-49d6-b632-f24e94540e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:29.997277 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-eef53d98-2d37-49d6-b632-f24e94540e8f None None] MFA Rules not processed for user `f831060f947640659b7e3d94f22fe6aa`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:29.998544 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-eef53d98-2d37-49d6-b632-f24e94540e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:30.061341 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1033/2070] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:29 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:30.065803 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d14449-d609-4a2c-a955-62b049ec3fa1 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:30.126440 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d14449-d609-4a2c-a955-62b049ec3fa1 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:30.131089 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0a5d0-60e4-47e3-b02c-ca682cc11da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:30.131743 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0a5d0-60e4-47e3-b02c-ca682cc11da6 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:30.132022 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0a5d0-60e4-47e3-b02c-ca682cc11da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:30.132301 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0a5d0-60e4-47e3-b02c-ca682cc11da6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:30.133029 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0a5d0-60e4-47e3-b02c-ca682cc11da6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:30.134895 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0a5d0-60e4-47e3-b02c-ca682cc11da6 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:30.159883 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1038/2071] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:30:30 2021] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:30:30.164211 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef53d98-2d37-49d6-b632-f24e94540e8f None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:30.175001 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef53d98-2d37-49d6-b632-f24e94540e8f None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:30.233764 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da40b2-12f9-4337-9a14-46105d2320eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:30.234360 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da40b2-12f9-4337-9a14-46105d2320eb admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:30.234646 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da40b2-12f9-4337-9a14-46105d2320eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:30.234920 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da40b2-12f9-4337-9a14-46105d2320eb admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:30.235615 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da40b2-12f9-4337-9a14-46105d2320eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:30.237595 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da40b2-12f9-4337-9a14-46105d2320eb admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:30.259359 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1034/2072] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:30:30 2021] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:30:30.263508 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0a5d0-60e4-47e3-b02c-ca682cc11da6 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:30.274384 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0a5d0-60e4-47e3-b02c-ca682cc11da6 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:30.279012 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14f81e-16c0-4989-b339-862caf4f93ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:30.279703 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14f81e-16c0-4989-b339-862caf4f93ba admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:30.279990 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14f81e-16c0-4989-b339-862caf4f93ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:30.280262 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14f81e-16c0-4989-b339-862caf4f93ba admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:30.281016 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14f81e-16c0-4989-b339-862caf4f93ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:30.282591 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14f81e-16c0-4989-b339-862caf4f93ba admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:30.292945 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1039/2073] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:30 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:30:30.297266 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da40b2-12f9-4337-9a14-46105d2320eb admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:30.307657 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da40b2-12f9-4337-9a14-46105d2320eb admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:30.313011 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bb80d-6b65-4bdf-b688-f296ff23a241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:30.313896 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bb80d-6b65-4bdf-b688-f296ff23a241 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:30.314179 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bb80d-6b65-4bdf-b688-f296ff23a241 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:30.314471 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bb80d-6b65-4bdf-b688-f296ff23a241 admin admin] PATH_INFO: `/v3/projects/c6c07580b9474742bc9b3b716ef56067/users/9b4873ec4d5947e08ad1a6da3415c97a/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:30.331284 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04bb80d-6b65-4bdf-b688-f296ff23a241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c07580b9474742bc9b3b716ef56067, user_id=9b4873ec4d5947e08ad1a6da3415c97a, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:30.334204 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04bb80d-6b65-4bdf-b688-f296ff23a241 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:30.350589 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1035/2074] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:30 2021] PUT /identity/v3/projects/c6c07580b9474742bc9b3b716ef56067/users/9b4873ec4d5947e08ad1a6da3415c97a/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:30:30.354541 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14f81e-16c0-4989-b339-862caf4f93ba admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:30.364379 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14f81e-16c0-4989-b339-862caf4f93ba admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:30.418208 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6d34a-c18a-4637-8a4c-f8126bde0259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:30.418873 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6d34a-c18a-4637-8a4c-f8126bde0259 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:30.419159 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6d34a-c18a-4637-8a4c-f8126bde0259 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:30.419436 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6d34a-c18a-4637-8a4c-f8126bde0259 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:30.420163 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6d34a-c18a-4637-8a4c-f8126bde0259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:30.421790 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6d34a-c18a-4637-8a4c-f8126bde0259 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:30.431029 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1040/2075] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:30 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:30:30.435121 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bb80d-6b65-4bdf-b688-f296ff23a241 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:30.445739 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bb80d-6b65-4bdf-b688-f296ff23a241 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:30.450318 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cb534-0afc-44ef-b2f0-02d6ef736a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:30.451182 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cb534-0afc-44ef-b2f0-02d6ef736a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:30.452087 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cb534-0afc-44ef-b2f0-02d6ef736a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:30.452375 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cb534-0afc-44ef-b2f0-02d6ef736a3b admin admin] PATH_INFO: `/v3/projects/c6c07580b9474742bc9b3b716ef56067/users/9b4873ec4d5947e08ad1a6da3415c97a/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:30.454427 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cb534-0afc-44ef-b2f0-02d6ef736a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c07580b9474742bc9b3b716ef56067, user_id=9b4873ec4d5947e08ad1a6da3415c97a, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:30.457077 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cb534-0afc-44ef-b2f0-02d6ef736a3b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:30.466771 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1036/2076] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:30 2021] PUT /identity/v3/projects/c6c07580b9474742bc9b3b716ef56067/users/9b4873ec4d5947e08ad1a6da3415c97a/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:30:30.476968 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fecc31-8f8a-4e00-aa6e-4c3bb6ee0a89 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:30.477338 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fecc31-8f8a-4e00-aa6e-4c3bb6ee0a89 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:30.477716 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fecc31-8f8a-4e00-aa6e-4c3bb6ee0a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:30.504725 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-e8fecc31-8f8a-4e00-aa6e-4c3bb6ee0a89 None None] MFA Rules not processed for user `9b4873ec4d5947e08ad1a6da3415c97a`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:30.505894 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e8fecc31-8f8a-4e00-aa6e-4c3bb6ee0a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:30.571673 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1041/2077] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:30 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:30.582437 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cb534-0afc-44ef-b2f0-02d6ef736a3b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:30.584110 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-2d9cb534-0afc-44ef-b2f0-02d6ef736a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:30.638964 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cb534-0afc-44ef-b2f0-02d6ef736a3b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:30.642642 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3340e-dc1a-4d31-81f7-6aa99fe916fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:30.643283 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3340e-dc1a-4d31-81f7-6aa99fe916fa service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:30.643563 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3340e-dc1a-4d31-81f7-6aa99fe916fa service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:30.643837 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3340e-dc1a-4d31-81f7-6aa99fe916fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:30.653075 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3340e-dc1a-4d31-81f7-6aa99fe916fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:30.654518 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3340e-dc1a-4d31-81f7-6aa99fe916fa service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:30.664165 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1037/2078] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:30 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:30.731084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fecc31-8f8a-4e00-aa6e-4c3bb6ee0a89 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:30.740776 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fecc31-8f8a-4e00-aa6e-4c3bb6ee0a89 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:30.744433 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790142f3-e337-4c15-bb60-be16a423b4c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:30.745102 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790142f3-e337-4c15-bb60-be16a423b4c1 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:30.745387 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790142f3-e337-4c15-bb60-be16a423b4c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:30.745658 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790142f3-e337-4c15-bb60-be16a423b4c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:30.800041 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790142f3-e337-4c15-bb60-be16a423b4c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:30.801446 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790142f3-e337-4c15-bb60-be16a423b4c1 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:30.810066 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1042/2079] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:30 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:31.044847 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3340e-dc1a-4d31-81f7-6aa99fe916fa service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:31.106218 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3340e-dc1a-4d31-81f7-6aa99fe916fa service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:31.111398 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867fc60-0201-4cd4-90ce-eb3d628a6a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:31.112257 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867fc60-0201-4cd4-90ce-eb3d628a6a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:31.112537 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867fc60-0201-4cd4-90ce-eb3d628a6a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:31.112813 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867fc60-0201-4cd4-90ce-eb3d628a6a6c admin admin] PATH_INFO: `/v3/users/f831060f947640659b7e3d94f22fe6aa` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:31.114042 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867fc60-0201-4cd4-90ce-eb3d628a6a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f831060f947640659b7e3d94f22fe6aa)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:31.115969 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867fc60-0201-4cd4-90ce-eb3d628a6a6c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:31.162778 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-c867fc60-0201-4cd4-90ce-eb3d628a6a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f831060f947640659b7e3d94f22fe6aa'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:31.174791 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-c867fc60-0201-4cd4-90ce-eb3d628a6a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f831060f947640659b7e3d94f22fe6aa'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:31.175450 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-c867fc60-0201-4cd4-90ce-eb3d628a6a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f831060f947640659b7e3d94f22fe6aa'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:31.182772 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-c867fc60-0201-4cd4-90ce-eb3d628a6a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f831060f947640659b7e3d94f22fe6aa'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:31.189822 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-c867fc60-0201-4cd4-90ce-eb3d628a6a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f831060f947640659b7e3d94f22fe6aa'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:31.195748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1038/2080] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:30:31 2021] DELETE /identity/v3/users/f831060f947640659b7e3d94f22fe6aa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:31.200277 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2697ef-62ec-4f9e-80ed-12fdca619067 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:31.200565 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2697ef-62ec-4f9e-80ed-12fdca619067 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:31.200838 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2697ef-62ec-4f9e-80ed-12fdca619067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:31.219618 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-7d2697ef-62ec-4f9e-80ed-12fdca619067 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:31.221182 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7d2697ef-62ec-4f9e-80ed-12fdca619067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:31.278242 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1043/2081] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:31.288606 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867fc60-0201-4cd4-90ce-eb3d628a6a6c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:31.290096 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-c867fc60-0201-4cd4-90ce-eb3d628a6a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:31.346446 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867fc60-0201-4cd4-90ce-eb3d628a6a6c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:31.350184 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c1b7f-d8bf-4245-8cb1-463a73b4e891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:31.350824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c1b7f-d8bf-4245-8cb1-463a73b4e891 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:31.351107 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c1b7f-d8bf-4245-8cb1-463a73b4e891 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:31.351382 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c1b7f-d8bf-4245-8cb1-463a73b4e891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:31.360351 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c1b7f-d8bf-4245-8cb1-463a73b4e891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:31.361770 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c1b7f-d8bf-4245-8cb1-463a73b4e891 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:31.371066 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1039/2082] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:31.644955 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2697ef-62ec-4f9e-80ed-12fdca619067 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:31.646565 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7d2697ef-62ec-4f9e-80ed-12fdca619067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:31.667261 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2697ef-62ec-4f9e-80ed-12fdca619067 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:31.671945 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37f44e-17e1-40fe-beb7-1b3efa068030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:31.672788 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37f44e-17e1-40fe-beb7-1b3efa068030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:31.673296 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37f44e-17e1-40fe-beb7-1b3efa068030 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:31.673569 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37f44e-17e1-40fe-beb7-1b3efa068030 admin admin] PATH_INFO: `/v3/projects/55495be5df614b668ebd91c4cbe055a9` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:31.680945 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37f44e-17e1-40fe-beb7-1b3efa068030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55495be5df614b668ebd91c4cbe055a9)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:31.682842 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37f44e-17e1-40fe-beb7-1b3efa068030 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:31.728899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ce37f44e-17e1-40fe-beb7-1b3efa068030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55495be5df614b668ebd91c4cbe055a9', 'request_id': 'req-ce37f44e-17e1-40fe-beb7-1b3efa068030'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:31.736096 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ce37f44e-17e1-40fe-beb7-1b3efa068030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55495be5df614b668ebd91c4cbe055a9', 'request_id': 'req-ce37f44e-17e1-40fe-beb7-1b3efa068030'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:31.741323 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ce37f44e-17e1-40fe-beb7-1b3efa068030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55495be5df614b668ebd91c4cbe055a9', 'request_id': 'req-ce37f44e-17e1-40fe-beb7-1b3efa068030'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:31.752922 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ce37f44e-17e1-40fe-beb7-1b3efa068030 admin admin] The token cache is being invalidate because project 55495be5df614b668ebd91c4cbe055a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:30:31.753216 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ce37f44e-17e1-40fe-beb7-1b3efa068030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:31.753850 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ce37f44e-17e1-40fe-beb7-1b3efa068030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:31.755356 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1044/2083] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:30:31 2021] DELETE /identity/v3/projects/55495be5df614b668ebd91c4cbe055a9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:31.759350 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c1b7f-d8bf-4245-8cb1-463a73b4e891 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:31.769373 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c1b7f-d8bf-4245-8cb1-463a73b4e891 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:31.823500 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f15c8-96f7-4ef2-b5b1-12a7d2230ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:31.824425 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f15c8-96f7-4ef2-b5b1-12a7d2230ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:31.824708 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f15c8-96f7-4ef2-b5b1-12a7d2230ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:31.825028 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f15c8-96f7-4ef2-b5b1-12a7d2230ed3 admin admin] PATH_INFO: `/v3/users/9b4873ec4d5947e08ad1a6da3415c97a` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:31.826301 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f15c8-96f7-4ef2-b5b1-12a7d2230ed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b4873ec4d5947e08ad1a6da3415c97a)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:31.828778 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f15c8-96f7-4ef2-b5b1-12a7d2230ed3 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:31.872027 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-005f15c8-96f7-4ef2-b5b1-12a7d2230ed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b4873ec4d5947e08ad1a6da3415c97a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:31.883806 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-005f15c8-96f7-4ef2-b5b1-12a7d2230ed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b4873ec4d5947e08ad1a6da3415c97a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:31.884571 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-005f15c8-96f7-4ef2-b5b1-12a7d2230ed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b4873ec4d5947e08ad1a6da3415c97a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:31.892976 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-005f15c8-96f7-4ef2-b5b1-12a7d2230ed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b4873ec4d5947e08ad1a6da3415c97a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:31.899483 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-005f15c8-96f7-4ef2-b5b1-12a7d2230ed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b4873ec4d5947e08ad1a6da3415c97a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:31.905238 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1040/2084] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:30:31 2021] DELETE /identity/v3/users/9b4873ec4d5947e08ad1a6da3415c97a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:32.194919 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37f44e-17e1-40fe-beb7-1b3efa068030 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:32.196524 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-ce37f44e-17e1-40fe-beb7-1b3efa068030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:32.212441 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37f44e-17e1-40fe-beb7-1b3efa068030 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:32.271870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f342c-c1cf-4dad-8fcd-0689d640ddb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:32.272643 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f342c-c1cf-4dad-8fcd-0689d640ddb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:32.273135 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f342c-c1cf-4dad-8fcd-0689d640ddb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:32.273420 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f342c-c1cf-4dad-8fcd-0689d640ddb9 admin admin] PATH_INFO: `/v3/projects/c6c07580b9474742bc9b3b716ef56067` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:32.274584 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f342c-c1cf-4dad-8fcd-0689d640ddb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6c07580b9474742bc9b3b716ef56067)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:32.276455 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f342c-c1cf-4dad-8fcd-0689d640ddb9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:32.321196 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1f0f342c-c1cf-4dad-8fcd-0689d640ddb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6c07580b9474742bc9b3b716ef56067', 'request_id': 'req-1f0f342c-c1cf-4dad-8fcd-0689d640ddb9'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:32.329668 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1f0f342c-c1cf-4dad-8fcd-0689d640ddb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6c07580b9474742bc9b3b716ef56067', 'request_id': 'req-1f0f342c-c1cf-4dad-8fcd-0689d640ddb9'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:32.335292 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1f0f342c-c1cf-4dad-8fcd-0689d640ddb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6c07580b9474742bc9b3b716ef56067', 'request_id': 'req-1f0f342c-c1cf-4dad-8fcd-0689d640ddb9'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:32.347606 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1f0f342c-c1cf-4dad-8fcd-0689d640ddb9 admin admin] The token cache is being invalidate because project c6c07580b9474742bc9b3b716ef56067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:30:32.349100 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1f0f342c-c1cf-4dad-8fcd-0689d640ddb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:32.350022 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1f0f342c-c1cf-4dad-8fcd-0689d640ddb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:32.351536 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1045/2085] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:30:32 2021] DELETE /identity/v3/projects/c6c07580b9474742bc9b3b716ef56067 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:32.357626 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386a488-3c17-4cfe-9386-d7d099ae4987 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:32.357983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386a488-3c17-4cfe-9386-d7d099ae4987 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:32.358263 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386a488-3c17-4cfe-9386-d7d099ae4987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:32.376752 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-4386a488-3c17-4cfe-9386-d7d099ae4987 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:32.378135 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4386a488-3c17-4cfe-9386-d7d099ae4987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:32.455265 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1041/2086] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:32.463194 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eae6c2-3303-44e0-832d-eb7cb95bda85 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:32.463824 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eae6c2-3303-44e0-832d-eb7cb95bda85 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:32.464187 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eae6c2-3303-44e0-832d-eb7cb95bda85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:32.485736 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-a9eae6c2-3303-44e0-832d-eb7cb95bda85 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:32.486449 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a9eae6c2-3303-44e0-832d-eb7cb95bda85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:32.498863 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1046/2087] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:32.503044 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386a488-3c17-4cfe-9386-d7d099ae4987 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:32.515442 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386a488-3c17-4cfe-9386-d7d099ae4987 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:32.530224 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475e088-a817-45d8-bf1a-04bd682487f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:32.531907 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475e088-a817-45d8-bf1a-04bd682487f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:32.532950 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475e088-a817-45d8-bf1a-04bd682487f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:32.533961 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475e088-a817-45d8-bf1a-04bd682487f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:32.537282 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475e088-a817-45d8-bf1a-04bd682487f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:30:32.538430 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475e088-a817-45d8-bf1a-04bd682487f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:32.544003 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475e088-a817-45d8-bf1a-04bd682487f0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:32.561375 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1042/2088] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:30:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:30:32.565639 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eae6c2-3303-44e0-832d-eb7cb95bda85 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:32.575554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eae6c2-3303-44e0-832d-eb7cb95bda85 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:32.596946 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b737a78-1e01-49e5-af1e-483e20d8eaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:32.600087 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b737a78-1e01-49e5-af1e-483e20d8eaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:32.600781 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b737a78-1e01-49e5-af1e-483e20d8eaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:32.601195 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b737a78-1e01-49e5-af1e-483e20d8eaa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:32.609364 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b737a78-1e01-49e5-af1e-483e20d8eaa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:32.614011 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b737a78-1e01-49e5-af1e-483e20d8eaa9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:32.659797 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1047/2089] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:30:32 2021] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:30:32.664014 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475e088-a817-45d8-bf1a-04bd682487f0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:32.676493 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475e088-a817-45d8-bf1a-04bd682487f0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:32.840027 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124f1df-df0d-4a01-9cd0-20743cbb1128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:32.840732 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124f1df-df0d-4a01-9cd0-20743cbb1128 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:32.844771 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124f1df-df0d-4a01-9cd0-20743cbb1128 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:32.845592 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124f1df-df0d-4a01-9cd0-20743cbb1128 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:32.847891 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124f1df-df0d-4a01-9cd0-20743cbb1128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:32.850768 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124f1df-df0d-4a01-9cd0-20743cbb1128 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:32.893678 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1043/2090] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:30:32 2021] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:30:32.898793 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b737a78-1e01-49e5-af1e-483e20d8eaa9 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:32.913633 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b737a78-1e01-49e5-af1e-483e20d8eaa9 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:32.926474 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326c518-7880-4187-ab3f-fab93c0d5439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:32.927429 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326c518-7880-4187-ab3f-fab93c0d5439 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:32.927709 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326c518-7880-4187-ab3f-fab93c0d5439 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:32.927976 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326c518-7880-4187-ab3f-fab93c0d5439 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:32.928871 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326c518-7880-4187-ab3f-fab93c0d5439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:32.930514 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326c518-7880-4187-ab3f-fab93c0d5439 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:32.942796 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1048/2091] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:32 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:30:32.947093 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124f1df-df0d-4a01-9cd0-20743cbb1128 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:32.957865 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124f1df-df0d-4a01-9cd0-20743cbb1128 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:32.981426 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a40d4-6b39-4684-838a-8728afb6f2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:32.982399 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a40d4-6b39-4684-838a-8728afb6f2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:32.983186 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a40d4-6b39-4684-838a-8728afb6f2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:32.983619 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a40d4-6b39-4684-838a-8728afb6f2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:32.984367 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a40d4-6b39-4684-838a-8728afb6f2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:32.986022 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a40d4-6b39-4684-838a-8728afb6f2c0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:33.012625 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1044/2092] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:32 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:30:33.012840 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326c518-7880-4187-ab3f-fab93c0d5439 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:33.024901 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326c518-7880-4187-ab3f-fab93c0d5439 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:33.030866 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a14d9d-1ae7-43c9-87dd-308dcf3d6344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:33.031756 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a14d9d-1ae7-43c9-87dd-308dcf3d6344 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:33.032038 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a14d9d-1ae7-43c9-87dd-308dcf3d6344 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:33.032315 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a14d9d-1ae7-43c9-87dd-308dcf3d6344 admin admin] PATH_INFO: `/v3/projects/d5308afc1e144b2a9dd26db415c68891/users/a5355ec2b90c49c9bd30ac0ac4da8f25/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:33.049023 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a14d9d-1ae7-43c9-87dd-308dcf3d6344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5308afc1e144b2a9dd26db415c68891, user_id=a5355ec2b90c49c9bd30ac0ac4da8f25, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:33.051863 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a14d9d-1ae7-43c9-87dd-308dcf3d6344 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:33.080927 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1049/2093] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:33 2021] PUT /identity/v3/projects/d5308afc1e144b2a9dd26db415c68891/users/a5355ec2b90c49c9bd30ac0ac4da8f25/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:33.087546 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000569c-305e-4b5b-b9bc-c1cbb7a752b3 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:33.087771 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000569c-305e-4b5b-b9bc-c1cbb7a752b3 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:33.088154 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000569c-305e-4b5b-b9bc-c1cbb7a752b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:33.122213 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-6000569c-305e-4b5b-b9bc-c1cbb7a752b3 None None] MFA Rules not processed for user `a5355ec2b90c49c9bd30ac0ac4da8f25`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:33.123958 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-6000569c-305e-4b5b-b9bc-c1cbb7a752b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:33.192822 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1045/2094] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:33 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:33.203978 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a14d9d-1ae7-43c9-87dd-308dcf3d6344 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:33.205830 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-d6a14d9d-1ae7-43c9-87dd-308dcf3d6344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:33.272745 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a14d9d-1ae7-43c9-87dd-308dcf3d6344 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:33.276496 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d2906-4109-4c5f-b5b3-7712b8610fc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:33.277187 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d2906-4109-4c5f-b5b3-7712b8610fc3 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:33.277473 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d2906-4109-4c5f-b5b3-7712b8610fc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:33.277749 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d2906-4109-4c5f-b5b3-7712b8610fc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:33.286739 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d2906-4109-4c5f-b5b3-7712b8610fc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:33.288179 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d2906-4109-4c5f-b5b3-7712b8610fc3 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:33.308912 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1050/2095] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:33 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:43.011098 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000569c-305e-4b5b-b9bc-c1cbb7a752b3 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:43.012631 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-6000569c-305e-4b5b-b9bc-c1cbb7a752b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:43.075242 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000569c-305e-4b5b-b9bc-c1cbb7a752b3 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:43.079724 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d543a-31cd-42bc-8241-b39297cbdb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:43.080584 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d543a-31cd-42bc-8241-b39297cbdb96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:43.080859 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d543a-31cd-42bc-8241-b39297cbdb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:43.081165 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d543a-31cd-42bc-8241-b39297cbdb96 admin admin] PATH_INFO: `/v3/users/870ac4d0be824d5a8fb5929391d3688b` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:43.082340 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d543a-31cd-42bc-8241-b39297cbdb96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=870ac4d0be824d5a8fb5929391d3688b)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:43.084242 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d543a-31cd-42bc-8241-b39297cbdb96 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:43.128951 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-bb1d543a-31cd-42bc-8241-b39297cbdb96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870ac4d0be824d5a8fb5929391d3688b'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:43.140068 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-bb1d543a-31cd-42bc-8241-b39297cbdb96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870ac4d0be824d5a8fb5929391d3688b'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:43.140745 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-bb1d543a-31cd-42bc-8241-b39297cbdb96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870ac4d0be824d5a8fb5929391d3688b'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:43.147867 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-bb1d543a-31cd-42bc-8241-b39297cbdb96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870ac4d0be824d5a8fb5929391d3688b'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:43.155196 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-bb1d543a-31cd-42bc-8241-b39297cbdb96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870ac4d0be824d5a8fb5929391d3688b'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:43.161197 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1046/2096] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:30:43 2021] DELETE /identity/v3/users/870ac4d0be824d5a8fb5929391d3688b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:43.166266 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b00660-f366-482e-933d-a8a73f479255 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:43.166767 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b00660-f366-482e-933d-a8a73f479255 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:43.166859 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b00660-f366-482e-933d-a8a73f479255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:43.185837 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-b3b00660-f366-482e-933d-a8a73f479255 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:43.187017 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b3b00660-f366-482e-933d-a8a73f479255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:43.244949 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1051/2097] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:43.254634 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d543a-31cd-42bc-8241-b39297cbdb96 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:43.256289 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-bb1d543a-31cd-42bc-8241-b39297cbdb96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:43.311241 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d543a-31cd-42bc-8241-b39297cbdb96 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:43.314911 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4652585-f705-43cd-a09d-d31c40520d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:43.315558 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4652585-f705-43cd-a09d-d31c40520d77 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:43.315843 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4652585-f705-43cd-a09d-d31c40520d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:43.316126 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4652585-f705-43cd-a09d-d31c40520d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:43.325286 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4652585-f705-43cd-a09d-d31c40520d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:43.327220 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4652585-f705-43cd-a09d-d31c40520d77 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:43.336869 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1047/2098] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:43.616441 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b00660-f366-482e-933d-a8a73f479255 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:43.618047 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b3b00660-f366-482e-933d-a8a73f479255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:43.630569 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b00660-f366-482e-933d-a8a73f479255 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:43.635433 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106856d-88e9-470d-ac64-8cd41abf8a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:43.636284 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106856d-88e9-470d-ac64-8cd41abf8a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:43.636563 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106856d-88e9-470d-ac64-8cd41abf8a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:43.636830 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106856d-88e9-470d-ac64-8cd41abf8a8f admin admin] PATH_INFO: `/v3/projects/e1bae7c3e09d47e2aa0f52517a523bed` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:43.638054 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1106856d-88e9-470d-ac64-8cd41abf8a8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1bae7c3e09d47e2aa0f52517a523bed)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:43.640646 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1106856d-88e9-470d-ac64-8cd41abf8a8f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:43.688270 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1106856d-88e9-470d-ac64-8cd41abf8a8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1bae7c3e09d47e2aa0f52517a523bed', 'request_id': 'req-1106856d-88e9-470d-ac64-8cd41abf8a8f'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:43.695928 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1106856d-88e9-470d-ac64-8cd41abf8a8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1bae7c3e09d47e2aa0f52517a523bed', 'request_id': 'req-1106856d-88e9-470d-ac64-8cd41abf8a8f'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:43.701835 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1106856d-88e9-470d-ac64-8cd41abf8a8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1bae7c3e09d47e2aa0f52517a523bed', 'request_id': 'req-1106856d-88e9-470d-ac64-8cd41abf8a8f'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:43.713181 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1106856d-88e9-470d-ac64-8cd41abf8a8f admin admin] The token cache is being invalidate because project e1bae7c3e09d47e2aa0f52517a523bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:30:43.713469 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1106856d-88e9-470d-ac64-8cd41abf8a8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:43.714106 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-1106856d-88e9-470d-ac64-8cd41abf8a8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:43.715624 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1052/2099] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:30:43 2021] DELETE /identity/v3/projects/e1bae7c3e09d47e2aa0f52517a523bed => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:43.720454 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4652585-f705-43cd-a09d-d31c40520d77 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:43.730007 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4652585-f705-43cd-a09d-d31c40520d77 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:43.783866 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd412cd-3e43-4849-8fcf-54034f9e36fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:43.784741 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd412cd-3e43-4849-8fcf-54034f9e36fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:43.785055 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd412cd-3e43-4849-8fcf-54034f9e36fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:43.785350 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd412cd-3e43-4849-8fcf-54034f9e36fb admin admin] PATH_INFO: `/v3/users/d460dab30970483894de8827ac9245dd` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:43.786717 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd412cd-3e43-4849-8fcf-54034f9e36fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d460dab30970483894de8827ac9245dd)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:43.789020 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd412cd-3e43-4849-8fcf-54034f9e36fb admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:43.833000 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-cbd412cd-3e43-4849-8fcf-54034f9e36fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd460dab30970483894de8827ac9245dd'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:43.844706 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-cbd412cd-3e43-4849-8fcf-54034f9e36fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd460dab30970483894de8827ac9245dd'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:43.845405 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-cbd412cd-3e43-4849-8fcf-54034f9e36fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd460dab30970483894de8827ac9245dd'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:43.852554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-cbd412cd-3e43-4849-8fcf-54034f9e36fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd460dab30970483894de8827ac9245dd'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:43.859636 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-cbd412cd-3e43-4849-8fcf-54034f9e36fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd460dab30970483894de8827ac9245dd'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:43.865972 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1048/2100] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:30:43 2021] DELETE /identity/v3/users/d460dab30970483894de8827ac9245dd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:30:44.147946 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106856d-88e9-470d-ac64-8cd41abf8a8f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:44.149394 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-1106856d-88e9-470d-ac64-8cd41abf8a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:44.161995 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106856d-88e9-470d-ac64-8cd41abf8a8f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:44.216829 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33407b0-9fa1-48fc-849d-6a2a10069628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:44.218646 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33407b0-9fa1-48fc-849d-6a2a10069628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:44.218987 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33407b0-9fa1-48fc-849d-6a2a10069628 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:44.219727 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33407b0-9fa1-48fc-849d-6a2a10069628 admin admin] PATH_INFO: `/v3/projects/05bf1ee5488b4cae8bf92e83e9092168` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:44.221352 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33407b0-9fa1-48fc-849d-6a2a10069628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05bf1ee5488b4cae8bf92e83e9092168)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:44.223892 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33407b0-9fa1-48fc-849d-6a2a10069628 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:44.270107 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-b33407b0-9fa1-48fc-849d-6a2a10069628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05bf1ee5488b4cae8bf92e83e9092168', 'request_id': 'req-b33407b0-9fa1-48fc-849d-6a2a10069628'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:44.277264 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-b33407b0-9fa1-48fc-849d-6a2a10069628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05bf1ee5488b4cae8bf92e83e9092168', 'request_id': 'req-b33407b0-9fa1-48fc-849d-6a2a10069628'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:44.282804 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-b33407b0-9fa1-48fc-849d-6a2a10069628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05bf1ee5488b4cae8bf92e83e9092168', 'request_id': 'req-b33407b0-9fa1-48fc-849d-6a2a10069628'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:44.293227 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-b33407b0-9fa1-48fc-849d-6a2a10069628 admin admin] The token cache is being invalidate because project 05bf1ee5488b4cae8bf92e83e9092168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:30:44.293513 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-b33407b0-9fa1-48fc-849d-6a2a10069628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:44.294149 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-b33407b0-9fa1-48fc-849d-6a2a10069628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:44.296182 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1053/2101] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:30:44 2021] DELETE /identity/v3/projects/05bf1ee5488b4cae8bf92e83e9092168 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:44.303138 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dc343-7e49-469e-ba54-a59f45e0750c None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:44.303603 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dc343-7e49-469e-ba54-a59f45e0750c None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:44.303720 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dc343-7e49-469e-ba54-a59f45e0750c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:44.321901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-858dc343-7e49-469e-ba54-a59f45e0750c None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:44.323076 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-858dc343-7e49-469e-ba54-a59f45e0750c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:44.382148 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1049/2102] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:30:44.389962 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b45f13-0b48-467a-bd2d-38cc6a69a056 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:44.390253 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b45f13-0b48-467a-bd2d-38cc6a69a056 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:44.390534 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b45f13-0b48-467a-bd2d-38cc6a69a056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:44.408997 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-87b45f13-0b48-467a-bd2d-38cc6a69a056 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:44.410126 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-87b45f13-0b48-467a-bd2d-38cc6a69a056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:44.418163 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1054/2103] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:44.422753 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858dc343-7e49-469e-ba54-a59f45e0750c None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:44.432739 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858dc343-7e49-469e-ba54-a59f45e0750c None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:44.437402 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f723421-cfb0-4f1f-af2c-9854256afebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:44.438060 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f723421-cfb0-4f1f-af2c-9854256afebf admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:44.438487 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f723421-cfb0-4f1f-af2c-9854256afebf admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:44.438768 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f723421-cfb0-4f1f-af2c-9854256afebf admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:44.439496 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f723421-cfb0-4f1f-af2c-9854256afebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:30:44.439802 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f723421-cfb0-4f1f-af2c-9854256afebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:44.441436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f723421-cfb0-4f1f-af2c-9854256afebf admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:44.452821 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1050/2104] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:30:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:30:44.457229 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b45f13-0b48-467a-bd2d-38cc6a69a056 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:44.466390 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b45f13-0b48-467a-bd2d-38cc6a69a056 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:44.472072 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b5ea3-f021-485b-ad79-085ff61ea218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:44.473126 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b5ea3-f021-485b-ad79-085ff61ea218 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:44.473480 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b5ea3-f021-485b-ad79-085ff61ea218 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:44.473755 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b5ea3-f021-485b-ad79-085ff61ea218 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:44.474451 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b5ea3-f021-485b-ad79-085ff61ea218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:44.476630 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b5ea3-f021-485b-ad79-085ff61ea218 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:44.506911 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1055/2105] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:30:44 2021] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:30:44.511030 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f723421-cfb0-4f1f-af2c-9854256afebf admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:44.520742 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f723421-cfb0-4f1f-af2c-9854256afebf admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:44.573988 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39f20b-1afb-4144-ba46-60d6c7e3ee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:44.574652 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39f20b-1afb-4144-ba46-60d6c7e3ee60 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:44.574933 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39f20b-1afb-4144-ba46-60d6c7e3ee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:44.575205 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39f20b-1afb-4144-ba46-60d6c7e3ee60 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:44.576019 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39f20b-1afb-4144-ba46-60d6c7e3ee60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:44.577953 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39f20b-1afb-4144-ba46-60d6c7e3ee60 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:44.597063 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1051/2106] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:30:44 2021] POST /identity/v3/users => generated 293 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:30:44.601170 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b5ea3-f021-485b-ad79-085ff61ea218 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:44.611908 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b5ea3-f021-485b-ad79-085ff61ea218 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:44.616538 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5e9d1-9567-4c01-b682-012806b54a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:44.617227 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5e9d1-9567-4c01-b682-012806b54a10 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:44.617512 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5e9d1-9567-4c01-b682-012806b54a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:44.617790 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5e9d1-9567-4c01-b682-012806b54a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:44.618514 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5e9d1-9567-4c01-b682-012806b54a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:44.620086 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5e9d1-9567-4c01-b682-012806b54a10 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:44.630068 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1056/2107] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:44 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:30:44.633892 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39f20b-1afb-4144-ba46-60d6c7e3ee60 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:44.643522 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39f20b-1afb-4144-ba46-60d6c7e3ee60 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:44.648066 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a232a-07f7-4ad9-afed-f5637cadcea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:44.648717 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a232a-07f7-4ad9-afed-f5637cadcea7 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:44.649037 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a232a-07f7-4ad9-afed-f5637cadcea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:44.649315 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a232a-07f7-4ad9-afed-f5637cadcea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:44.650034 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a232a-07f7-4ad9-afed-f5637cadcea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:44.651643 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a232a-07f7-4ad9-afed-f5637cadcea7 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:44.661766 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1052/2108] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:44 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:30:44.666007 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5e9d1-9567-4c01-b682-012806b54a10 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:44.677281 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5e9d1-9567-4c01-b682-012806b54a10 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:44.682018 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0d666-ee88-498f-a9db-ef7208776af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:44.682888 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0d666-ee88-498f-a9db-ef7208776af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:44.683173 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0d666-ee88-498f-a9db-ef7208776af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:44.683447 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0d666-ee88-498f-a9db-ef7208776af9 admin admin] PATH_INFO: `/v3/projects/21433e51f1354ebeae689d41605cb365/users/27c1dca1803749078fbc2a7a24e0b53c/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:44.697439 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0d666-ee88-498f-a9db-ef7208776af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21433e51f1354ebeae689d41605cb365, user_id=27c1dca1803749078fbc2a7a24e0b53c, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:44.700050 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0d666-ee88-498f-a9db-ef7208776af9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:44.713920 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1057/2109] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:44 2021] PUT /identity/v3/projects/21433e51f1354ebeae689d41605cb365/users/27c1dca1803749078fbc2a7a24e0b53c/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:44.724608 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d366b-be6e-45b1-8c58-9ce0a9aed62b None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:44.724969 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d366b-be6e-45b1-8c58-9ce0a9aed62b None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:44.725230 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d366b-be6e-45b1-8c58-9ce0a9aed62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:44.753204 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-ec1d366b-be6e-45b1-8c58-9ce0a9aed62b None None] MFA Rules not processed for user `27c1dca1803749078fbc2a7a24e0b53c`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:44.754423 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ec1d366b-be6e-45b1-8c58-9ce0a9aed62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:44.816888 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1053/2110] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:44 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:30:44.821441 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0d666-ee88-498f-a9db-ef7208776af9 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:44.883200 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0d666-ee88-498f-a9db-ef7208776af9 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:44.888026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131d280-a83f-48f1-b908-4dd02ad369e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:44.889228 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131d280-a83f-48f1-b908-4dd02ad369e2 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:44.889512 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131d280-a83f-48f1-b908-4dd02ad369e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:44.889791 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131d280-a83f-48f1-b908-4dd02ad369e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:44.890496 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131d280-a83f-48f1-b908-4dd02ad369e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:44.892383 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131d280-a83f-48f1-b908-4dd02ad369e2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:44.918175 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1058/2111] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:30:44 2021] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:30:44.922629 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d366b-be6e-45b1-8c58-9ce0a9aed62b None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:44.933482 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d366b-be6e-45b1-8c58-9ce0a9aed62b None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:44.989479 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6849c-22ac-465b-8c7a-b9dda3073916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:44.990153 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6849c-22ac-465b-8c7a-b9dda3073916 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:44.990432 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6849c-22ac-465b-8c7a-b9dda3073916 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:44.990705 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6849c-22ac-465b-8c7a-b9dda3073916 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:44.991418 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6849c-22ac-465b-8c7a-b9dda3073916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:44.993359 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6849c-22ac-465b-8c7a-b9dda3073916 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:45.012665 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1054/2112] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:30:44 2021] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:30:45.016619 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131d280-a83f-48f1-b908-4dd02ad369e2 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:45.026612 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131d280-a83f-48f1-b908-4dd02ad369e2 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:45.031216 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2803e8-13cb-4e51-8605-aecc6bbf84eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:45.031863 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2803e8-13cb-4e51-8605-aecc6bbf84eb admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:45.032142 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2803e8-13cb-4e51-8605-aecc6bbf84eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:45.032411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2803e8-13cb-4e51-8605-aecc6bbf84eb admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:45.033159 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2803e8-13cb-4e51-8605-aecc6bbf84eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:45.034727 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2803e8-13cb-4e51-8605-aecc6bbf84eb admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:45.045279 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1059/2113] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:45 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:30:45.049107 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6849c-22ac-465b-8c7a-b9dda3073916 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:45.058427 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6849c-22ac-465b-8c7a-b9dda3073916 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:45.063917 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576719fa-e9b9-4ff3-821e-52f76bf6db00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:45.064802 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576719fa-e9b9-4ff3-821e-52f76bf6db00 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:45.065124 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576719fa-e9b9-4ff3-821e-52f76bf6db00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:45.065399 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576719fa-e9b9-4ff3-821e-52f76bf6db00 admin admin] PATH_INFO: `/v3/projects/e23936df54424f08b3f2ff50c7cf619a/users/9d2d444491b94d6a8d4641fa240e4b5c/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:45.080051 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576719fa-e9b9-4ff3-821e-52f76bf6db00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23936df54424f08b3f2ff50c7cf619a, user_id=9d2d444491b94d6a8d4641fa240e4b5c, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:45.082823 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576719fa-e9b9-4ff3-821e-52f76bf6db00 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:45.097590 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1055/2114] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:45 2021] PUT /identity/v3/projects/e23936df54424f08b3f2ff50c7cf619a/users/9d2d444491b94d6a8d4641fa240e4b5c/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:30:45.101336 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2803e8-13cb-4e51-8605-aecc6bbf84eb admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:45.111890 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2803e8-13cb-4e51-8605-aecc6bbf84eb admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:45.169418 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd6754-26dc-411b-9dc0-89acb3e48f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:45.171564 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd6754-26dc-411b-9dc0-89acb3e48f92 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:45.171564 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd6754-26dc-411b-9dc0-89acb3e48f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:45.171564 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd6754-26dc-411b-9dc0-89acb3e48f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:45.171828 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd6754-26dc-411b-9dc0-89acb3e48f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:45.173512 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd6754-26dc-411b-9dc0-89acb3e48f92 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:45.183551 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1060/2115] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:45 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:30:45.187851 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576719fa-e9b9-4ff3-821e-52f76bf6db00 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:45.199115 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576719fa-e9b9-4ff3-821e-52f76bf6db00 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:45.205825 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b58792-4841-449e-a818-bc9920d82815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:45.206840 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b58792-4841-449e-a818-bc9920d82815 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:45.207287 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b58792-4841-449e-a818-bc9920d82815 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:45.207572 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b58792-4841-449e-a818-bc9920d82815 admin admin] PATH_INFO: `/v3/projects/e23936df54424f08b3f2ff50c7cf619a/users/9d2d444491b94d6a8d4641fa240e4b5c/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:45.209732 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b58792-4841-449e-a818-bc9920d82815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23936df54424f08b3f2ff50c7cf619a, user_id=9d2d444491b94d6a8d4641fa240e4b5c, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:45.212691 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b58792-4841-449e-a818-bc9920d82815 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:45.226949 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1056/2116] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:45 2021] PUT /identity/v3/projects/e23936df54424f08b3f2ff50c7cf619a/users/9d2d444491b94d6a8d4641fa240e4b5c/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:45.238262 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f0de3-87ef-4a7b-8c7e-36ab56e9c1c7 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:45.238764 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f0de3-87ef-4a7b-8c7e-36ab56e9c1c7 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:45.238853 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f0de3-87ef-4a7b-8c7e-36ab56e9c1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:45.263937 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-8c4f0de3-87ef-4a7b-8c7e-36ab56e9c1c7 None None] MFA Rules not processed for user `9d2d444491b94d6a8d4641fa240e4b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:45.265526 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8c4f0de3-87ef-4a7b-8c7e-36ab56e9c1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:45.329735 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1061/2117] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:45 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:45.340147 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b58792-4841-449e-a818-bc9920d82815 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:45.342449 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-27b58792-4841-449e-a818-bc9920d82815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:45.397533 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b58792-4841-449e-a818-bc9920d82815 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:45.401234 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1aeb4c-2e7c-44b8-b057-2c5cc65a8aae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:45.401850 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1aeb4c-2e7c-44b8-b057-2c5cc65a8aae service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:45.402130 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1aeb4c-2e7c-44b8-b057-2c5cc65a8aae service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:45.402402 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1aeb4c-2e7c-44b8-b057-2c5cc65a8aae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:45.411516 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1aeb4c-2e7c-44b8-b057-2c5cc65a8aae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:45.412971 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1aeb4c-2e7c-44b8-b057-2c5cc65a8aae service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:45.422619 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1057/2118] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:45 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:45.481939 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f0de3-87ef-4a7b-8c7e-36ab56e9c1c7 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:45.545033 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f0de3-87ef-4a7b-8c7e-36ab56e9c1c7 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:45.549437 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd10f86-6db3-423a-9f5d-f8a9cfb6d23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:45.550280 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd10f86-6db3-423a-9f5d-f8a9cfb6d23f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:45.550554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd10f86-6db3-423a-9f5d-f8a9cfb6d23f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:45.550821 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd10f86-6db3-423a-9f5d-f8a9cfb6d23f admin admin] PATH_INFO: `/v3/users/27c1dca1803749078fbc2a7a24e0b53c` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:45.552022 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd10f86-6db3-423a-9f5d-f8a9cfb6d23f admin admin] RBAC: Authorizing `identity:delete_user(user_id=27c1dca1803749078fbc2a7a24e0b53c)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:45.553943 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd10f86-6db3-423a-9f5d-f8a9cfb6d23f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:45.598313 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8dd10f86-6db3-423a-9f5d-f8a9cfb6d23f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27c1dca1803749078fbc2a7a24e0b53c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:45.598956 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8dd10f86-6db3-423a-9f5d-f8a9cfb6d23f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27c1dca1803749078fbc2a7a24e0b53c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:45.605826 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8dd10f86-6db3-423a-9f5d-f8a9cfb6d23f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27c1dca1803749078fbc2a7a24e0b53c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:45.606425 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8dd10f86-6db3-423a-9f5d-f8a9cfb6d23f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27c1dca1803749078fbc2a7a24e0b53c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:45.617614 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8dd10f86-6db3-423a-9f5d-f8a9cfb6d23f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27c1dca1803749078fbc2a7a24e0b53c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:45.629303 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1062/2119] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:30:45 2021] DELETE /identity/v3/users/27c1dca1803749078fbc2a7a24e0b53c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:45.634804 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006c60f-26ca-418e-bd92-0fa9f1c4811b None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:45.635075 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006c60f-26ca-418e-bd92-0fa9f1c4811b None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:45.635359 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006c60f-26ca-418e-bd92-0fa9f1c4811b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:45.653907 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-4006c60f-26ca-418e-bd92-0fa9f1c4811b None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:45.655630 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4006c60f-26ca-418e-bd92-0fa9f1c4811b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:45.711222 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1058/2120] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:45.722017 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd10f86-6db3-423a-9f5d-f8a9cfb6d23f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:45.723406 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8dd10f86-6db3-423a-9f5d-f8a9cfb6d23f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:45.777128 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd10f86-6db3-423a-9f5d-f8a9cfb6d23f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:45.781394 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01c584-6344-4055-b329-fe4e44dceaa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:45.782023 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01c584-6344-4055-b329-fe4e44dceaa2 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:45.782298 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01c584-6344-4055-b329-fe4e44dceaa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:45.782567 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01c584-6344-4055-b329-fe4e44dceaa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:45.791161 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01c584-6344-4055-b329-fe4e44dceaa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:45.792563 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01c584-6344-4055-b329-fe4e44dceaa2 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:45.802151 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1063/2121] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:46.121121 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006c60f-26ca-418e-bd92-0fa9f1c4811b None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:46.122633 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4006c60f-26ca-418e-bd92-0fa9f1c4811b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:46.137692 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4006c60f-26ca-418e-bd92-0fa9f1c4811b None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:46.147270 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414a226-d619-400c-9487-4862543259e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:46.148236 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414a226-d619-400c-9487-4862543259e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:46.148585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414a226-d619-400c-9487-4862543259e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:46.148982 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414a226-d619-400c-9487-4862543259e2 admin admin] PATH_INFO: `/v3/projects/21433e51f1354ebeae689d41605cb365` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:46.150269 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414a226-d619-400c-9487-4862543259e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21433e51f1354ebeae689d41605cb365)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:46.152461 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414a226-d619-400c-9487-4862543259e2 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:46.214260 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e414a226-d619-400c-9487-4862543259e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21433e51f1354ebeae689d41605cb365', 'request_id': 'req-e414a226-d619-400c-9487-4862543259e2'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:46.221758 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e414a226-d619-400c-9487-4862543259e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21433e51f1354ebeae689d41605cb365', 'request_id': 'req-e414a226-d619-400c-9487-4862543259e2'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:46.228829 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e414a226-d619-400c-9487-4862543259e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21433e51f1354ebeae689d41605cb365', 'request_id': 'req-e414a226-d619-400c-9487-4862543259e2'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:46.239656 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e414a226-d619-400c-9487-4862543259e2 admin admin] The token cache is being invalidate because project 21433e51f1354ebeae689d41605cb365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:30:46.240154 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e414a226-d619-400c-9487-4862543259e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:46.241166 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e414a226-d619-400c-9487-4862543259e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:46.242899 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1059/2122] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:30:46 2021] DELETE /identity/v3/projects/21433e51f1354ebeae689d41605cb365 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:46.246926 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01c584-6344-4055-b329-fe4e44dceaa2 service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:46.257803 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01c584-6344-4055-b329-fe4e44dceaa2 service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:46.313776 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381f092-13f9-4dd8-8c40-6b145529e547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:46.314735 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381f092-13f9-4dd8-8c40-6b145529e547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:46.315091 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381f092-13f9-4dd8-8c40-6b145529e547 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:46.315443 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381f092-13f9-4dd8-8c40-6b145529e547 admin admin] PATH_INFO: `/v3/users/9d2d444491b94d6a8d4641fa240e4b5c` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:46.316709 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381f092-13f9-4dd8-8c40-6b145529e547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d2d444491b94d6a8d4641fa240e4b5c)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:46.318737 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381f092-13f9-4dd8-8c40-6b145529e547 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:46.368323 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9381f092-13f9-4dd8-8c40-6b145529e547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d2d444491b94d6a8d4641fa240e4b5c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:46.369044 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9381f092-13f9-4dd8-8c40-6b145529e547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d2d444491b94d6a8d4641fa240e4b5c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:46.376778 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9381f092-13f9-4dd8-8c40-6b145529e547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d2d444491b94d6a8d4641fa240e4b5c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:46.377409 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9381f092-13f9-4dd8-8c40-6b145529e547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d2d444491b94d6a8d4641fa240e4b5c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:46.389749 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9381f092-13f9-4dd8-8c40-6b145529e547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d2d444491b94d6a8d4641fa240e4b5c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:46.403299 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1064/2123] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:30:46 2021] DELETE /identity/v3/users/9d2d444491b94d6a8d4641fa240e4b5c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:46.677753 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414a226-d619-400c-9487-4862543259e2 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:46.679264 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-e414a226-d619-400c-9487-4862543259e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:46.692603 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414a226-d619-400c-9487-4862543259e2 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:46.746164 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c2dbb-9c21-4285-ac13-d5d1f9d0a377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:46.746953 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c2dbb-9c21-4285-ac13-d5d1f9d0a377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:46.747235 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c2dbb-9c21-4285-ac13-d5d1f9d0a377 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:46.747516 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c2dbb-9c21-4285-ac13-d5d1f9d0a377 admin admin] PATH_INFO: `/v3/projects/e23936df54424f08b3f2ff50c7cf619a` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:46.749215 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c2dbb-9c21-4285-ac13-d5d1f9d0a377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e23936df54424f08b3f2ff50c7cf619a)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:46.751113 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c2dbb-9c21-4285-ac13-d5d1f9d0a377 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:46.793942 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a54c2dbb-9c21-4285-ac13-d5d1f9d0a377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e23936df54424f08b3f2ff50c7cf619a', 'request_id': 'req-a54c2dbb-9c21-4285-ac13-d5d1f9d0a377'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:46.799791 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a54c2dbb-9c21-4285-ac13-d5d1f9d0a377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e23936df54424f08b3f2ff50c7cf619a', 'request_id': 'req-a54c2dbb-9c21-4285-ac13-d5d1f9d0a377'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:46.806768 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a54c2dbb-9c21-4285-ac13-d5d1f9d0a377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e23936df54424f08b3f2ff50c7cf619a', 'request_id': 'req-a54c2dbb-9c21-4285-ac13-d5d1f9d0a377'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:46.816856 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a54c2dbb-9c21-4285-ac13-d5d1f9d0a377 admin admin] The token cache is being invalidate because project e23936df54424f08b3f2ff50c7cf619a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:30:46.817174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a54c2dbb-9c21-4285-ac13-d5d1f9d0a377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:46.817774 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a54c2dbb-9c21-4285-ac13-d5d1f9d0a377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:46.819266 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1060/2124] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:30:46 2021] DELETE /identity/v3/projects/e23936df54424f08b3f2ff50c7cf619a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:46.824855 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd873b-0965-4d44-9193-a6b4aecd36e8 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:46.825178 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd873b-0965-4d44-9193-a6b4aecd36e8 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:46.825457 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd873b-0965-4d44-9193-a6b4aecd36e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:46.843175 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-c0dd873b-0965-4d44-9193-a6b4aecd36e8 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:46.844616 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c0dd873b-0965-4d44-9193-a6b4aecd36e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:46.900339 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1065/2125] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:46.908160 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e5824-793d-4f98-b3d0-e80fb4de8e5b None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:46.908450 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e5824-793d-4f98-b3d0-e80fb4de8e5b None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:46.908730 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e5824-793d-4f98-b3d0-e80fb4de8e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:46.927290 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-304e5824-793d-4f98-b3d0-e80fb4de8e5b None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:46.928468 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-304e5824-793d-4f98-b3d0-e80fb4de8e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:46.936711 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1061/2126] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:46.940639 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd873b-0965-4d44-9193-a6b4aecd36e8 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:46.949915 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd873b-0965-4d44-9193-a6b4aecd36e8 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:46.955073 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d292b01-495b-456c-b512-4f3135001227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:46.955712 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d292b01-495b-456c-b512-4f3135001227 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:46.955995 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d292b01-495b-456c-b512-4f3135001227 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:46.956270 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d292b01-495b-456c-b512-4f3135001227 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:46.957020 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d292b01-495b-456c-b512-4f3135001227 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:30:46.957329 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d292b01-495b-456c-b512-4f3135001227 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:46.958909 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d292b01-495b-456c-b512-4f3135001227 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:46.970042 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1066/2127] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:30:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:30:46.974035 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e5824-793d-4f98-b3d0-e80fb4de8e5b None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:46.983222 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e5824-793d-4f98-b3d0-e80fb4de8e5b None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:46.987939 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e292994-3269-4eb2-92c7-8ffc27b0e179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:46.988732 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e292994-3269-4eb2-92c7-8ffc27b0e179 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:46.988896 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e292994-3269-4eb2-92c7-8ffc27b0e179 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:46.989195 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e292994-3269-4eb2-92c7-8ffc27b0e179 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:46.989962 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e292994-3269-4eb2-92c7-8ffc27b0e179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:46.992154 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e292994-3269-4eb2-92c7-8ffc27b0e179 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:47.019544 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1062/2128] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:30:46 2021] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:30:47.023699 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d292b01-495b-456c-b512-4f3135001227 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:47.033618 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d292b01-495b-456c-b512-4f3135001227 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:47.091882 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e526dd-c7b8-4c62-b588-43b77793a4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:47.092554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e526dd-c7b8-4c62-b588-43b77793a4d7 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:47.093079 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e526dd-c7b8-4c62-b588-43b77793a4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:47.093357 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e526dd-c7b8-4c62-b588-43b77793a4d7 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:47.094292 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e526dd-c7b8-4c62-b588-43b77793a4d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:47.097359 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e526dd-c7b8-4c62-b588-43b77793a4d7 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:47.122199 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1067/2129] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:30:47 2021] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:30:47.124077 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e292994-3269-4eb2-92c7-8ffc27b0e179 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:47.134161 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e292994-3269-4eb2-92c7-8ffc27b0e179 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:47.138878 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b20c8-6480-4ca4-89b6-ee5e2228cc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:47.139578 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b20c8-6480-4ca4-89b6-ee5e2228cc77 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:47.139859 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b20c8-6480-4ca4-89b6-ee5e2228cc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:47.140133 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b20c8-6480-4ca4-89b6-ee5e2228cc77 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:47.140858 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b20c8-6480-4ca4-89b6-ee5e2228cc77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:47.142466 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b20c8-6480-4ca4-89b6-ee5e2228cc77 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:47.156964 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1063/2130] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:47 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:30:47.157161 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e526dd-c7b8-4c62-b588-43b77793a4d7 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:47.167356 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e526dd-c7b8-4c62-b588-43b77793a4d7 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:47.172734 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a59e1a-8311-4694-85bf-db1273648ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:47.173604 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a59e1a-8311-4694-85bf-db1273648ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:47.173909 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a59e1a-8311-4694-85bf-db1273648ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:47.174179 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a59e1a-8311-4694-85bf-db1273648ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:47.174940 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a59e1a-8311-4694-85bf-db1273648ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:47.176508 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a59e1a-8311-4694-85bf-db1273648ab8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:47.187550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1068/2131] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:47 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:30:47.191654 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b20c8-6480-4ca4-89b6-ee5e2228cc77 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:47.204789 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b20c8-6480-4ca4-89b6-ee5e2228cc77 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:47.211087 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b99257-5af2-4d6c-ba3c-5b95119d6696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:47.213633 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b99257-5af2-4d6c-ba3c-5b95119d6696 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:47.213633 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b99257-5af2-4d6c-ba3c-5b95119d6696 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:47.213633 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b99257-5af2-4d6c-ba3c-5b95119d6696 admin admin] PATH_INFO: `/v3/projects/c78a3bd08aac452fb808b6eb493a48d8/users/d50b99266e5c4e60ab29f803d66561ad/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:47.230701 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b99257-5af2-4d6c-ba3c-5b95119d6696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c78a3bd08aac452fb808b6eb493a48d8, user_id=d50b99266e5c4e60ab29f803d66561ad, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:47.234060 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b99257-5af2-4d6c-ba3c-5b95119d6696 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:47.263140 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1064/2132] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:47 2021] PUT /identity/v3/projects/c78a3bd08aac452fb808b6eb493a48d8/users/d50b99266e5c4e60ab29f803d66561ad/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:47.263378 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d7b19-0370-492b-a376-429a85449d71 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:47.263378 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d7b19-0370-492b-a376-429a85449d71 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:47.263900 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d7b19-0370-492b-a376-429a85449d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:47.291746 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-c53d7b19-0370-492b-a376-429a85449d71 None None] MFA Rules not processed for user `d50b99266e5c4e60ab29f803d66561ad`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:47.293011 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c53d7b19-0370-492b-a376-429a85449d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:47.371561 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1069/2133] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:47 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:47.376635 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b99257-5af2-4d6c-ba3c-5b95119d6696 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:47.444650 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b99257-5af2-4d6c-ba3c-5b95119d6696 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:47.451834 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb5223-11dd-40db-b2f2-49509c76d9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:47.453860 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb5223-11dd-40db-b2f2-49509c76d9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:47.454238 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb5223-11dd-40db-b2f2-49509c76d9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:47.454593 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb5223-11dd-40db-b2f2-49509c76d9f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:47.455385 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb5223-11dd-40db-b2f2-49509c76d9f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:47.457369 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb5223-11dd-40db-b2f2-49509c76d9f4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:47.492571 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1065/2134] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:30:47 2021] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:30:47.496195 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d7b19-0370-492b-a376-429a85449d71 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:47.509415 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d7b19-0370-492b-a376-429a85449d71 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:47.569460 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd04b0-03a7-4b12-b2bc-6b548a2caba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:47.570296 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd04b0-03a7-4b12-b2bc-6b548a2caba9 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:47.570656 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd04b0-03a7-4b12-b2bc-6b548a2caba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:47.570998 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd04b0-03a7-4b12-b2bc-6b548a2caba9 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:47.571927 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd04b0-03a7-4b12-b2bc-6b548a2caba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:47.573982 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd04b0-03a7-4b12-b2bc-6b548a2caba9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:47.599630 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1070/2135] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:30:47 2021] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:30:47.603406 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb5223-11dd-40db-b2f2-49509c76d9f4 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:47.615544 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb5223-11dd-40db-b2f2-49509c76d9f4 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:47.621879 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76cbcc-b0bf-48ac-aa58-0ec73fa99c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:47.623146 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76cbcc-b0bf-48ac-aa58-0ec73fa99c6f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:47.623533 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76cbcc-b0bf-48ac-aa58-0ec73fa99c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:47.623925 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76cbcc-b0bf-48ac-aa58-0ec73fa99c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:47.624727 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76cbcc-b0bf-48ac-aa58-0ec73fa99c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:47.626467 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76cbcc-b0bf-48ac-aa58-0ec73fa99c6f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:47.640972 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1066/2136] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:47 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:30:47.644948 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd04b0-03a7-4b12-b2bc-6b548a2caba9 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:47.655442 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd04b0-03a7-4b12-b2bc-6b548a2caba9 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:47.663087 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b4822-b9db-46e6-b40e-d1b9c7b5f367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:47.663838 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b4822-b9db-46e6-b40e-d1b9c7b5f367 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:47.664204 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b4822-b9db-46e6-b40e-d1b9c7b5f367 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:47.664548 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b4822-b9db-46e6-b40e-d1b9c7b5f367 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:47.665541 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b4822-b9db-46e6-b40e-d1b9c7b5f367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:47.667429 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b4822-b9db-46e6-b40e-d1b9c7b5f367 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:47.678760 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1071/2137] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:47 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:30:47.682973 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76cbcc-b0bf-48ac-aa58-0ec73fa99c6f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:47.693364 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76cbcc-b0bf-48ac-aa58-0ec73fa99c6f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:47.698552 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6499d-7ff5-4074-99e3-e68d170adc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:47.699424 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6499d-7ff5-4074-99e3-e68d170adc23 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:47.699702 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6499d-7ff5-4074-99e3-e68d170adc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:47.699978 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6499d-7ff5-4074-99e3-e68d170adc23 admin admin] PATH_INFO: `/v3/projects/c266ddd7869947c0a1357e820784a10e/users/dbd46ace1f49451caf28c5b1256dd396/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:47.714708 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6499d-7ff5-4074-99e3-e68d170adc23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c266ddd7869947c0a1357e820784a10e, user_id=dbd46ace1f49451caf28c5b1256dd396, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:47.717905 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6499d-7ff5-4074-99e3-e68d170adc23 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:47.731440 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1067/2138] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:47 2021] PUT /identity/v3/projects/c266ddd7869947c0a1357e820784a10e/users/dbd46ace1f49451caf28c5b1256dd396/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:30:47.742785 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a84e25-14d2-45ca-8879-709f77d485ac None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:47.743067 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a84e25-14d2-45ca-8879-709f77d485ac None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:47.743327 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a84e25-14d2-45ca-8879-709f77d485ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:47.771496 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-e9a84e25-14d2-45ca-8879-709f77d485ac None None] MFA Rules not processed for user `dbd46ace1f49451caf28c5b1256dd396`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:47.772620 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e9a84e25-14d2-45ca-8879-709f77d485ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:47.836114 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1072/2139] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:47 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:47.840815 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6499d-7ff5-4074-99e3-e68d170adc23 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:47.901717 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6499d-7ff5-4074-99e3-e68d170adc23 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:47.907163 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8cc76-acc2-4438-83a3-b7c48d0c6e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:47.907821 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8cc76-acc2-4438-83a3-b7c48d0c6e06 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:47.908102 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8cc76-acc2-4438-83a3-b7c48d0c6e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:47.908379 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8cc76-acc2-4438-83a3-b7c48d0c6e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:47.909108 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8cc76-acc2-4438-83a3-b7c48d0c6e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:47.911045 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8cc76-acc2-4438-83a3-b7c48d0c6e06 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:47.936092 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1068/2140] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:30:47 2021] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:30:47.940861 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a84e25-14d2-45ca-8879-709f77d485ac None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:47.952850 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a84e25-14d2-45ca-8879-709f77d485ac None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:48.010280 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ba212-640e-451f-8c8d-7096afc6d9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:48.010958 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ba212-640e-451f-8c8d-7096afc6d9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:48.011236 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ba212-640e-451f-8c8d-7096afc6d9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:48.011515 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ba212-640e-451f-8c8d-7096afc6d9f8 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:48.012213 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ba212-640e-451f-8c8d-7096afc6d9f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:48.014189 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ba212-640e-451f-8c8d-7096afc6d9f8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:48.037176 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1073/2141] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:30:47 2021] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:30:48.038388 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8cc76-acc2-4438-83a3-b7c48d0c6e06 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:48.049411 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8cc76-acc2-4438-83a3-b7c48d0c6e06 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:48.054574 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b1a34-9963-47da-a6f8-2b2b602930be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:48.055324 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b1a34-9963-47da-a6f8-2b2b602930be admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:48.056418 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b1a34-9963-47da-a6f8-2b2b602930be admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:48.056817 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b1a34-9963-47da-a6f8-2b2b602930be admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:48.057629 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b1a34-9963-47da-a6f8-2b2b602930be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:48.059229 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b1a34-9963-47da-a6f8-2b2b602930be admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:48.070967 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1069/2142] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:48 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:30:48.075404 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ba212-640e-451f-8c8d-7096afc6d9f8 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:48.085367 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ba212-640e-451f-8c8d-7096afc6d9f8 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:48.089979 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3ff21-133c-464d-a5ee-206c0f1ba262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:48.090843 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3ff21-133c-464d-a5ee-206c0f1ba262 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:48.091122 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3ff21-133c-464d-a5ee-206c0f1ba262 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:48.091392 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3ff21-133c-464d-a5ee-206c0f1ba262 admin admin] PATH_INFO: `/v3/projects/762c45eb656b427e9698ac24f6ef2c22/users/348ca7c8babd40a68f89054b804cb458/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:48.106699 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3ff21-133c-464d-a5ee-206c0f1ba262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=762c45eb656b427e9698ac24f6ef2c22, user_id=348ca7c8babd40a68f89054b804cb458, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:48.110026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3ff21-133c-464d-a5ee-206c0f1ba262 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:48.123450 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1074/2143] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:48 2021] PUT /identity/v3/projects/762c45eb656b427e9698ac24f6ef2c22/users/348ca7c8babd40a68f89054b804cb458/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:48.127454 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b1a34-9963-47da-a6f8-2b2b602930be admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:48.137587 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b1a34-9963-47da-a6f8-2b2b602930be admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:48.198729 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b776d3d-b0f6-4f58-a934-bf321c06b306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:48.199400 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b776d3d-b0f6-4f58-a934-bf321c06b306 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:48.199680 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b776d3d-b0f6-4f58-a934-bf321c06b306 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:48.200043 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b776d3d-b0f6-4f58-a934-bf321c06b306 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:48.200810 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b776d3d-b0f6-4f58-a934-bf321c06b306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:48.202515 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b776d3d-b0f6-4f58-a934-bf321c06b306 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:48.212641 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1070/2144] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:48 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:30:48.218088 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3ff21-133c-464d-a5ee-206c0f1ba262 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:48.230759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3ff21-133c-464d-a5ee-206c0f1ba262 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:48.237068 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513014e2-d24a-47ed-bd99-7294ee6e276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:48.238781 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513014e2-d24a-47ed-bd99-7294ee6e276a admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:48.239083 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513014e2-d24a-47ed-bd99-7294ee6e276a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:48.239345 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513014e2-d24a-47ed-bd99-7294ee6e276a admin admin] PATH_INFO: `/v3/projects/762c45eb656b427e9698ac24f6ef2c22/users/348ca7c8babd40a68f89054b804cb458/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:48.241495 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513014e2-d24a-47ed-bd99-7294ee6e276a admin admin] RBAC: Authorizing `identity:create_grant(project_id=762c45eb656b427e9698ac24f6ef2c22, user_id=348ca7c8babd40a68f89054b804cb458, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:48.244201 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513014e2-d24a-47ed-bd99-7294ee6e276a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:48.255139 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1075/2145] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:48 2021] PUT /identity/v3/projects/762c45eb656b427e9698ac24f6ef2c22/users/348ca7c8babd40a68f89054b804cb458/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:48.265386 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fe950-3a4b-486d-8562-7f53346e1596 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:48.265681 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fe950-3a4b-486d-8562-7f53346e1596 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:48.266053 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fe950-3a4b-486d-8562-7f53346e1596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:48.296096 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-4a4fe950-3a4b-486d-8562-7f53346e1596 None None] MFA Rules not processed for user `348ca7c8babd40a68f89054b804cb458`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:48.297362 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4a4fe950-3a4b-486d-8562-7f53346e1596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:48.374718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1071/2146] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:48 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:48.385316 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513014e2-d24a-47ed-bd99-7294ee6e276a admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:48.387140 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-513014e2-d24a-47ed-bd99-7294ee6e276a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:48.451605 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513014e2-d24a-47ed-bd99-7294ee6e276a admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:48.455890 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a0728-a19f-4fd5-b1d6-82e755276864 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:48.456646 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a0728-a19f-4fd5-b1d6-82e755276864 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:48.456811 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a0728-a19f-4fd5-b1d6-82e755276864 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:48.457161 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a0728-a19f-4fd5-b1d6-82e755276864 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:48.472741 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a0728-a19f-4fd5-b1d6-82e755276864 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:48.474834 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a0728-a19f-4fd5-b1d6-82e755276864 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:48.487906 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1076/2147] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:48 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:48.533843 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fe950-3a4b-486d-8562-7f53346e1596 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:48.537054 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4a4fe950-3a4b-486d-8562-7f53346e1596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:48.554457 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fe950-3a4b-486d-8562-7f53346e1596 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:48.558434 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f65bc4-90e0-42a0-9bc8-eed049fe0133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:48.559219 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f65bc4-90e0-42a0-9bc8-eed049fe0133 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:48.559490 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f65bc4-90e0-42a0-9bc8-eed049fe0133 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:48.559774 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f65bc4-90e0-42a0-9bc8-eed049fe0133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:48.617061 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f65bc4-90e0-42a0-9bc8-eed049fe0133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:48.618527 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f65bc4-90e0-42a0-9bc8-eed049fe0133 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:48.628921 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1072/2148] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:48 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:51.515673 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a0728-a19f-4fd5-b1d6-82e755276864 service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:51.579870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a0728-a19f-4fd5-b1d6-82e755276864 service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:51.584456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7f0e6-fab0-48b1-878d-0801dffafa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:51.585350 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7f0e6-fab0-48b1-878d-0801dffafa29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:51.585690 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7f0e6-fab0-48b1-878d-0801dffafa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:51.585899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7f0e6-fab0-48b1-878d-0801dffafa29 admin admin] PATH_INFO: `/v3/users/d50b99266e5c4e60ab29f803d66561ad` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:51.587127 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7f0e6-fab0-48b1-878d-0801dffafa29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50b99266e5c4e60ab29f803d66561ad)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:51.589047 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7f0e6-fab0-48b1-878d-0801dffafa29 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:51.635223 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-78f7f0e6-fab0-48b1-878d-0801dffafa29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50b99266e5c4e60ab29f803d66561ad'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:51.635867 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-78f7f0e6-fab0-48b1-878d-0801dffafa29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50b99266e5c4e60ab29f803d66561ad'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:51.645745 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-78f7f0e6-fab0-48b1-878d-0801dffafa29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50b99266e5c4e60ab29f803d66561ad'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:51.646487 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-78f7f0e6-fab0-48b1-878d-0801dffafa29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50b99266e5c4e60ab29f803d66561ad'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:51.658552 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-78f7f0e6-fab0-48b1-878d-0801dffafa29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50b99266e5c4e60ab29f803d66561ad'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:51.670856 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1077/2149] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:30:51 2021] DELETE /identity/v3/users/d50b99266e5c4e60ab29f803d66561ad => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:51.675543 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de293c-db97-40a1-9ed7-6e2fbfc4010f None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:51.676008 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de293c-db97-40a1-9ed7-6e2fbfc4010f None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:51.676130 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de293c-db97-40a1-9ed7-6e2fbfc4010f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:51.693716 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-67de293c-db97-40a1-9ed7-6e2fbfc4010f None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:51.695114 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-67de293c-db97-40a1-9ed7-6e2fbfc4010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:51.798672 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1073/2150] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:51.811944 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7f0e6-fab0-48b1-878d-0801dffafa29 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:51.814672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-78f7f0e6-fab0-48b1-878d-0801dffafa29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:51.889678 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7f0e6-fab0-48b1-878d-0801dffafa29 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:51.893881 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75de74-3b70-4106-91f1-dec143e82967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:51.894620 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75de74-3b70-4106-91f1-dec143e82967 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:51.895122 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75de74-3b70-4106-91f1-dec143e82967 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:51.895380 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75de74-3b70-4106-91f1-dec143e82967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:51.908543 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75de74-3b70-4106-91f1-dec143e82967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:51.911627 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75de74-3b70-4106-91f1-dec143e82967 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:51.924509 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1078/2151] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:30:52.681406 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de293c-db97-40a1-9ed7-6e2fbfc4010f None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:52.683397 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-67de293c-db97-40a1-9ed7-6e2fbfc4010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:52.699353 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de293c-db97-40a1-9ed7-6e2fbfc4010f None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:52.705690 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034b202-2903-4b3a-a3b8-7a5e4ce24f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:52.707050 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034b202-2903-4b3a-a3b8-7a5e4ce24f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:52.707521 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034b202-2903-4b3a-a3b8-7a5e4ce24f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:52.707798 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034b202-2903-4b3a-a3b8-7a5e4ce24f60 admin admin] PATH_INFO: `/v3/projects/c78a3bd08aac452fb808b6eb493a48d8` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:52.709212 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034b202-2903-4b3a-a3b8-7a5e4ce24f60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c78a3bd08aac452fb808b6eb493a48d8)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:52.711132 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034b202-2903-4b3a-a3b8-7a5e4ce24f60 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:52.768142 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0034b202-2903-4b3a-a3b8-7a5e4ce24f60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c78a3bd08aac452fb808b6eb493a48d8', 'request_id': 'req-0034b202-2903-4b3a-a3b8-7a5e4ce24f60'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:52.774625 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0034b202-2903-4b3a-a3b8-7a5e4ce24f60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c78a3bd08aac452fb808b6eb493a48d8', 'request_id': 'req-0034b202-2903-4b3a-a3b8-7a5e4ce24f60'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:52.784365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0034b202-2903-4b3a-a3b8-7a5e4ce24f60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c78a3bd08aac452fb808b6eb493a48d8', 'request_id': 'req-0034b202-2903-4b3a-a3b8-7a5e4ce24f60'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:52.799677 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0034b202-2903-4b3a-a3b8-7a5e4ce24f60 admin admin] The token cache is being invalidate because project c78a3bd08aac452fb808b6eb493a48d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:30:52.799677 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0034b202-2903-4b3a-a3b8-7a5e4ce24f60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:52.799677 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0034b202-2903-4b3a-a3b8-7a5e4ce24f60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:52.801496 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1074/2152] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:30:52 2021] DELETE /identity/v3/projects/c78a3bd08aac452fb808b6eb493a48d8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:52.805058 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75de74-3b70-4106-91f1-dec143e82967 service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:52.817620 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75de74-3b70-4106-91f1-dec143e82967 service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:52.883494 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc932e-38f5-4128-9e21-589fd382cab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:52.887843 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc932e-38f5-4128-9e21-589fd382cab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:52.890544 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc932e-38f5-4128-9e21-589fd382cab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:52.890918 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc932e-38f5-4128-9e21-589fd382cab5 admin admin] PATH_INFO: `/v3/users/dbd46ace1f49451caf28c5b1256dd396` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:52.894150 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc932e-38f5-4128-9e21-589fd382cab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd46ace1f49451caf28c5b1256dd396)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:52.895933 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc932e-38f5-4128-9e21-589fd382cab5 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:52.996076 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-78dc932e-38f5-4128-9e21-589fd382cab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd46ace1f49451caf28c5b1256dd396'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:52.997031 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-78dc932e-38f5-4128-9e21-589fd382cab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd46ace1f49451caf28c5b1256dd396'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:53.010908 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-78dc932e-38f5-4128-9e21-589fd382cab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd46ace1f49451caf28c5b1256dd396'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:53.013031 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-78dc932e-38f5-4128-9e21-589fd382cab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd46ace1f49451caf28c5b1256dd396'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:53.039001 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-78dc932e-38f5-4128-9e21-589fd382cab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd46ace1f49451caf28c5b1256dd396'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:53.073764 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1079/2153] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:30:52 2021] DELETE /identity/v3/users/dbd46ace1f49451caf28c5b1256dd396 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:30:53.640929 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034b202-2903-4b3a-a3b8-7a5e4ce24f60 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:53.642497 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-0034b202-2903-4b3a-a3b8-7a5e4ce24f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:53.662979 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034b202-2903-4b3a-a3b8-7a5e4ce24f60 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:53.734747 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba9bc8-d15a-4d94-a549-76460812a0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:53.735610 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba9bc8-d15a-4d94-a549-76460812a0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:53.735890 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba9bc8-d15a-4d94-a549-76460812a0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:53.736166 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba9bc8-d15a-4d94-a549-76460812a0cc admin admin] PATH_INFO: `/v3/projects/c266ddd7869947c0a1357e820784a10e` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:53.737443 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba9bc8-d15a-4d94-a549-76460812a0cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c266ddd7869947c0a1357e820784a10e)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:53.739382 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba9bc8-d15a-4d94-a549-76460812a0cc admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:53.791957 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-50ba9bc8-d15a-4d94-a549-76460812a0cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c266ddd7869947c0a1357e820784a10e', 'request_id': 'req-50ba9bc8-d15a-4d94-a549-76460812a0cc'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:53.798244 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-50ba9bc8-d15a-4d94-a549-76460812a0cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c266ddd7869947c0a1357e820784a10e', 'request_id': 'req-50ba9bc8-d15a-4d94-a549-76460812a0cc'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:53.814348 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-50ba9bc8-d15a-4d94-a549-76460812a0cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c266ddd7869947c0a1357e820784a10e', 'request_id': 'req-50ba9bc8-d15a-4d94-a549-76460812a0cc'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:53.829831 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-50ba9bc8-d15a-4d94-a549-76460812a0cc admin admin] The token cache is being invalidate because project c266ddd7869947c0a1357e820784a10e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:30:53.830192 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-50ba9bc8-d15a-4d94-a549-76460812a0cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:53.831083 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-50ba9bc8-d15a-4d94-a549-76460812a0cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:53.833910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1075/2154] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:30:53 2021] DELETE /identity/v3/projects/c266ddd7869947c0a1357e820784a10e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:53.838004 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc932e-38f5-4128-9e21-589fd382cab5 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:53.840953 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-78dc932e-38f5-4128-9e21-589fd382cab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:53.858953 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc932e-38f5-4128-9e21-589fd382cab5 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:53.918217 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92254be-9971-441a-9ab4-b59369ce639b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:53.919102 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92254be-9971-441a-9ab4-b59369ce639b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:53.919899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92254be-9971-441a-9ab4-b59369ce639b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:53.920172 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92254be-9971-441a-9ab4-b59369ce639b admin admin] PATH_INFO: `/v3/users/348ca7c8babd40a68f89054b804cb458` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:53.921421 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92254be-9971-441a-9ab4-b59369ce639b admin admin] RBAC: Authorizing `identity:delete_user(user_id=348ca7c8babd40a68f89054b804cb458)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:53.923601 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92254be-9971-441a-9ab4-b59369ce639b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:53.971476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c92254be-9971-441a-9ab4-b59369ce639b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '348ca7c8babd40a68f89054b804cb458'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:53.972051 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c92254be-9971-441a-9ab4-b59369ce639b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '348ca7c8babd40a68f89054b804cb458'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:53.979308 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c92254be-9971-441a-9ab4-b59369ce639b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '348ca7c8babd40a68f89054b804cb458'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:53.979915 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c92254be-9971-441a-9ab4-b59369ce639b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '348ca7c8babd40a68f89054b804cb458'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:53.991979 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c92254be-9971-441a-9ab4-b59369ce639b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '348ca7c8babd40a68f89054b804cb458'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:54.004826 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1080/2155] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:30:53 2021] DELETE /identity/v3/users/348ca7c8babd40a68f89054b804cb458 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:54.330647 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba9bc8-d15a-4d94-a549-76460812a0cc admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:54.333289 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-50ba9bc8-d15a-4d94-a549-76460812a0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:54.350577 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba9bc8-d15a-4d94-a549-76460812a0cc admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:54.463067 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519d721-2518-4adc-a4b9-b91d513137ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:54.464017 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519d721-2518-4adc-a4b9-b91d513137ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:54.464365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519d721-2518-4adc-a4b9-b91d513137ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:54.464709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519d721-2518-4adc-a4b9-b91d513137ab admin admin] PATH_INFO: `/v3/projects/762c45eb656b427e9698ac24f6ef2c22` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:54.466606 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519d721-2518-4adc-a4b9-b91d513137ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=762c45eb656b427e9698ac24f6ef2c22)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:54.468713 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519d721-2518-4adc-a4b9-b91d513137ab admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:54.568692 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8519d721-2518-4adc-a4b9-b91d513137ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '762c45eb656b427e9698ac24f6ef2c22', 'request_id': 'req-8519d721-2518-4adc-a4b9-b91d513137ab'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:54.581157 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8519d721-2518-4adc-a4b9-b91d513137ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '762c45eb656b427e9698ac24f6ef2c22', 'request_id': 'req-8519d721-2518-4adc-a4b9-b91d513137ab'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:54.610810 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8519d721-2518-4adc-a4b9-b91d513137ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '762c45eb656b427e9698ac24f6ef2c22', 'request_id': 'req-8519d721-2518-4adc-a4b9-b91d513137ab'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:54.631847 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8519d721-2518-4adc-a4b9-b91d513137ab admin admin] The token cache is being invalidate because project 762c45eb656b427e9698ac24f6ef2c22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:30:54.632344 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8519d721-2518-4adc-a4b9-b91d513137ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:54.633169 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8519d721-2518-4adc-a4b9-b91d513137ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:30:54.634883 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1076/2156] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:30:54 2021] DELETE /identity/v3/projects/762c45eb656b427e9698ac24f6ef2c22 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:54.641637 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2425682-d7da-4fd8-8a98-609e8d955389 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:54.642311 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2425682-d7da-4fd8-8a98-609e8d955389 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:54.642736 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2425682-d7da-4fd8-8a98-609e8d955389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:54.673370 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-c2425682-d7da-4fd8-8a98-609e8d955389 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:54.674878 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c2425682-d7da-4fd8-8a98-609e8d955389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:54.814919 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1081/2157] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:30:54.823142 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2821cb0-7a64-426e-811d-d20350f037a0 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:54.823658 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2821cb0-7a64-426e-811d-d20350f037a0 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:54.823764 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2821cb0-7a64-426e-811d-d20350f037a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:54.853522 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-f2821cb0-7a64-426e-811d-d20350f037a0 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:54.854718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f2821cb0-7a64-426e-811d-d20350f037a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:54.863797 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1077/2158] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:54.868299 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2425682-d7da-4fd8-8a98-609e8d955389 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:54.879814 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2425682-d7da-4fd8-8a98-609e8d955389 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:54.885701 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be10ae-800e-4189-9e03-8206279561a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:54.886560 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be10ae-800e-4189-9e03-8206279561a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:54.886938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be10ae-800e-4189-9e03-8206279561a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:54.887445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be10ae-800e-4189-9e03-8206279561a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:54.889016 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be10ae-800e-4189-9e03-8206279561a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:30:54.889546 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be10ae-800e-4189-9e03-8206279561a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:54.891220 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be10ae-800e-4189-9e03-8206279561a4 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:54.911070 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1082/2159] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:30:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:30:54.916270 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2821cb0-7a64-426e-811d-d20350f037a0 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:54.927174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2821cb0-7a64-426e-811d-d20350f037a0 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:54.934359 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ba3ea-78f9-4c9b-a7c2-6262f59f86a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:54.935613 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ba3ea-78f9-4c9b-a7c2-6262f59f86a1 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:54.935907 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ba3ea-78f9-4c9b-a7c2-6262f59f86a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:54.936189 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ba3ea-78f9-4c9b-a7c2-6262f59f86a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:54.936936 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ba3ea-78f9-4c9b-a7c2-6262f59f86a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:54.939912 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ba3ea-78f9-4c9b-a7c2-6262f59f86a1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:54.975855 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1078/2160] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:30:54 2021] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:30:54.980505 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be10ae-800e-4189-9e03-8206279561a4 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:54.991153 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be10ae-800e-4189-9e03-8206279561a4 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:55.053945 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfba9b0-400d-41ea-8972-02365b7b33ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:55.054705 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfba9b0-400d-41ea-8972-02365b7b33ba admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:55.054992 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfba9b0-400d-41ea-8972-02365b7b33ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:55.055281 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfba9b0-400d-41ea-8972-02365b7b33ba admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:55.055947 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfba9b0-400d-41ea-8972-02365b7b33ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:55.057880 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfba9b0-400d-41ea-8972-02365b7b33ba admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:55.080012 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1083/2161] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:30:54 2021] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:30:55.084225 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ba3ea-78f9-4c9b-a7c2-6262f59f86a1 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:55.095866 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ba3ea-78f9-4c9b-a7c2-6262f59f86a1 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:55.101339 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46300e7-d5db-4a72-8922-3f9ffeeb1b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:55.102018 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46300e7-d5db-4a72-8922-3f9ffeeb1b15 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:55.102297 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46300e7-d5db-4a72-8922-3f9ffeeb1b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:55.102576 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46300e7-d5db-4a72-8922-3f9ffeeb1b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:55.103300 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46300e7-d5db-4a72-8922-3f9ffeeb1b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:55.104950 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46300e7-d5db-4a72-8922-3f9ffeeb1b15 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:55.116411 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1079/2162] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:55 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:30:55.120655 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfba9b0-400d-41ea-8972-02365b7b33ba admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:55.130607 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfba9b0-400d-41ea-8972-02365b7b33ba admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:55.137518 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc829fa-64ce-4f14-be18-7abf73234cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:55.138244 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc829fa-64ce-4f14-be18-7abf73234cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:55.138504 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc829fa-64ce-4f14-be18-7abf73234cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:55.138774 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc829fa-64ce-4f14-be18-7abf73234cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:55.139508 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc829fa-64ce-4f14-be18-7abf73234cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:55.141110 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc829fa-64ce-4f14-be18-7abf73234cd5 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:55.151121 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1084/2163] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:30:55 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:30:55.155978 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46300e7-d5db-4a72-8922-3f9ffeeb1b15 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:55.166056 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46300e7-d5db-4a72-8922-3f9ffeeb1b15 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:55.171524 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06523cb-c2ac-403f-b39a-09729bd30e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:55.172437 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06523cb-c2ac-403f-b39a-09729bd30e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:55.172719 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06523cb-c2ac-403f-b39a-09729bd30e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:55.173035 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06523cb-c2ac-403f-b39a-09729bd30e8f admin admin] PATH_INFO: `/v3/projects/cfdda32417c8466bb74c29c2031a1003/users/ab7e4f6036924452b4b019bcac929f69/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:55.186930 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06523cb-c2ac-403f-b39a-09729bd30e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfdda32417c8466bb74c29c2031a1003, user_id=ab7e4f6036924452b4b019bcac929f69, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:55.189587 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06523cb-c2ac-403f-b39a-09729bd30e8f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:55.202329 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1080/2164] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:30:55 2021] PUT /identity/v3/projects/cfdda32417c8466bb74c29c2031a1003/users/ab7e4f6036924452b4b019bcac929f69/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:30:55.214472 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b3e5b-31e6-42fc-b72e-78eb38986ba8 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:55.214768 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b3e5b-31e6-42fc-b72e-78eb38986ba8 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:55.215048 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b3e5b-31e6-42fc-b72e-78eb38986ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:55.244364 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-3a2b3e5b-31e6-42fc-b72e-78eb38986ba8 None None] MFA Rules not processed for user `ab7e4f6036924452b4b019bcac929f69`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:30:55.245579 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-3a2b3e5b-31e6-42fc-b72e-78eb38986ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:55.309037 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1085/2165] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:30:55 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:30:55.321573 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06523cb-c2ac-403f-b39a-09729bd30e8f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:30:55.323414 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f06523cb-c2ac-403f-b39a-09729bd30e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:30:55.383282 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06523cb-c2ac-403f-b39a-09729bd30e8f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:30:55.387208 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cbe95-a4d6-4dd8-8eac-793d81a95734 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d661d14d94fa597aee037599de7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:30:55.387866 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cbe95-a4d6-4dd8-8eac-793d81a95734 service glance] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:30:55.388188 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cbe95-a4d6-4dd8-8eac-793d81a95734 service glance] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:30:55.388469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cbe95-a4d6-4dd8-8eac-793d81a95734 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:30:55.398993 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cbe95-a4d6-4dd8-8eac-793d81a95734 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:30:55.400445 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cbe95-a4d6-4dd8-8eac-793d81a95734 service glance] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:30:55.411188 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1081/2166] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:30:55 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:31:03.144784 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b3e5b-31e6-42fc-b72e-78eb38986ba8 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:03.146399 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-3a2b3e5b-31e6-42fc-b72e-78eb38986ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:03.219060 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b3e5b-31e6-42fc-b72e-78eb38986ba8 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:03.224660 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9dccf-86b9-41d2-b106-102183063d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:03.225568 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9dccf-86b9-41d2-b106-102183063d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:03.225848 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9dccf-86b9-41d2-b106-102183063d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:03.226117 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9dccf-86b9-41d2-b106-102183063d48 admin admin] PATH_INFO: `/v3/users/257eb0a43dad490a988d37150655c50a` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:03.227309 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9dccf-86b9-41d2-b106-102183063d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=257eb0a43dad490a988d37150655c50a)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:03.229272 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9dccf-86b9-41d2-b106-102183063d48 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:03.273895 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-71a9dccf-86b9-41d2-b106-102183063d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '257eb0a43dad490a988d37150655c50a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:03.274536 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-71a9dccf-86b9-41d2-b106-102183063d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '257eb0a43dad490a988d37150655c50a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:03.282100 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-71a9dccf-86b9-41d2-b106-102183063d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '257eb0a43dad490a988d37150655c50a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:03.282697 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-71a9dccf-86b9-41d2-b106-102183063d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '257eb0a43dad490a988d37150655c50a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:03.295328 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-71a9dccf-86b9-41d2-b106-102183063d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '257eb0a43dad490a988d37150655c50a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:03.307610 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1086/2167] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:31:03 2021] DELETE /identity/v3/users/257eb0a43dad490a988d37150655c50a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:31:03.524499 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cbe95-a4d6-4dd8-8eac-793d81a95734 service glance] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:03.540695 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cbe95-a4d6-4dd8-8eac-793d81a95734 service glance] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:03.614713 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ea47b-a796-447c-ab0d-01cde78a8efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:03.615777 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ea47b-a796-447c-ab0d-01cde78a8efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:03.616446 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ea47b-a796-447c-ab0d-01cde78a8efd admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:03.616895 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ea47b-a796-447c-ab0d-01cde78a8efd admin admin] PATH_INFO: `/v3/projects/937cafa2ddd247a4b56fb1f4d915b6ba` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:03.618375 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ea47b-a796-447c-ab0d-01cde78a8efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=937cafa2ddd247a4b56fb1f4d915b6ba)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:03.620446 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ea47b-a796-447c-ab0d-01cde78a8efd admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:03.678086 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-9c7ea47b-a796-447c-ab0d-01cde78a8efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '937cafa2ddd247a4b56fb1f4d915b6ba', 'request_id': 'req-9c7ea47b-a796-447c-ab0d-01cde78a8efd'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:03.684261 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-9c7ea47b-a796-447c-ab0d-01cde78a8efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '937cafa2ddd247a4b56fb1f4d915b6ba', 'request_id': 'req-9c7ea47b-a796-447c-ab0d-01cde78a8efd'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:03.694059 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-9c7ea47b-a796-447c-ab0d-01cde78a8efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '937cafa2ddd247a4b56fb1f4d915b6ba', 'request_id': 'req-9c7ea47b-a796-447c-ab0d-01cde78a8efd'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:03.705762 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-9c7ea47b-a796-447c-ab0d-01cde78a8efd admin admin] The token cache is being invalidate because project 937cafa2ddd247a4b56fb1f4d915b6ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:31:03.706054 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-9c7ea47b-a796-447c-ab0d-01cde78a8efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:03.706694 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-9c7ea47b-a796-447c-ab0d-01cde78a8efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:03.708614 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1082/2168] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:31:03 2021] DELETE /identity/v3/projects/937cafa2ddd247a4b56fb1f4d915b6ba => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:31:03.712414 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9dccf-86b9-41d2-b106-102183063d48 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:03.714017 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-71a9dccf-86b9-41d2-b106-102183063d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:03.727936 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9dccf-86b9-41d2-b106-102183063d48 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:03.801274 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147b10a-cf55-45ed-9e93-80b7b44a15ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:03.802307 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147b10a-cf55-45ed-9e93-80b7b44a15ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:03.802684 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147b10a-cf55-45ed-9e93-80b7b44a15ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:03.803101 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147b10a-cf55-45ed-9e93-80b7b44a15ce admin admin] PATH_INFO: `/v3/users/004d3ba8be64422c8c0731fd3e92b656` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:03.804377 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147b10a-cf55-45ed-9e93-80b7b44a15ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=004d3ba8be64422c8c0731fd3e92b656)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:03.806429 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147b10a-cf55-45ed-9e93-80b7b44a15ce admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:03.857924 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c147b10a-cf55-45ed-9e93-80b7b44a15ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '004d3ba8be64422c8c0731fd3e92b656'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:03.858582 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c147b10a-cf55-45ed-9e93-80b7b44a15ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '004d3ba8be64422c8c0731fd3e92b656'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:03.865834 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c147b10a-cf55-45ed-9e93-80b7b44a15ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '004d3ba8be64422c8c0731fd3e92b656'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:03.866572 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c147b10a-cf55-45ed-9e93-80b7b44a15ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '004d3ba8be64422c8c0731fd3e92b656'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:03.879266 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c147b10a-cf55-45ed-9e93-80b7b44a15ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '004d3ba8be64422c8c0731fd3e92b656'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:03.893738 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1087/2169] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:31:03 2021] DELETE /identity/v3/users/004d3ba8be64422c8c0731fd3e92b656 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:31:04.071698 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ea47b-a796-447c-ab0d-01cde78a8efd admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:04.073172 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-9c7ea47b-a796-447c-ab0d-01cde78a8efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:04.092927 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ea47b-a796-447c-ab0d-01cde78a8efd admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:04.152133 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167a7e9-8a84-4a3a-9345-0eba4027714a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:04.152995 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167a7e9-8a84-4a3a-9345-0eba4027714a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:04.153842 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167a7e9-8a84-4a3a-9345-0eba4027714a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:04.154124 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167a7e9-8a84-4a3a-9345-0eba4027714a admin admin] PATH_INFO: `/v3/projects/2bd34824cbfa4dafb8f1f5f3ef8b83ea` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:04.155310 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167a7e9-8a84-4a3a-9345-0eba4027714a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bd34824cbfa4dafb8f1f5f3ef8b83ea)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:04.157240 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167a7e9-8a84-4a3a-9345-0eba4027714a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:04.202017 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d167a7e9-8a84-4a3a-9345-0eba4027714a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bd34824cbfa4dafb8f1f5f3ef8b83ea', 'request_id': 'req-d167a7e9-8a84-4a3a-9345-0eba4027714a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:04.208841 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d167a7e9-8a84-4a3a-9345-0eba4027714a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bd34824cbfa4dafb8f1f5f3ef8b83ea', 'request_id': 'req-d167a7e9-8a84-4a3a-9345-0eba4027714a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:04.216728 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d167a7e9-8a84-4a3a-9345-0eba4027714a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bd34824cbfa4dafb8f1f5f3ef8b83ea', 'request_id': 'req-d167a7e9-8a84-4a3a-9345-0eba4027714a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:04.228521 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d167a7e9-8a84-4a3a-9345-0eba4027714a admin admin] The token cache is being invalidate because project 2bd34824cbfa4dafb8f1f5f3ef8b83ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:31:04.228813 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d167a7e9-8a84-4a3a-9345-0eba4027714a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:04.229484 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d167a7e9-8a84-4a3a-9345-0eba4027714a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:04.231063 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1083/2170] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:31:04 2021] DELETE /identity/v3/projects/2bd34824cbfa4dafb8f1f5f3ef8b83ea => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:31:04.237470 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e879156-2582-4938-8bb5-b3e834e2f750 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:04.237923 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e879156-2582-4938-8bb5-b3e834e2f750 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:04.238178 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e879156-2582-4938-8bb5-b3e834e2f750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:04.261250 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-2e879156-2582-4938-8bb5-b3e834e2f750 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:04.262994 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-2e879156-2582-4938-8bb5-b3e834e2f750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:04.329262 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1088/2171] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:31:04.333293 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7f43d-6849-423e-a162-e35fd831240e None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:04.333520 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7f43d-6849-423e-a162-e35fd831240e None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:04.333799 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7f43d-6849-423e-a162-e35fd831240e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:04.352752 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-6de7f43d-6849-423e-a162-e35fd831240e None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:04.354091 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-6de7f43d-6849-423e-a162-e35fd831240e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:04.362355 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1084/2172] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:31:04.366838 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e879156-2582-4938-8bb5-b3e834e2f750 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:04.377152 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e879156-2582-4938-8bb5-b3e834e2f750 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:04.382384 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7fd9e-fe41-4837-b421-524bb0fc6684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:04.383060 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7fd9e-fe41-4837-b421-524bb0fc6684 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:04.383343 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7fd9e-fe41-4837-b421-524bb0fc6684 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:04.383624 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7fd9e-fe41-4837-b421-524bb0fc6684 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:04.384362 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7fd9e-fe41-4837-b421-524bb0fc6684 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:31:04.384678 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7fd9e-fe41-4837-b421-524bb0fc6684 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:04.386357 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7fd9e-fe41-4837-b421-524bb0fc6684 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:04.409643 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1089/2173] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:31:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:31:04.414444 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7f43d-6849-423e-a162-e35fd831240e None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:04.424363 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7f43d-6849-423e-a162-e35fd831240e None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:04.429303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c11ab-28fa-400c-aaea-a3d3392d2271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:04.429923 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c11ab-28fa-400c-aaea-a3d3392d2271 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:04.430204 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c11ab-28fa-400c-aaea-a3d3392d2271 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:04.430481 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c11ab-28fa-400c-aaea-a3d3392d2271 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:04.431236 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c11ab-28fa-400c-aaea-a3d3392d2271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:04.433163 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c11ab-28fa-400c-aaea-a3d3392d2271 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:04.461261 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1085/2174] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:31:04 2021] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:31:04.465193 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7fd9e-fe41-4837-b421-524bb0fc6684 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:04.483008 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7fd9e-fe41-4837-b421-524bb0fc6684 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:04.541548 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700516a3-5649-4f66-b56f-ee973b04eb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:04.542330 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700516a3-5649-4f66-b56f-ee973b04eb6b admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:04.542641 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700516a3-5649-4f66-b56f-ee973b04eb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:04.542984 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700516a3-5649-4f66-b56f-ee973b04eb6b admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:04.543787 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700516a3-5649-4f66-b56f-ee973b04eb6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:04.546145 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700516a3-5649-4f66-b56f-ee973b04eb6b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:04.566482 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1090/2175] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:31:04 2021] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:31:04.570564 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c11ab-28fa-400c-aaea-a3d3392d2271 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:04.581228 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c11ab-28fa-400c-aaea-a3d3392d2271 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:04.586086 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fce8df-ccd7-4273-9030-347c16f7dfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:04.586739 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fce8df-ccd7-4273-9030-347c16f7dfb6 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:04.587023 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fce8df-ccd7-4273-9030-347c16f7dfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:04.587300 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fce8df-ccd7-4273-9030-347c16f7dfb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:04.588025 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fce8df-ccd7-4273-9030-347c16f7dfb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:04.589705 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fce8df-ccd7-4273-9030-347c16f7dfb6 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:04.601250 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1086/2176] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:31:04 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:31:04.605320 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700516a3-5649-4f66-b56f-ee973b04eb6b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:04.615039 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700516a3-5649-4f66-b56f-ee973b04eb6b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:04.619704 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4605e-b49c-46df-96f9-279b51d7dc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:04.620420 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4605e-b49c-46df-96f9-279b51d7dc8b admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:04.620706 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4605e-b49c-46df-96f9-279b51d7dc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:04.621015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4605e-b49c-46df-96f9-279b51d7dc8b admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:04.621740 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4605e-b49c-46df-96f9-279b51d7dc8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:04.623857 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4605e-b49c-46df-96f9-279b51d7dc8b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:04.633694 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1091/2177] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:31:04 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:31:04.638443 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fce8df-ccd7-4273-9030-347c16f7dfb6 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:04.649032 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fce8df-ccd7-4273-9030-347c16f7dfb6 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:04.654097 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591df50d-8b0c-4852-affc-4d595a308549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:04.655115 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591df50d-8b0c-4852-affc-4d595a308549 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:04.655459 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591df50d-8b0c-4852-affc-4d595a308549 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:04.655798 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591df50d-8b0c-4852-affc-4d595a308549 admin admin] PATH_INFO: `/v3/projects/5fb22ef906594d469bdeacb4d190b0fd/users/180cd93bd92f4837b9daf25ca446d6b2/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:04.672338 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591df50d-8b0c-4852-affc-4d595a308549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb22ef906594d469bdeacb4d190b0fd, user_id=180cd93bd92f4837b9daf25ca446d6b2, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:04.675021 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591df50d-8b0c-4852-affc-4d595a308549 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:04.695289 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1087/2178] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:31:04 2021] PUT /identity/v3/projects/5fb22ef906594d469bdeacb4d190b0fd/users/180cd93bd92f4837b9daf25ca446d6b2/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:31:04.706224 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e36f63-5ce4-4fd7-9c47-64fc97922b81 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:04.706520 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e36f63-5ce4-4fd7-9c47-64fc97922b81 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:04.706804 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e36f63-5ce4-4fd7-9c47-64fc97922b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:04.745026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-58e36f63-5ce4-4fd7-9c47-64fc97922b81 None None] MFA Rules not processed for user `180cd93bd92f4837b9daf25ca446d6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:04.746521 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-58e36f63-5ce4-4fd7-9c47-64fc97922b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:04.848206 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1092/2179] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:04 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:31:04.852811 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591df50d-8b0c-4852-affc-4d595a308549 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:04.935490 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591df50d-8b0c-4852-affc-4d595a308549 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:04.942295 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63ecfd-3fc9-44b8-873a-d75b399b94eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:04.943244 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63ecfd-3fc9-44b8-873a-d75b399b94eb admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:04.943543 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63ecfd-3fc9-44b8-873a-d75b399b94eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:04.943807 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63ecfd-3fc9-44b8-873a-d75b399b94eb admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:04.944698 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63ecfd-3fc9-44b8-873a-d75b399b94eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:04.946916 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63ecfd-3fc9-44b8-873a-d75b399b94eb admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:04.981247 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1088/2180] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:31:04 2021] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:31:04.982471 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e36f63-5ce4-4fd7-9c47-64fc97922b81 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:04.999811 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e36f63-5ce4-4fd7-9c47-64fc97922b81 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:05.057780 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747ea2d-0c9a-4f9f-87df-f35ce49ea776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:05.058457 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747ea2d-0c9a-4f9f-87df-f35ce49ea776 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:05.058824 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747ea2d-0c9a-4f9f-87df-f35ce49ea776 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:05.059103 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747ea2d-0c9a-4f9f-87df-f35ce49ea776 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:05.060364 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747ea2d-0c9a-4f9f-87df-f35ce49ea776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:05.062329 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747ea2d-0c9a-4f9f-87df-f35ce49ea776 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:05.096550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1093/2181] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:31:04 2021] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:31:05.100540 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63ecfd-3fc9-44b8-873a-d75b399b94eb admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:05.112531 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63ecfd-3fc9-44b8-873a-d75b399b94eb admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:05.118457 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf3b16-e4b8-4aa4-a751-a0ce23e3c4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:05.119250 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf3b16-e4b8-4aa4-a751-a0ce23e3c4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:05.119598 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf3b16-e4b8-4aa4-a751-a0ce23e3c4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:05.119950 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf3b16-e4b8-4aa4-a751-a0ce23e3c4f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:05.121239 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf3b16-e4b8-4aa4-a751-a0ce23e3c4f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:05.122747 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf3b16-e4b8-4aa4-a751-a0ce23e3c4f6 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:05.133803 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1089/2182] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:31:05 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:31:05.139404 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747ea2d-0c9a-4f9f-87df-f35ce49ea776 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:05.155107 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747ea2d-0c9a-4f9f-87df-f35ce49ea776 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:05.165033 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d1af6-71c6-4af8-ad7d-356f128f12f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:05.166072 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d1af6-71c6-4af8-ad7d-356f128f12f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:05.166456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d1af6-71c6-4af8-ad7d-356f128f12f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:05.166807 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d1af6-71c6-4af8-ad7d-356f128f12f4 admin admin] PATH_INFO: `/v3/projects/04d145b25f134b96b2ff3b275ab84ee4/users/2a44855a05c140bf9214e4f085445270/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:05.183573 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d1af6-71c6-4af8-ad7d-356f128f12f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d145b25f134b96b2ff3b275ab84ee4, user_id=2a44855a05c140bf9214e4f085445270, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:05.186751 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d1af6-71c6-4af8-ad7d-356f128f12f4 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:05.234636 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1094/2183] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:31:05 2021] PUT /identity/v3/projects/04d145b25f134b96b2ff3b275ab84ee4/users/2a44855a05c140bf9214e4f085445270/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:31:05.242202 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf3b16-e4b8-4aa4-a751-a0ce23e3c4f6 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:05.260546 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf3b16-e4b8-4aa4-a751-a0ce23e3c4f6 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:05.363155 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788cc6c-ba3c-44af-b695-d53c55ad0ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:05.364904 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788cc6c-ba3c-44af-b695-d53c55ad0ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:05.365072 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788cc6c-ba3c-44af-b695-d53c55ad0ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:05.365317 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788cc6c-ba3c-44af-b695-d53c55ad0ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:05.366059 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788cc6c-ba3c-44af-b695-d53c55ad0ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:05.371274 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788cc6c-ba3c-44af-b695-d53c55ad0ed3 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:05.396276 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1090/2184] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:31:05 2021] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:31:05.397914 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d1af6-71c6-4af8-ad7d-356f128f12f4 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:05.410722 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d1af6-71c6-4af8-ad7d-356f128f12f4 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:05.418602 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8c574-de03-4e0a-950b-cd2f51e29098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:05.420139 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8c574-de03-4e0a-950b-cd2f51e29098 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:05.420456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8c574-de03-4e0a-950b-cd2f51e29098 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:05.420811 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8c574-de03-4e0a-950b-cd2f51e29098 admin admin] PATH_INFO: `/v3/projects/04d145b25f134b96b2ff3b275ab84ee4/users/2a44855a05c140bf9214e4f085445270/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:05.423873 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8c574-de03-4e0a-950b-cd2f51e29098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d145b25f134b96b2ff3b275ab84ee4, user_id=2a44855a05c140bf9214e4f085445270, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:05.426709 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8c574-de03-4e0a-950b-cd2f51e29098 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:05.437793 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1095/2185] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:31:05 2021] PUT /identity/v3/projects/04d145b25f134b96b2ff3b275ab84ee4/users/2a44855a05c140bf9214e4f085445270/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:31:05.450789 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c017d-2c71-4670-a781-2477bf69cafc None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:05.451038 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c017d-2c71-4670-a781-2477bf69cafc None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:05.451310 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c017d-2c71-4670-a781-2477bf69cafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:05.484495 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-830c017d-2c71-4670-a781-2477bf69cafc None None] MFA Rules not processed for user `2a44855a05c140bf9214e4f085445270`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:05.488928 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-830c017d-2c71-4670-a781-2477bf69cafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:05.556850 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1091/2186] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:05 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:31:05.567868 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8c574-de03-4e0a-950b-cd2f51e29098 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:05.571279 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-4fa8c574-de03-4e0a-950b-cd2f51e29098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:05.642474 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8c574-de03-4e0a-950b-cd2f51e29098 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:05.646075 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb49f3-9eb2-46b2-ba87-5f3a7db9727a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:05.646963 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb49f3-9eb2-46b2-ba87-5f3a7db9727a service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:05.647356 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb49f3-9eb2-46b2-ba87-5f3a7db9727a service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:05.647710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb49f3-9eb2-46b2-ba87-5f3a7db9727a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:05.716232 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb49f3-9eb2-46b2-ba87-5f3a7db9727a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:05.717566 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb49f3-9eb2-46b2-ba87-5f3a7db9727a service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:05.726612 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1096/2187] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:31:05 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:31:06.199353 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c017d-2c71-4670-a781-2477bf69cafc None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:06.202213 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-830c017d-2c71-4670-a781-2477bf69cafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:06.272197 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c017d-2c71-4670-a781-2477bf69cafc None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:06.277464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a5189-cd3e-4ee5-b5eb-b9ecd7e2ba32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:06.278442 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a5189-cd3e-4ee5-b5eb-b9ecd7e2ba32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:06.278648 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a5189-cd3e-4ee5-b5eb-b9ecd7e2ba32 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:06.278922 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a5189-cd3e-4ee5-b5eb-b9ecd7e2ba32 admin admin] PATH_INFO: `/v3/users/a5355ec2b90c49c9bd30ac0ac4da8f25` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:06.280147 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a5189-cd3e-4ee5-b5eb-b9ecd7e2ba32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5355ec2b90c49c9bd30ac0ac4da8f25)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:06.282350 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a5189-cd3e-4ee5-b5eb-b9ecd7e2ba32 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:06.329197 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a38a5189-cd3e-4ee5-b5eb-b9ecd7e2ba32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5355ec2b90c49c9bd30ac0ac4da8f25'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:06.343831 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a38a5189-cd3e-4ee5-b5eb-b9ecd7e2ba32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5355ec2b90c49c9bd30ac0ac4da8f25'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:06.344790 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a38a5189-cd3e-4ee5-b5eb-b9ecd7e2ba32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5355ec2b90c49c9bd30ac0ac4da8f25'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:06.353976 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a38a5189-cd3e-4ee5-b5eb-b9ecd7e2ba32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5355ec2b90c49c9bd30ac0ac4da8f25'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:06.355428 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb49f3-9eb2-46b2-ba87-5f3a7db9727a service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:06.357345 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-90bb49f3-9eb2-46b2-ba87-5f3a7db9727a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:06.362577 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a38a5189-cd3e-4ee5-b5eb-b9ecd7e2ba32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5355ec2b90c49c9bd30ac0ac4da8f25'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:06.369022 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1092/2188] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:31:06 2021] DELETE /identity/v3/users/a5355ec2b90c49c9bd30ac0ac4da8f25 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:31:06.373197 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb49f3-9eb2-46b2-ba87-5f3a7db9727a service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:06.373716 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f59f1-06b5-4cad-ae2c-ec551e1cf585 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:06.374002 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f59f1-06b5-4cad-ae2c-ec551e1cf585 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:06.374274 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f59f1-06b5-4cad-ae2c-ec551e1cf585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:06.390735 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-d48f59f1-06b5-4cad-ae2c-ec551e1cf585 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:06.391920 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d48f59f1-06b5-4cad-ae2c-ec551e1cf585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:06.427842 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8751c02-0bef-44b3-b60f-ecdef162113c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:06.428699 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8751c02-0bef-44b3-b60f-ecdef162113c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:06.429023 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8751c02-0bef-44b3-b60f-ecdef162113c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:06.429565 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8751c02-0bef-44b3-b60f-ecdef162113c admin admin] PATH_INFO: `/v3/users/b0b7aae305a145bb84b9e3624a41d7d4` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:06.430760 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8751c02-0bef-44b3-b60f-ecdef162113c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0b7aae305a145bb84b9e3624a41d7d4)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:06.432684 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8751c02-0bef-44b3-b60f-ecdef162113c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:06.449467 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1093/2189] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:31:06.459610 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f59f1-06b5-4cad-ae2c-ec551e1cf585 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:06.461041 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d48f59f1-06b5-4cad-ae2c-ec551e1cf585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:06.484427 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-b8751c02-0bef-44b3-b60f-ecdef162113c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0b7aae305a145bb84b9e3624a41d7d4'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:06.485197 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-b8751c02-0bef-44b3-b60f-ecdef162113c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0b7aae305a145bb84b9e3624a41d7d4'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:06.494743 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-b8751c02-0bef-44b3-b60f-ecdef162113c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0b7aae305a145bb84b9e3624a41d7d4'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:06.495450 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-b8751c02-0bef-44b3-b60f-ecdef162113c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0b7aae305a145bb84b9e3624a41d7d4'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:06.507759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-b8751c02-0bef-44b3-b60f-ecdef162113c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0b7aae305a145bb84b9e3624a41d7d4'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:06.520992 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1097/2190] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:31:06 2021] DELETE /identity/v3/users/b0b7aae305a145bb84b9e3624a41d7d4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:31:06.521359 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f59f1-06b5-4cad-ae2c-ec551e1cf585 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:06.576070 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e9129-0fdc-4fe2-9652-96329ed279d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:06.576748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e9129-0fdc-4fe2-9652-96329ed279d2 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:06.577055 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e9129-0fdc-4fe2-9652-96329ed279d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:06.577369 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e9129-0fdc-4fe2-9652-96329ed279d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:06.579512 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-3e6e9129-0fdc-4fe2-9652-96329ed279d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:06.644442 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e9129-0fdc-4fe2-9652-96329ed279d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:06.646020 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e9129-0fdc-4fe2-9652-96329ed279d2 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:06.661339 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1094/2191] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:31:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:31:06.713068 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8751c02-0bef-44b3-b60f-ecdef162113c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:06.714758 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b8751c02-0bef-44b3-b60f-ecdef162113c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:06.745269 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8751c02-0bef-44b3-b60f-ecdef162113c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:06.752403 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea60079-6ef3-410b-8444-0d97a15db519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:06.753503 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea60079-6ef3-410b-8444-0d97a15db519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:06.754046 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea60079-6ef3-410b-8444-0d97a15db519 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:06.754521 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea60079-6ef3-410b-8444-0d97a15db519 admin admin] PATH_INFO: `/v3/projects/4f739b6af4b5422783af4089b8c7b16f` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:06.756074 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea60079-6ef3-410b-8444-0d97a15db519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f739b6af4b5422783af4089b8c7b16f)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:06.759208 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea60079-6ef3-410b-8444-0d97a15db519 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:06.831706 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-7ea60079-6ef3-410b-8444-0d97a15db519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f739b6af4b5422783af4089b8c7b16f', 'request_id': 'req-7ea60079-6ef3-410b-8444-0d97a15db519'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:06.840415 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-7ea60079-6ef3-410b-8444-0d97a15db519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f739b6af4b5422783af4089b8c7b16f', 'request_id': 'req-7ea60079-6ef3-410b-8444-0d97a15db519'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:06.846401 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-7ea60079-6ef3-410b-8444-0d97a15db519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f739b6af4b5422783af4089b8c7b16f', 'request_id': 'req-7ea60079-6ef3-410b-8444-0d97a15db519'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:06.859231 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-7ea60079-6ef3-410b-8444-0d97a15db519 admin admin] The token cache is being invalidate because project 4f739b6af4b5422783af4089b8c7b16f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:31:06.859518 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-7ea60079-6ef3-410b-8444-0d97a15db519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:06.860345 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-7ea60079-6ef3-410b-8444-0d97a15db519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:06.861880 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1098/2192] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:31:06 2021] DELETE /identity/v3/projects/4f739b6af4b5422783af4089b8c7b16f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:31:06.867575 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10399766-1f65-4d29-a221-ad7f8bea3911 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:06.867980 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10399766-1f65-4d29-a221-ad7f8bea3911 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:06.868320 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10399766-1f65-4d29-a221-ad7f8bea3911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:06.887952 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-10399766-1f65-4d29-a221-ad7f8bea3911 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:06.889211 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-10399766-1f65-4d29-a221-ad7f8bea3911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:06.948572 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1095/2193] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:31:06.956700 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b6db3-c29a-435f-8d3a-7ab67edb64b2 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:06.957021 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b6db3-c29a-435f-8d3a-7ab67edb64b2 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:06.957298 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b6db3-c29a-435f-8d3a-7ab67edb64b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:06.976357 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-ae4b6db3-c29a-435f-8d3a-7ab67edb64b2 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:06.977669 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-ae4b6db3-c29a-435f-8d3a-7ab67edb64b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:06.987605 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1099/2194] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:31:06.991826 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10399766-1f65-4d29-a221-ad7f8bea3911 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:07.002692 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10399766-1f65-4d29-a221-ad7f8bea3911 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:07.008036 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe11e41-ce87-409e-86dd-81f192642a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:07.008977 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe11e41-ce87-409e-86dd-81f192642a3a admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:07.009352 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe11e41-ce87-409e-86dd-81f192642a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:07.009728 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe11e41-ce87-409e-86dd-81f192642a3a admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:07.010799 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe11e41-ce87-409e-86dd-81f192642a3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:31:07.011167 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe11e41-ce87-409e-86dd-81f192642a3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:07.013436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe11e41-ce87-409e-86dd-81f192642a3a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:07.018608 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b6db3-c29a-435f-8d3a-7ab67edb64b2 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:07.020078 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-ae4b6db3-c29a-435f-8d3a-7ab67edb64b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:07.031348 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1096/2195] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:31:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:31:07.032307 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe11e41-ce87-409e-86dd-81f192642a3a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:07.044084 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe11e41-ce87-409e-86dd-81f192642a3a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:07.044183 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b6db3-c29a-435f-8d3a-7ab67edb64b2 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:07.049415 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287869c-528a-434e-b2a6-31bb5c169fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:07.049878 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c944bf-ec5a-4bd2-a607-9c044d86424b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:07.050274 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287869c-528a-434e-b2a6-31bb5c169fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:07.050524 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c944bf-ec5a-4bd2-a607-9c044d86424b admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:07.050623 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287869c-528a-434e-b2a6-31bb5c169fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:07.050795 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c944bf-ec5a-4bd2-a607-9c044d86424b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:07.050941 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287869c-528a-434e-b2a6-31bb5c169fe6 admin admin] PATH_INFO: `/v3/projects/d5308afc1e144b2a9dd26db415c68891` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:07.051065 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c944bf-ec5a-4bd2-a607-9c044d86424b admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:07.051750 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c944bf-ec5a-4bd2-a607-9c044d86424b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:07.052134 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287869c-528a-434e-b2a6-31bb5c169fe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5308afc1e144b2a9dd26db415c68891)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:07.053905 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c944bf-ec5a-4bd2-a607-9c044d86424b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:07.054105 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287869c-528a-434e-b2a6-31bb5c169fe6 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:07.086614 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1097/2196] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:31:07 2021] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:31:07.091133 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c944bf-ec5a-4bd2-a607-9c044d86424b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:07.106656 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c287869c-528a-434e-b2a6-31bb5c169fe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5308afc1e144b2a9dd26db415c68891', 'request_id': 'req-c287869c-528a-434e-b2a6-31bb5c169fe6'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:07.114533 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c287869c-528a-434e-b2a6-31bb5c169fe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5308afc1e144b2a9dd26db415c68891', 'request_id': 'req-c287869c-528a-434e-b2a6-31bb5c169fe6'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:07.120273 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c287869c-528a-434e-b2a6-31bb5c169fe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5308afc1e144b2a9dd26db415c68891', 'request_id': 'req-c287869c-528a-434e-b2a6-31bb5c169fe6'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:07.132520 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c287869c-528a-434e-b2a6-31bb5c169fe6 admin admin] The token cache is being invalidate because project d5308afc1e144b2a9dd26db415c68891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:31:07.132714 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c287869c-528a-434e-b2a6-31bb5c169fe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:07.133618 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c287869c-528a-434e-b2a6-31bb5c169fe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:07.134974 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1100/2197] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:31:07 2021] DELETE /identity/v3/projects/d5308afc1e144b2a9dd26db415c68891 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:31:07.141602 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfec480-e2a1-40d3-a853-682bde2a7774 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:07.141886 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfec480-e2a1-40d3-a853-682bde2a7774 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:07.142207 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfec480-e2a1-40d3-a853-682bde2a7774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:07.156160 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c944bf-ec5a-4bd2-a607-9c044d86424b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:07.160843 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-7cfec480-e2a1-40d3-a853-682bde2a7774 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:07.162101 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7cfec480-e2a1-40d3-a853-682bde2a7774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:07.226891 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c76d7-700e-4a7e-8631-8ad6dc62482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:07.227771 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c76d7-700e-4a7e-8631-8ad6dc62482f admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:07.228056 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c76d7-700e-4a7e-8631-8ad6dc62482f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:07.228349 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c76d7-700e-4a7e-8631-8ad6dc62482f admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:07.229149 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c76d7-700e-4a7e-8631-8ad6dc62482f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:07.231651 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c76d7-700e-4a7e-8631-8ad6dc62482f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:07.237876 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1101/2198] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:31:07.239788 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5b7a1-091f-4458-a522-5f3fa124bc8e None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:07.240084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5b7a1-091f-4458-a522-5f3fa124bc8e None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:07.240362 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5b7a1-091f-4458-a522-5f3fa124bc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:07.260736 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1098/2199] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:31:07 2021] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:31:07.265730 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c76d7-700e-4a7e-8631-8ad6dc62482f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:07.269129 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-0f0c76d7-700e-4a7e-8631-8ad6dc62482f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:07.270084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-a7e5b7a1-091f-4458-a522-5f3fa124bc8e None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:07.271378 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a7e5b7a1-091f-4458-a522-5f3fa124bc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:07.281549 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c76d7-700e-4a7e-8631-8ad6dc62482f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:07.286929 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff645e1-bb7f-4467-a24a-91c5c12d6323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:07.287767 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff645e1-bb7f-4467-a24a-91c5c12d6323 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:07.288119 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff645e1-bb7f-4467-a24a-91c5c12d6323 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:07.288807 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff645e1-bb7f-4467-a24a-91c5c12d6323 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:07.288960 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1102/2200] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:31:07.289340 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff645e1-bb7f-4467-a24a-91c5c12d6323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:07.291008 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff645e1-bb7f-4467-a24a-91c5c12d6323 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:07.292967 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5b7a1-091f-4458-a522-5f3fa124bc8e None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:07.311620 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5b7a1-091f-4458-a522-5f3fa124bc8e None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:07.311762 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1099/2201] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:31:07 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:31:07.311762 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff645e1-bb7f-4467-a24a-91c5c12d6323 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:07.316578 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3218333-86d8-462b-a899-673302c7cb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:07.317518 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3218333-86d8-462b-a899-673302c7cb88 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:07.317977 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3218333-86d8-462b-a899-673302c7cb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:07.318436 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3218333-86d8-462b-a899-673302c7cb88 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:07.318635 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff645e1-bb7f-4467-a24a-91c5c12d6323 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:07.319512 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3218333-86d8-462b-a899-673302c7cb88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:31:07.319938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3218333-86d8-462b-a899-673302c7cb88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:07.321818 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3218333-86d8-462b-a899-673302c7cb88 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:07.323930 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd879f2f-a6bc-48b4-a9b0-b2b352dd6ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:07.324907 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd879f2f-a6bc-48b4-a9b0-b2b352dd6ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:07.325782 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd879f2f-a6bc-48b4-a9b0-b2b352dd6ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:07.326069 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd879f2f-a6bc-48b4-a9b0-b2b352dd6ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:07.326814 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd879f2f-a6bc-48b4-a9b0-b2b352dd6ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:07.328406 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd879f2f-a6bc-48b4-a9b0-b2b352dd6ff3 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:07.340923 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1103/2202] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:31:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:31:07.341086 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1100/2203] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:31:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:31:07.341167 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3218333-86d8-462b-a899-673302c7cb88 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:07.344073 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd879f2f-a6bc-48b4-a9b0-b2b352dd6ff3 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:07.352340 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3218333-86d8-462b-a899-673302c7cb88 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:07.354764 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd879f2f-a6bc-48b4-a9b0-b2b352dd6ff3 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:07.357869 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed5c65-3f80-4337-ab7b-8d4ad417af4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:07.359197 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed5c65-3f80-4337-ab7b-8d4ad417af4c admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:07.359483 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed5c65-3f80-4337-ab7b-8d4ad417af4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:07.359760 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed5c65-3f80-4337-ab7b-8d4ad417af4c admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:07.360209 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675e890-519d-44cc-9191-8a7bb893b23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:07.360600 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed5c65-3f80-4337-ab7b-8d4ad417af4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:07.361228 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675e890-519d-44cc-9191-8a7bb893b23c admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:07.361570 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675e890-519d-44cc-9191-8a7bb893b23c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:07.361904 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675e890-519d-44cc-9191-8a7bb893b23c admin admin] PATH_INFO: `/v3/projects/adaac922bb1d4dac87ae1a96045dcce2/users/6d88e560bc7f48019d584bd7c88d73ab/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:07.363047 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed5c65-3f80-4337-ab7b-8d4ad417af4c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:07.381974 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675e890-519d-44cc-9191-8a7bb893b23c admin admin] RBAC: Authorizing `identity:create_grant(project_id=adaac922bb1d4dac87ae1a96045dcce2, user_id=6d88e560bc7f48019d584bd7c88d73ab, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:07.385312 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675e890-519d-44cc-9191-8a7bb893b23c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:07.393679 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1104/2204] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:31:07 2021] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:31:07.397863 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed5c65-3f80-4337-ab7b-8d4ad417af4c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:07.399432 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1101/2205] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:31:07 2021] PUT /identity/v3/projects/adaac922bb1d4dac87ae1a96045dcce2/users/6d88e560bc7f48019d584bd7c88d73ab/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:31:07.404656 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910399f-c969-46ed-adb3-b9a9fc20a6a9 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:07.405207 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910399f-c969-46ed-adb3-b9a9fc20a6a9 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:07.405634 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910399f-c969-46ed-adb3-b9a9fc20a6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:07.424243 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-0910399f-c969-46ed-adb3-b9a9fc20a6a9 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:07.425891 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-0910399f-c969-46ed-adb3-b9a9fc20a6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:07.484698 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed5c65-3f80-4337-ab7b-8d4ad417af4c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:07.514353 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1102/2206] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:31:07.525720 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910399f-c969-46ed-adb3-b9a9fc20a6a9 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:07.527719 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-0910399f-c969-46ed-adb3-b9a9fc20a6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:07.584311 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050b445-cebe-4a16-b6fe-7934f0a06a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:07.585390 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050b445-cebe-4a16-b6fe-7934f0a06a15 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:07.598381 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050b445-cebe-4a16-b6fe-7934f0a06a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:07.598381 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050b445-cebe-4a16-b6fe-7934f0a06a15 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:07.598381 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050b445-cebe-4a16-b6fe-7934f0a06a15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:07.601894 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050b445-cebe-4a16-b6fe-7934f0a06a15 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:07.609318 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910399f-c969-46ed-adb3-b9a9fc20a6a9 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:07.628996 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b3b46-2b21-4cd4-a207-7433ef46bc6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:07.629688 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b3b46-2b21-4cd4-a207-7433ef46bc6d service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:07.629965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b3b46-2b21-4cd4-a207-7433ef46bc6d service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:07.630338 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b3b46-2b21-4cd4-a207-7433ef46bc6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:07.631682 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1105/2207] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:31:07 2021] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:31:07.638407 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050b445-cebe-4a16-b6fe-7934f0a06a15 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:07.650770 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b3b46-2b21-4cd4-a207-7433ef46bc6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:07.652482 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b3b46-2b21-4cd4-a207-7433ef46bc6d service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:07.660928 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050b445-cebe-4a16-b6fe-7934f0a06a15 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:07.663469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1103/2208] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:31:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:31:07.666685 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff05397-e340-44d6-93f3-9efe0979b31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:07.667531 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff05397-e340-44d6-93f3-9efe0979b31c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:07.667959 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff05397-e340-44d6-93f3-9efe0979b31c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:07.668571 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff05397-e340-44d6-93f3-9efe0979b31c admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:07.669658 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff05397-e340-44d6-93f3-9efe0979b31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:07.672912 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff05397-e340-44d6-93f3-9efe0979b31c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:07.688285 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1106/2209] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:31:07 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:31:07.692979 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b3b46-2b21-4cd4-a207-7433ef46bc6d service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:07.706126 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b3b46-2b21-4cd4-a207-7433ef46bc6d service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:07.710985 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547f823-9c22-4400-8d02-6967c2bdf6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:07.711666 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547f823-9c22-4400-8d02-6967c2bdf6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:07.712052 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547f823-9c22-4400-8d02-6967c2bdf6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:07.712338 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547f823-9c22-4400-8d02-6967c2bdf6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:07.713151 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547f823-9c22-4400-8d02-6967c2bdf6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:07.714923 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547f823-9c22-4400-8d02-6967c2bdf6b5 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:07.725929 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1104/2210] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:31:07 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:31:07.730251 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff05397-e340-44d6-93f3-9efe0979b31c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:07.740140 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff05397-e340-44d6-93f3-9efe0979b31c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:07.745219 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f4604-8543-49d5-a254-f49830e3eb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:07.746306 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f4604-8543-49d5-a254-f49830e3eb37 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:07.747263 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f4604-8543-49d5-a254-f49830e3eb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:07.747553 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f4604-8543-49d5-a254-f49830e3eb37 admin admin] PATH_INFO: `/v3/projects/f0a738746edc4065abdd9bf0edc267bc/users/b07a465abaed478ba3ec62e2e26d4431/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:07.765969 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f4604-8543-49d5-a254-f49830e3eb37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a738746edc4065abdd9bf0edc267bc, user_id=b07a465abaed478ba3ec62e2e26d4431, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:07.768741 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f4604-8543-49d5-a254-f49830e3eb37 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:07.794255 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1107/2211] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:31:07 2021] PUT /identity/v3/projects/f0a738746edc4065abdd9bf0edc267bc/users/b07a465abaed478ba3ec62e2e26d4431/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:31:07.797436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb4b6c-cf8d-474d-a16d-dd060bc64971 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:07.797727 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb4b6c-cf8d-474d-a16d-dd060bc64971 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:07.798007 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb4b6c-cf8d-474d-a16d-dd060bc64971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:07.828817 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-c7fb4b6c-cf8d-474d-a16d-dd060bc64971 None None] MFA Rules not processed for user `b07a465abaed478ba3ec62e2e26d4431`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:07.830192 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-c7fb4b6c-cf8d-474d-a16d-dd060bc64971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:07.901772 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1105/2212] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:07 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:31:07.903114 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f4604-8543-49d5-a254-f49830e3eb37 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:07.964488 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f4604-8543-49d5-a254-f49830e3eb37 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:07.969288 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5091d0d-0ed2-44e7-85d0-1690af9afb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:07.970053 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5091d0d-0ed2-44e7-85d0-1690af9afb4c admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:07.970220 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5091d0d-0ed2-44e7-85d0-1690af9afb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:07.970491 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5091d0d-0ed2-44e7-85d0-1690af9afb4c admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:07.971167 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5091d0d-0ed2-44e7-85d0-1690af9afb4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:07.973456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5091d0d-0ed2-44e7-85d0-1690af9afb4c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:08.001198 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1108/2213] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:31:07 2021] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:31:08.005335 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb4b6c-cf8d-474d-a16d-dd060bc64971 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:08.018051 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb4b6c-cf8d-474d-a16d-dd060bc64971 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:08.088038 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73c655-ae99-4074-ae8f-b69e49426974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:08.088038 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73c655-ae99-4074-ae8f-b69e49426974 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:08.088038 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73c655-ae99-4074-ae8f-b69e49426974 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:08.088038 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73c655-ae99-4074-ae8f-b69e49426974 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:08.088912 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73c655-ae99-4074-ae8f-b69e49426974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:08.090942 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73c655-ae99-4074-ae8f-b69e49426974 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:08.113676 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1106/2214] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:31:08 2021] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:31:08.117877 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5091d0d-0ed2-44e7-85d0-1690af9afb4c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:08.128467 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5091d0d-0ed2-44e7-85d0-1690af9afb4c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:08.133081 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90119fe2-13fc-4f60-b4fe-a492a4e0334b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:08.133738 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90119fe2-13fc-4f60-b4fe-a492a4e0334b admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:08.134084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90119fe2-13fc-4f60-b4fe-a492a4e0334b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:08.134356 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90119fe2-13fc-4f60-b4fe-a492a4e0334b admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:08.135082 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90119fe2-13fc-4f60-b4fe-a492a4e0334b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:08.136645 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90119fe2-13fc-4f60-b4fe-a492a4e0334b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:08.147642 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1109/2215] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:31:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:31:08.152524 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73c655-ae99-4074-ae8f-b69e49426974 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:08.162193 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73c655-ae99-4074-ae8f-b69e49426974 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:08.167429 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc61270-a681-4343-8dd2-20340ac17def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:08.168110 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc61270-a681-4343-8dd2-20340ac17def admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:08.168377 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc61270-a681-4343-8dd2-20340ac17def admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:08.169196 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc61270-a681-4343-8dd2-20340ac17def admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:08.169936 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc61270-a681-4343-8dd2-20340ac17def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:08.172135 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc61270-a681-4343-8dd2-20340ac17def admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:08.182040 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1107/2216] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:31:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:31:08.187809 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90119fe2-13fc-4f60-b4fe-a492a4e0334b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:08.199517 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90119fe2-13fc-4f60-b4fe-a492a4e0334b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:08.204779 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791b7f4-b612-4b8b-b497-15d99c6c1506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:08.205901 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791b7f4-b612-4b8b-b497-15d99c6c1506 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:08.206199 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791b7f4-b612-4b8b-b497-15d99c6c1506 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:08.206459 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791b7f4-b612-4b8b-b497-15d99c6c1506 admin admin] PATH_INFO: `/v3/projects/9054d0c565744146b0d0ea8ac77d6956/users/9375b1972c6d44e9973db1b12b772fe7/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:08.224432 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791b7f4-b612-4b8b-b497-15d99c6c1506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9054d0c565744146b0d0ea8ac77d6956, user_id=9375b1972c6d44e9973db1b12b772fe7, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:08.227089 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791b7f4-b612-4b8b-b497-15d99c6c1506 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:08.240861 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1110/2217] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:31:08 2021] PUT /identity/v3/projects/9054d0c565744146b0d0ea8ac77d6956/users/9375b1972c6d44e9973db1b12b772fe7/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:31:08.251207 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d0cea-f9b5-4f50-a5fd-2959145e1f1d None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:08.251728 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d0cea-f9b5-4f50-a5fd-2959145e1f1d None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:08.251820 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d0cea-f9b5-4f50-a5fd-2959145e1f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:08.279728 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-de3d0cea-f9b5-4f50-a5fd-2959145e1f1d None None] MFA Rules not processed for user `9375b1972c6d44e9973db1b12b772fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:08.281058 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-de3d0cea-f9b5-4f50-a5fd-2959145e1f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:08.357739 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1108/2218] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:08 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:31:08.362523 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791b7f4-b612-4b8b-b497-15d99c6c1506 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:08.430520 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c169be-489f-4aba-82af-cba54a0040df None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:08.430719 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c169be-489f-4aba-82af-cba54a0040df None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:08.430974 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c169be-489f-4aba-82af-cba54a0040df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:08.463679 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-61c169be-489f-4aba-82af-cba54a0040df None None] MFA Rules not processed for user `6d88e560bc7f48019d584bd7c88d73ab`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:08.465057 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-61c169be-489f-4aba-82af-cba54a0040df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:08.471425 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791b7f4-b612-4b8b-b497-15d99c6c1506 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:08.482096 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67599c-072a-4c26-a942-66c81c15d1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:08.483117 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67599c-072a-4c26-a942-66c81c15d1e7 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:08.483626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67599c-072a-4c26-a942-66c81c15d1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:08.484113 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67599c-072a-4c26-a942-66c81c15d1e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:08.485359 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67599c-072a-4c26-a942-66c81c15d1e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:08.488422 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67599c-072a-4c26-a942-66c81c15d1e7 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:08.519980 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1111/2219] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:31:08 2021] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:31:08.526011 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67599c-072a-4c26-a942-66c81c15d1e7 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:08.553893 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1109/2220] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:08 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:31:08.565416 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4714e-7b06-46f0-83d2-62b4153993db None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:08.565855 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4714e-7b06-46f0-83d2-62b4153993db None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:08.566137 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4714e-7b06-46f0-83d2-62b4153993db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:08.584596 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-32a4714e-7b06-46f0-83d2-62b4153993db None None] MFA Rules not processed for user `6d88e560bc7f48019d584bd7c88d73ab`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:08.585947 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-32a4714e-7b06-46f0-83d2-62b4153993db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:08.592054 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67599c-072a-4c26-a942-66c81c15d1e7 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:08.597182 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b4aec-9fb0-4c4e-8301-e83e891abae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:08.597960 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b4aec-9fb0-4c4e-8301-e83e891abae5 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:08.598306 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b4aec-9fb0-4c4e-8301-e83e891abae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:08.598656 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b4aec-9fb0-4c4e-8301-e83e891abae5 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:08.599570 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b4aec-9fb0-4c4e-8301-e83e891abae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:08.601590 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b4aec-9fb0-4c4e-8301-e83e891abae5 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:08.622854 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1112/2221] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:31:08 2021] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:31:08.626797 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b4aec-9fb0-4c4e-8301-e83e891abae5 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:08.636403 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b4aec-9fb0-4c4e-8301-e83e891abae5 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:08.641973 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8282824-869c-41ea-8f84-06376be3ab8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:08.642717 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8282824-869c-41ea-8f84-06376be3ab8e admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:08.643003 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8282824-869c-41ea-8f84-06376be3ab8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:08.643281 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8282824-869c-41ea-8f84-06376be3ab8e admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:08.644008 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8282824-869c-41ea-8f84-06376be3ab8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:08.645692 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8282824-869c-41ea-8f84-06376be3ab8e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:08.652223 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1110/2222] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:08 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:31:08.655638 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1113/2223] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:31:08 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:31:08.659795 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4714e-7b06-46f0-83d2-62b4153993db None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:08.664060 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8282824-869c-41ea-8f84-06376be3ab8e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:08.665795 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-f8282824-869c-41ea-8f84-06376be3ab8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:08.671814 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4714e-7b06-46f0-83d2-62b4153993db None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:08.678025 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6ff00-cd8c-4ff3-a9be-9375bdbc51cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:08.678987 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6ff00-cd8c-4ff3-a9be-9375bdbc51cb admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:08.679362 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6ff00-cd8c-4ff3-a9be-9375bdbc51cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:08.679702 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6ff00-cd8c-4ff3-a9be-9375bdbc51cb admin admin] PATH_INFO: `/v3/projects/5ddf465e01d649ffb5ef5d67a6b77515/users/a8fe21b8ee4a4d52aba83a26fe17644a/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:08.702041 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6ff00-cd8c-4ff3-a9be-9375bdbc51cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ddf465e01d649ffb5ef5d67a6b77515, user_id=a8fe21b8ee4a4d52aba83a26fe17644a, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:08.705391 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6ff00-cd8c-4ff3-a9be-9375bdbc51cb admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:08.727963 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1111/2224] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:31:08 2021] PUT /identity/v3/projects/5ddf465e01d649ffb5ef5d67a6b77515/users/a8fe21b8ee4a4d52aba83a26fe17644a/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:31:08.736945 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6ff00-cd8c-4ff3-a9be-9375bdbc51cb admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:08.786219 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8282824-869c-41ea-8f84-06376be3ab8e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:08.813965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6ff00-cd8c-4ff3-a9be-9375bdbc51cb admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:08.820236 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f8ba0-6dbc-4e15-860d-f83edb776ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:08.821021 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f8ba0-6dbc-4e15-860d-f83edb776ebf admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:08.821622 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f8ba0-6dbc-4e15-860d-f83edb776ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:08.821933 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f8ba0-6dbc-4e15-860d-f83edb776ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:08.822775 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f8ba0-6dbc-4e15-860d-f83edb776ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:08.824497 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f8ba0-6dbc-4e15-860d-f83edb776ebf admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:08.836562 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1112/2225] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:31:08 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:31:08.841124 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f8ba0-6dbc-4e15-860d-f83edb776ebf admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:08.855679 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f8ba0-6dbc-4e15-860d-f83edb776ebf admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:08.862731 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d6805-5dbd-4875-897b-e08216a66b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:08.863798 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d6805-5dbd-4875-897b-e08216a66b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:08.864322 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d6805-5dbd-4875-897b-e08216a66b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:08.864775 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d6805-5dbd-4875-897b-e08216a66b90 admin admin] PATH_INFO: `/v3/projects/5ddf465e01d649ffb5ef5d67a6b77515/users/a8fe21b8ee4a4d52aba83a26fe17644a/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:08.866860 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d6805-5dbd-4875-897b-e08216a66b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ddf465e01d649ffb5ef5d67a6b77515, user_id=a8fe21b8ee4a4d52aba83a26fe17644a, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:08.870140 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d6805-5dbd-4875-897b-e08216a66b90 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:08.876926 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004645e2-14e2-497a-9083-548281378316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:08.877316 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004645e2-14e2-497a-9083-548281378316 service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:08.877600 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004645e2-14e2-497a-9083-548281378316 service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:08.877874 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004645e2-14e2-497a-9083-548281378316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:08.896244 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1113/2226] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:31:08 2021] PUT /identity/v3/projects/5ddf465e01d649ffb5ef5d67a6b77515/users/a8fe21b8ee4a4d52aba83a26fe17644a/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:31:08.908317 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2a43a-9440-4e57-9954-e712c8d81c57 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:08.908601 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2a43a-9440-4e57-9954-e712c8d81c57 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:08.908897 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2a43a-9440-4e57-9954-e712c8d81c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:08.945812 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-57a2a43a-9440-4e57-9954-e712c8d81c57 None None] MFA Rules not processed for user `a8fe21b8ee4a4d52aba83a26fe17644a`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:08.946993 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-57a2a43a-9440-4e57-9954-e712c8d81c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:08.947234 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004645e2-14e2-497a-9083-548281378316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:08.949068 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004645e2-14e2-497a-9083-548281378316 service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:08.959131 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1114/2227] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:31:08 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:31:09.022113 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1114/2228] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:08 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:31:09.032388 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004645e2-14e2-497a-9083-548281378316 service nova] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:09.034212 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-004645e2-14e2-497a-9083-548281378316 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:09.109795 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004645e2-14e2-497a-9083-548281378316 service nova] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:09.162265 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcee216-480f-4a73-8160-04122d8d3789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:09.162908 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcee216-480f-4a73-8160-04122d8d3789 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:09.163288 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcee216-480f-4a73-8160-04122d8d3789 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:09.163564 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcee216-480f-4a73-8160-04122d8d3789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:09.219947 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcee216-480f-4a73-8160-04122d8d3789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:09.221395 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcee216-480f-4a73-8160-04122d8d3789 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:09.230664 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1115/2229] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:31:09 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:31:10.213006 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2a43a-9440-4e57-9954-e712c8d81c57 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:10.223169 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2a43a-9440-4e57-9954-e712c8d81c57 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:10.226957 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1192c-de24-4cb1-8607-f38040fac02a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:10.227671 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1192c-de24-4cb1-8607-f38040fac02a service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:10.228024 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1192c-de24-4cb1-8607-f38040fac02a service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:10.228365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1192c-de24-4cb1-8607-f38040fac02a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:10.230266 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-91f1192c-de24-4cb1-8607-f38040fac02a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:10.292948 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1192c-de24-4cb1-8607-f38040fac02a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:10.294904 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1192c-de24-4cb1-8607-f38040fac02a service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:10.304512 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1115/2230] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:31:10 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:31:10.733595 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcee216-480f-4a73-8160-04122d8d3789 service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:10.735062 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-2bcee216-480f-4a73-8160-04122d8d3789 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:10.745615 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcee216-480f-4a73-8160-04122d8d3789 service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:10.749812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6953f-ee95-40ce-8769-975636bf37fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:10.750451 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6953f-ee95-40ce-8769-975636bf37fc service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:10.750731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6953f-ee95-40ce-8769-975636bf37fc service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:10.751024 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6953f-ee95-40ce-8769-975636bf37fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:10.804979 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6953f-ee95-40ce-8769-975636bf37fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:10.806400 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6953f-ee95-40ce-8769-975636bf37fc service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:10.815748 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1116/2231] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:31:10 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:31:11.336538 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1192c-de24-4cb1-8607-f38040fac02a service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:11.345133 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1192c-de24-4cb1-8607-f38040fac02a service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:11.348801 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82385ee-47cf-42d8-8cf2-d187d8be27c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:11.349475 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82385ee-47cf-42d8-8cf2-d187d8be27c8 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:11.349757 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82385ee-47cf-42d8-8cf2-d187d8be27c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:11.350036 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82385ee-47cf-42d8-8cf2-d187d8be27c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:11.359644 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82385ee-47cf-42d8-8cf2-d187d8be27c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:11.361093 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82385ee-47cf-42d8-8cf2-d187d8be27c8 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:11.370315 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1116/2232] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:31:11 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:31:15.158363 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6953f-ee95-40ce-8769-975636bf37fc service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:15.159773 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-36a6953f-ee95-40ce-8769-975636bf37fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:15.219994 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82385ee-47cf-42d8-8cf2-d187d8be27c8 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:15.248478 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6953f-ee95-40ce-8769-975636bf37fc service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:15.253017 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dd8e7-90a5-4507-986b-9160fac5f702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:15.253881 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dd8e7-90a5-4507-986b-9160fac5f702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:15.254159 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dd8e7-90a5-4507-986b-9160fac5f702 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:15.254430 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dd8e7-90a5-4507-986b-9160fac5f702 admin admin] PATH_INFO: `/v3/users/180cd93bd92f4837b9daf25ca446d6b2` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:15.255596 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dd8e7-90a5-4507-986b-9160fac5f702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=180cd93bd92f4837b9daf25ca446d6b2)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:15.257533 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dd8e7-90a5-4507-986b-9160fac5f702 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:15.287828 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82385ee-47cf-42d8-8cf2-d187d8be27c8 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:15.292731 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea8800-5173-4673-ae42-09dbbec05d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:15.294249 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea8800-5173-4673-ae42-09dbbec05d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:15.294554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea8800-5173-4673-ae42-09dbbec05d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:15.294822 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea8800-5173-4673-ae42-09dbbec05d28 admin admin] PATH_INFO: `/v3/users/b07a465abaed478ba3ec62e2e26d4431` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:15.296015 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea8800-5173-4673-ae42-09dbbec05d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b07a465abaed478ba3ec62e2e26d4431)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:15.298134 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea8800-5173-4673-ae42-09dbbec05d28 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:15.303982 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a51dd8e7-90a5-4507-986b-9160fac5f702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '180cd93bd92f4837b9daf25ca446d6b2'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:15.304630 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a51dd8e7-90a5-4507-986b-9160fac5f702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '180cd93bd92f4837b9daf25ca446d6b2'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:15.312164 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a51dd8e7-90a5-4507-986b-9160fac5f702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '180cd93bd92f4837b9daf25ca446d6b2'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:15.312781 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a51dd8e7-90a5-4507-986b-9160fac5f702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '180cd93bd92f4837b9daf25ca446d6b2'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:15.324797 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a51dd8e7-90a5-4507-986b-9160fac5f702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '180cd93bd92f4837b9daf25ca446d6b2'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:15.336619 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1117/2233] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:31:15 2021] DELETE /identity/v3/users/180cd93bd92f4837b9daf25ca446d6b2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:31:15.341662 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430fce2-9772-4076-98bd-65db45d7736a None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:15.342015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430fce2-9772-4076-98bd-65db45d7736a None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:15.342356 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430fce2-9772-4076-98bd-65db45d7736a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:15.346502 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-79ea8800-5173-4673-ae42-09dbbec05d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b07a465abaed478ba3ec62e2e26d4431'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:15.358397 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-79ea8800-5173-4673-ae42-09dbbec05d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b07a465abaed478ba3ec62e2e26d4431'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:15.359060 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-79ea8800-5173-4673-ae42-09dbbec05d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b07a465abaed478ba3ec62e2e26d4431'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:15.359719 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-d430fce2-9772-4076-98bd-65db45d7736a None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:15.360922 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-d430fce2-9772-4076-98bd-65db45d7736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:15.367507 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-79ea8800-5173-4673-ae42-09dbbec05d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b07a465abaed478ba3ec62e2e26d4431'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:15.378163 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-79ea8800-5173-4673-ae42-09dbbec05d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b07a465abaed478ba3ec62e2e26d4431'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:15.385779 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1117/2234] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:31:15 2021] DELETE /identity/v3/users/b07a465abaed478ba3ec62e2e26d4431 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:31:15.390075 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b0003-187a-478d-8933-c5fd38e82081 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:15.390378 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b0003-187a-478d-8933-c5fd38e82081 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:15.390634 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b0003-187a-478d-8933-c5fd38e82081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:15.408174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-5f2b0003-187a-478d-8933-c5fd38e82081 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:15.409804 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-5f2b0003-187a-478d-8933-c5fd38e82081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:15.423897 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1118/2235] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:31:15.435279 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430fce2-9772-4076-98bd-65db45d7736a None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:15.438591 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-d430fce2-9772-4076-98bd-65db45d7736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:15.483599 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1118/2236] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:31:15.491812 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b0003-187a-478d-8933-c5fd38e82081 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:15.494203 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-5f2b0003-187a-478d-8933-c5fd38e82081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:15.496790 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430fce2-9772-4076-98bd-65db45d7736a None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:15.549270 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f9958-d50f-4d76-a0ee-8b7cee6b2eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:15.550239 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f9958-d50f-4d76-a0ee-8b7cee6b2eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:15.550239 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f9958-d50f-4d76-a0ee-8b7cee6b2eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:15.550585 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f9958-d50f-4d76-a0ee-8b7cee6b2eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:15.556162 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b0003-187a-478d-8933-c5fd38e82081 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:15.560492 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bbe2e-11bd-4ef0-8763-bfc5330c1d9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:15.561006 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f9958-d50f-4d76-a0ee-8b7cee6b2eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:15.561195 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bbe2e-11bd-4ef0-8763-bfc5330c1d9a service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:15.561439 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bbe2e-11bd-4ef0-8763-bfc5330c1d9a service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:15.561742 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bbe2e-11bd-4ef0-8763-bfc5330c1d9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:15.562450 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f9958-d50f-4d76-a0ee-8b7cee6b2eb1 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:15.571010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bbe2e-11bd-4ef0-8763-bfc5330c1d9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:15.572436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bbe2e-11bd-4ef0-8763-bfc5330c1d9a service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:15.575610 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1119/2237] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:31:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:31:15.582152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1119/2238] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:31:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:31:15.865709 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f9958-d50f-4d76-a0ee-8b7cee6b2eb1 service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:15.867309 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-df1f9958-d50f-4d76-a0ee-8b7cee6b2eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:15.884195 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f9958-d50f-4d76-a0ee-8b7cee6b2eb1 service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:15.892569 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64648e-32d4-4340-b64d-e54c8ae137e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:15.893555 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64648e-32d4-4340-b64d-e54c8ae137e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:15.893911 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64648e-32d4-4340-b64d-e54c8ae137e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:15.894186 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64648e-32d4-4340-b64d-e54c8ae137e1 admin admin] PATH_INFO: `/v3/projects/5fb22ef906594d469bdeacb4d190b0fd` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:15.895427 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64648e-32d4-4340-b64d-e54c8ae137e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fb22ef906594d469bdeacb4d190b0fd)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:15.897364 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64648e-32d4-4340-b64d-e54c8ae137e1 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:15.949305 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-4a64648e-32d4-4340-b64d-e54c8ae137e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fb22ef906594d469bdeacb4d190b0fd', 'request_id': 'req-4a64648e-32d4-4340-b64d-e54c8ae137e1'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:15.958584 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-4a64648e-32d4-4340-b64d-e54c8ae137e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fb22ef906594d469bdeacb4d190b0fd', 'request_id': 'req-4a64648e-32d4-4340-b64d-e54c8ae137e1'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:15.964411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-4a64648e-32d4-4340-b64d-e54c8ae137e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fb22ef906594d469bdeacb4d190b0fd', 'request_id': 'req-4a64648e-32d4-4340-b64d-e54c8ae137e1'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:15.975851 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-4a64648e-32d4-4340-b64d-e54c8ae137e1 admin admin] The token cache is being invalidate because project 5fb22ef906594d469bdeacb4d190b0fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:31:15.976060 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-4a64648e-32d4-4340-b64d-e54c8ae137e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:15.977176 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-4a64648e-32d4-4340-b64d-e54c8ae137e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:15.977651 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bbe2e-11bd-4ef0-8763-bfc5330c1d9a service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:15.981708 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-9c4bbe2e-11bd-4ef0-8763-bfc5330c1d9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:15.981977 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1120/2239] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:31:15 2021] DELETE /identity/v3/projects/5fb22ef906594d469bdeacb4d190b0fd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:31:15.982784 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64648e-32d4-4340-b64d-e54c8ae137e1 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:15.984395 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-4a64648e-32d4-4340-b64d-e54c8ae137e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:15.992696 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bbe2e-11bd-4ef0-8763-bfc5330c1d9a service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:16.050991 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3688cb1-81a9-4dc3-a310-552c44f36fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:16.051224 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64648e-32d4-4340-b64d-e54c8ae137e1 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:16.052066 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3688cb1-81a9-4dc3-a310-552c44f36fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:16.052298 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3688cb1-81a9-4dc3-a310-552c44f36fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:16.052576 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3688cb1-81a9-4dc3-a310-552c44f36fa8 admin admin] PATH_INFO: `/v3/projects/f0a738746edc4065abdd9bf0edc267bc` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:16.053842 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3688cb1-81a9-4dc3-a310-552c44f36fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0a738746edc4065abdd9bf0edc267bc)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:16.055682 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b5d68-5aad-4146-82e4-864fbf742f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:16.055802 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3688cb1-81a9-4dc3-a310-552c44f36fa8 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:16.056566 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b5d68-5aad-4146-82e4-864fbf742f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:16.056841 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b5d68-5aad-4146-82e4-864fbf742f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:16.057140 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b5d68-5aad-4146-82e4-864fbf742f59 admin admin] PATH_INFO: `/v3/users/2a44855a05c140bf9214e4f085445270` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:16.058352 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b5d68-5aad-4146-82e4-864fbf742f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a44855a05c140bf9214e4f085445270)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:16.060427 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b5d68-5aad-4146-82e4-864fbf742f59 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:16.104180 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d3688cb1-81a9-4dc3-a310-552c44f36fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0a738746edc4065abdd9bf0edc267bc', 'request_id': 'req-d3688cb1-81a9-4dc3-a310-552c44f36fa8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.109960 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-784b5d68-5aad-4146-82e4-864fbf742f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a44855a05c140bf9214e4f085445270'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.110628 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-784b5d68-5aad-4146-82e4-864fbf742f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a44855a05c140bf9214e4f085445270'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.110906 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d3688cb1-81a9-4dc3-a310-552c44f36fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0a738746edc4065abdd9bf0edc267bc', 'request_id': 'req-d3688cb1-81a9-4dc3-a310-552c44f36fa8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.118445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-784b5d68-5aad-4146-82e4-864fbf742f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a44855a05c140bf9214e4f085445270'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.119367 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-784b5d68-5aad-4146-82e4-864fbf742f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a44855a05c140bf9214e4f085445270'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.128601 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d3688cb1-81a9-4dc3-a310-552c44f36fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0a738746edc4065abdd9bf0edc267bc', 'request_id': 'req-d3688cb1-81a9-4dc3-a310-552c44f36fa8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.132489 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d3688cb1-81a9-4dc3-a310-552c44f36fa8 admin admin] The token cache is being invalidate because project f0a738746edc4065abdd9bf0edc267bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:31:16.132822 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d3688cb1-81a9-4dc3-a310-552c44f36fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.133254 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-784b5d68-5aad-4146-82e4-864fbf742f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a44855a05c140bf9214e4f085445270'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.133497 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d3688cb1-81a9-4dc3-a310-552c44f36fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.135035 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1120/2240] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:31:15 2021] DELETE /identity/v3/projects/f0a738746edc4065abdd9bf0edc267bc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:31:16.139270 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3688cb1-81a9-4dc3-a310-552c44f36fa8 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:16.140563 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d3688cb1-81a9-4dc3-a310-552c44f36fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:16.147343 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1121/2241] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:31:15 2021] DELETE /identity/v3/users/2a44855a05c140bf9214e4f085445270 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:31:16.203858 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3688cb1-81a9-4dc3-a310-552c44f36fa8 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:16.269785 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953a526-4613-4187-a755-4d01f20a6d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:16.270681 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953a526-4613-4187-a755-4d01f20a6d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:16.270954 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953a526-4613-4187-a755-4d01f20a6d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:16.271243 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953a526-4613-4187-a755-4d01f20a6d29 admin admin] PATH_INFO: `/v3/users/9375b1972c6d44e9973db1b12b772fe7` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:16.272725 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953a526-4613-4187-a755-4d01f20a6d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9375b1972c6d44e9973db1b12b772fe7)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:16.274736 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953a526-4613-4187-a755-4d01f20a6d29 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:16.327224 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a953a526-4613-4187-a755-4d01f20a6d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9375b1972c6d44e9973db1b12b772fe7'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.341436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a953a526-4613-4187-a755-4d01f20a6d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9375b1972c6d44e9973db1b12b772fe7'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.342436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a953a526-4613-4187-a755-4d01f20a6d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9375b1972c6d44e9973db1b12b772fe7'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.350346 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a953a526-4613-4187-a755-4d01f20a6d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9375b1972c6d44e9973db1b12b772fe7'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.358405 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-a953a526-4613-4187-a755-4d01f20a6d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9375b1972c6d44e9973db1b12b772fe7'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.364941 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1121/2242] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:31:16 2021] DELETE /identity/v3/users/9375b1972c6d44e9973db1b12b772fe7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:31:16.445488 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b5d68-5aad-4146-82e4-864fbf742f59 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:16.447212 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-784b5d68-5aad-4146-82e4-864fbf742f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:16.464369 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b5d68-5aad-4146-82e4-864fbf742f59 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:16.532445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae42aa9-554a-4eba-a6cf-9c8f6b7f55a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:16.532445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae42aa9-554a-4eba-a6cf-9c8f6b7f55a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:16.532445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae42aa9-554a-4eba-a6cf-9c8f6b7f55a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:16.532445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae42aa9-554a-4eba-a6cf-9c8f6b7f55a5 admin admin] PATH_INFO: `/v3/projects/04d145b25f134b96b2ff3b275ab84ee4` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:16.533221 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae42aa9-554a-4eba-a6cf-9c8f6b7f55a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04d145b25f134b96b2ff3b275ab84ee4)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:16.535118 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae42aa9-554a-4eba-a6cf-9c8f6b7f55a5 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:16.582645 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-fae42aa9-554a-4eba-a6cf-9c8f6b7f55a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d145b25f134b96b2ff3b275ab84ee4', 'request_id': 'req-fae42aa9-554a-4eba-a6cf-9c8f6b7f55a5'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.591659 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-fae42aa9-554a-4eba-a6cf-9c8f6b7f55a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d145b25f134b96b2ff3b275ab84ee4', 'request_id': 'req-fae42aa9-554a-4eba-a6cf-9c8f6b7f55a5'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.598748 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-fae42aa9-554a-4eba-a6cf-9c8f6b7f55a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d145b25f134b96b2ff3b275ab84ee4', 'request_id': 'req-fae42aa9-554a-4eba-a6cf-9c8f6b7f55a5'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.611133 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-fae42aa9-554a-4eba-a6cf-9c8f6b7f55a5 admin admin] The token cache is being invalidate because project 04d145b25f134b96b2ff3b275ab84ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:31:16.611429 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-fae42aa9-554a-4eba-a6cf-9c8f6b7f55a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.612087 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-fae42aa9-554a-4eba-a6cf-9c8f6b7f55a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.614026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1122/2243] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:31:16 2021] DELETE /identity/v3/projects/04d145b25f134b96b2ff3b275ab84ee4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:31:16.620922 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725747c0-6bfd-4531-899d-19d06ad301bc None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:16.621364 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725747c0-6bfd-4531-899d-19d06ad301bc None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:16.622954 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725747c0-6bfd-4531-899d-19d06ad301bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:16.641332 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-725747c0-6bfd-4531-899d-19d06ad301bc None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:16.642914 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-725747c0-6bfd-4531-899d-19d06ad301bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:16.709876 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1122/2244] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:31:16.714496 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae42aa9-554a-4eba-a6cf-9c8f6b7f55a5 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:16.716665 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-fae42aa9-554a-4eba-a6cf-9c8f6b7f55a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:16.722247 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec46c8-0831-4489-ad01-acd5669b033a None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:16.722550 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec46c8-0831-4489-ad01-acd5669b033a None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:16.722835 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec46c8-0831-4489-ad01-acd5669b033a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:16.730409 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae42aa9-554a-4eba-a6cf-9c8f6b7f55a5 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:16.744349 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d436d-56b5-4584-bec0-9ce86dc0160a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:16.745298 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d436d-56b5-4584-bec0-9ce86dc0160a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:16.745624 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d436d-56b5-4584-bec0-9ce86dc0160a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:16.745909 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d436d-56b5-4584-bec0-9ce86dc0160a admin admin] PATH_INFO: `/v3/projects/9054d0c565744146b0d0ea8ac77d6956` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:16.747363 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d436d-56b5-4584-bec0-9ce86dc0160a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9054d0c565744146b0d0ea8ac77d6956)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:16.749571 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d436d-56b5-4584-bec0-9ce86dc0160a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:16.763707 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-26ec46c8-0831-4489-ad01-acd5669b033a None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:16.764960 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-26ec46c8-0831-4489-ad01-acd5669b033a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:16.776309 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1123/2245] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:31:16.777640 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec46c8-0831-4489-ad01-acd5669b033a None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:16.788142 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec46c8-0831-4489-ad01-acd5669b033a None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:16.799820 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8c2d436d-56b5-4584-bec0-9ce86dc0160a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9054d0c565744146b0d0ea8ac77d6956', 'request_id': 'req-8c2d436d-56b5-4584-bec0-9ce86dc0160a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.807167 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8c2d436d-56b5-4584-bec0-9ce86dc0160a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9054d0c565744146b0d0ea8ac77d6956', 'request_id': 'req-8c2d436d-56b5-4584-bec0-9ce86dc0160a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.813478 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8c2d436d-56b5-4584-bec0-9ce86dc0160a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9054d0c565744146b0d0ea8ac77d6956', 'request_id': 'req-8c2d436d-56b5-4584-bec0-9ce86dc0160a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.826726 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8c2d436d-56b5-4584-bec0-9ce86dc0160a admin admin] The token cache is being invalidate because project 9054d0c565744146b0d0ea8ac77d6956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:31:16.827020 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8c2d436d-56b5-4584-bec0-9ce86dc0160a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.827695 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8c2d436d-56b5-4584-bec0-9ce86dc0160a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.829273 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1123/2246] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:31:16 2021] DELETE /identity/v3/projects/9054d0c565744146b0d0ea8ac77d6956 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:31:16.833141 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d436d-56b5-4584-bec0-9ce86dc0160a admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:16.834395 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8c2d436d-56b5-4584-bec0-9ce86dc0160a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:16.847300 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d0075-e5dc-4047-a384-ff62e821e6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:16.847974 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d0075-e5dc-4047-a384-ff62e821e6eb admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:16.848255 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d0075-e5dc-4047-a384-ff62e821e6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:16.848532 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d0075-e5dc-4047-a384-ff62e821e6eb admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:16.849299 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d0075-e5dc-4047-a384-ff62e821e6eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:31:16.849609 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d0075-e5dc-4047-a384-ff62e821e6eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:16.851206 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d0075-e5dc-4047-a384-ff62e821e6eb admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:16.863036 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1124/2247] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:31:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:31:16.867139 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d0075-e5dc-4047-a384-ff62e821e6eb admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:16.868830 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-393d0075-e5dc-4047-a384-ff62e821e6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:16.881752 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d0075-e5dc-4047-a384-ff62e821e6eb admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:16.887115 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e84bc-df6c-4f4d-b7f8-53e75e8b4193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:16.888352 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e84bc-df6c-4f4d-b7f8-53e75e8b4193 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:16.888680 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e84bc-df6c-4f4d-b7f8-53e75e8b4193 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:16.888965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e84bc-df6c-4f4d-b7f8-53e75e8b4193 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:16.889621 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e84bc-df6c-4f4d-b7f8-53e75e8b4193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:16.891953 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e84bc-df6c-4f4d-b7f8-53e75e8b4193 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:16.898381 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d436d-56b5-4584-bec0-9ce86dc0160a admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:16.907130 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35601f3f-d747-4c1b-b56e-a439e3a3554d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:16.908784 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35601f3f-d747-4c1b-b56e-a439e3a3554d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:16.908784 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35601f3f-d747-4c1b-b56e-a439e3a3554d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:16.908784 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35601f3f-d747-4c1b-b56e-a439e3a3554d admin admin] PATH_INFO: `/v3/users/a8fe21b8ee4a4d52aba83a26fe17644a` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:16.909982 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35601f3f-d747-4c1b-b56e-a439e3a3554d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8fe21b8ee4a4d52aba83a26fe17644a)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:16.912964 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35601f3f-d747-4c1b-b56e-a439e3a3554d admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:16.923745 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1125/2248] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:31:16 2021] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:31:16.925225 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e84bc-df6c-4f4d-b7f8-53e75e8b4193 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:16.959817 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-35601f3f-d747-4c1b-b56e-a439e3a3554d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8fe21b8ee4a4d52aba83a26fe17644a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.960487 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-35601f3f-d747-4c1b-b56e-a439e3a3554d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8fe21b8ee4a4d52aba83a26fe17644a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.968894 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-35601f3f-d747-4c1b-b56e-a439e3a3554d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8fe21b8ee4a4d52aba83a26fe17644a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.969720 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-35601f3f-d747-4c1b-b56e-a439e3a3554d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8fe21b8ee4a4d52aba83a26fe17644a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.982538 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-35601f3f-d747-4c1b-b56e-a439e3a3554d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8fe21b8ee4a4d52aba83a26fe17644a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:16.992499 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e84bc-df6c-4f4d-b7f8-53e75e8b4193 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:16.997363 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cac945-0bf0-426f-8ef6-8677a7bbf4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:16.997525 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1124/2249] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:31:16 2021] DELETE /identity/v3/users/a8fe21b8ee4a4d52aba83a26fe17644a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:31:17.000469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cac945-0bf0-426f-8ef6-8677a7bbf4eb admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:17.000469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cac945-0bf0-426f-8ef6-8677a7bbf4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:17.000469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cac945-0bf0-426f-8ef6-8677a7bbf4eb admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:17.000977 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cac945-0bf0-426f-8ef6-8677a7bbf4eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:17.002834 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cac945-0bf0-426f-8ef6-8677a7bbf4eb admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:17.023819 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1126/2250] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:31:16 2021] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:31:17.028254 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35601f3f-d747-4c1b-b56e-a439e3a3554d admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:17.029748 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-35601f3f-d747-4c1b-b56e-a439e3a3554d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:17.098058 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35601f3f-d747-4c1b-b56e-a439e3a3554d admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:17.102850 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242373d-35e8-4b05-9fb4-f2cfa05bfbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:17.103511 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242373d-35e8-4b05-9fb4-f2cfa05bfbd8 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:17.103799 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242373d-35e8-4b05-9fb4-f2cfa05bfbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:17.104076 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242373d-35e8-4b05-9fb4-f2cfa05bfbd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:17.104801 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242373d-35e8-4b05-9fb4-f2cfa05bfbd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:17.106418 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242373d-35e8-4b05-9fb4-f2cfa05bfbd8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:17.119744 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1125/2251] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:31:17 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:31:17.123982 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cac945-0bf0-426f-8ef6-8677a7bbf4eb admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:17.135219 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cac945-0bf0-426f-8ef6-8677a7bbf4eb admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:17.141256 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33396ba1-8246-435c-b356-fef6311d6c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:17.141961 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33396ba1-8246-435c-b356-fef6311d6c87 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:17.142243 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33396ba1-8246-435c-b356-fef6311d6c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:17.142519 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33396ba1-8246-435c-b356-fef6311d6c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:17.143249 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33396ba1-8246-435c-b356-fef6311d6c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:17.144993 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33396ba1-8246-435c-b356-fef6311d6c87 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:17.157668 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1127/2252] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:31:17 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:31:17.161736 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242373d-35e8-4b05-9fb4-f2cfa05bfbd8 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:17.172812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242373d-35e8-4b05-9fb4-f2cfa05bfbd8 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:17.179782 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a04e9-58fe-459a-853c-98afd78468e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:17.181009 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a04e9-58fe-459a-853c-98afd78468e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:17.181899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a04e9-58fe-459a-853c-98afd78468e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:17.182274 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a04e9-58fe-459a-853c-98afd78468e3 admin admin] PATH_INFO: `/v3/projects/8a1b8612adb24c1595c3aebc8ecbcc8a/users/4953f526fabf4db399fe6f829bdbeb78/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:17.198050 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a04e9-58fe-459a-853c-98afd78468e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a1b8612adb24c1595c3aebc8ecbcc8a, user_id=4953f526fabf4db399fe6f829bdbeb78, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:17.201266 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a04e9-58fe-459a-853c-98afd78468e3 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:17.214060 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1126/2253] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:31:17 2021] PUT /identity/v3/projects/8a1b8612adb24c1595c3aebc8ecbcc8a/users/4953f526fabf4db399fe6f829bdbeb78/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:31:17.227187 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4878b70-294d-4fad-aa44-0dab417a1fda None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:17.227474 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4878b70-294d-4fad-aa44-0dab417a1fda None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:17.227966 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4878b70-294d-4fad-aa44-0dab417a1fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:17.253943 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-b4878b70-294d-4fad-aa44-0dab417a1fda None None] MFA Rules not processed for user `4953f526fabf4db399fe6f829bdbeb78`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:17.255405 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b4878b70-294d-4fad-aa44-0dab417a1fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:17.297162 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a04e9-58fe-459a-853c-98afd78468e3 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:17.298920 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-963a04e9-58fe-459a-853c-98afd78468e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:17.330910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1128/2254] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:17 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:31:17.385722 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a04e9-58fe-459a-853c-98afd78468e3 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:17.391031 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169236e5-e713-44ab-8e39-ac2f2f9376b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:17.391884 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169236e5-e713-44ab-8e39-ac2f2f9376b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:17.392172 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169236e5-e713-44ab-8e39-ac2f2f9376b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:17.392448 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169236e5-e713-44ab-8e39-ac2f2f9376b4 admin admin] PATH_INFO: `/v3/projects/5ddf465e01d649ffb5ef5d67a6b77515` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:17.393637 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169236e5-e713-44ab-8e39-ac2f2f9376b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ddf465e01d649ffb5ef5d67a6b77515)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:17.395527 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169236e5-e713-44ab-8e39-ac2f2f9376b4 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:17.443590 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-169236e5-e713-44ab-8e39-ac2f2f9376b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ddf465e01d649ffb5ef5d67a6b77515', 'request_id': 'req-169236e5-e713-44ab-8e39-ac2f2f9376b4'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:17.451380 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-169236e5-e713-44ab-8e39-ac2f2f9376b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ddf465e01d649ffb5ef5d67a6b77515', 'request_id': 'req-169236e5-e713-44ab-8e39-ac2f2f9376b4'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:17.456624 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-169236e5-e713-44ab-8e39-ac2f2f9376b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ddf465e01d649ffb5ef5d67a6b77515', 'request_id': 'req-169236e5-e713-44ab-8e39-ac2f2f9376b4'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:17.468009 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-169236e5-e713-44ab-8e39-ac2f2f9376b4 admin admin] The token cache is being invalidate because project 5ddf465e01d649ffb5ef5d67a6b77515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:31:17.468558 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-169236e5-e713-44ab-8e39-ac2f2f9376b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:17.469462 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-169236e5-e713-44ab-8e39-ac2f2f9376b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:17.472180 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1127/2255] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:31:17 2021] DELETE /identity/v3/projects/5ddf465e01d649ffb5ef5d67a6b77515 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:31:23.123621 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4878b70-294d-4fad-aa44-0dab417a1fda None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:23.125179 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b4878b70-294d-4fad-aa44-0dab417a1fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:23.180863 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4878b70-294d-4fad-aa44-0dab417a1fda None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:23.228193 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59163d98-1f56-4aaf-89de-1259452f0ba4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d661d14d94fa597aee037599de7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:23.229048 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59163d98-1f56-4aaf-89de-1259452f0ba4 service glance] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:23.229331 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59163d98-1f56-4aaf-89de-1259452f0ba4 service glance] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:23.229604 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59163d98-1f56-4aaf-89de-1259452f0ba4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:23.231412 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-59163d98-1f56-4aaf-89de-1259452f0ba4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:23.287700 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59163d98-1f56-4aaf-89de-1259452f0ba4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:23.289173 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59163d98-1f56-4aaf-89de-1259452f0ba4 service glance] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:23.298149 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1129/2256] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:31:23 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:31:23.463972 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d826db5-45a0-4202-83e0-81eb42282fa6 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:23.464450 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d826db5-45a0-4202-83e0-81eb42282fa6 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:23.464587 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d826db5-45a0-4202-83e0-81eb42282fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:23.484711 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-1d826db5-45a0-4202-83e0-81eb42282fa6 None None] MFA Rules not processed for user `a93401007dd64d88af5e41ff08679a28`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:23.485967 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-1d826db5-45a0-4202-83e0-81eb42282fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:23.539548 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1128/2257] 10.222.0.32 () {58 vars in 1010 bytes} [Wed Sep 15 02:31:23 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:31:23.581586 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59163d98-1f56-4aaf-89de-1259452f0ba4 service glance] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:23.583005 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-59163d98-1f56-4aaf-89de-1259452f0ba4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:23.657755 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59163d98-1f56-4aaf-89de-1259452f0ba4 service glance] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:23.663139 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96ad42-921d-4133-9ef6-fbabd501aab8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea510f540b2d47dcb19c8715fd247786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:23.664094 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96ad42-921d-4133-9ef6-fbabd501aab8 service swift] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:23.664465 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96ad42-921d-4133-9ef6-fbabd501aab8 service swift] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:23.664749 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96ad42-921d-4133-9ef6-fbabd501aab8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:23.673661 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96ad42-921d-4133-9ef6-fbabd501aab8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:23.675287 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96ad42-921d-4133-9ef6-fbabd501aab8 service swift] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:23.683428 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1130/2258] 10.222.0.32 () {60 vars in 1385 bytes} [Wed Sep 15 02:31:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 02:31:24.593584 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfa338-ea31-49c9-8fdd-7aa184352bf1 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:24.594124 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfa338-ea31-49c9-8fdd-7aa184352bf1 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:24.594124 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bfa338-ea31-49c9-8fdd-7aa184352bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:24.612349 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-72bfa338-ea31-49c9-8fdd-7aa184352bf1 None None] MFA Rules not processed for user `a93401007dd64d88af5e41ff08679a28`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:24.613568 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-72bfa338-ea31-49c9-8fdd-7aa184352bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:24.621279 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1129/2259] 10.222.0.32 () {58 vars in 1010 bytes} [Wed Sep 15 02:31:24 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:31:24.634684 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96ad42-921d-4133-9ef6-fbabd501aab8 service swift] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:24.645322 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96ad42-921d-4133-9ef6-fbabd501aab8 service swift] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:24.650237 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7ec98-4b90-4280-b62c-5d7e68e25991 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea510f540b2d47dcb19c8715fd247786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:24.650896 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7ec98-4b90-4280-b62c-5d7e68e25991 service swift] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:24.651174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7ec98-4b90-4280-b62c-5d7e68e25991 service swift] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:24.651454 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7ec98-4b90-4280-b62c-5d7e68e25991 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:24.661078 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7ec98-4b90-4280-b62c-5d7e68e25991 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:24.662775 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7ec98-4b90-4280-b62c-5d7e68e25991 service swift] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:24.672839 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1131/2260] 10.222.0.32 () {60 vars in 1385 bytes} [Wed Sep 15 02:31:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 02:31:27.522155 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ce650-d2bf-4187-bdb8-27d1cf46d5e7 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:27.522635 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ce650-d2bf-4187-bdb8-27d1cf46d5e7 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:27.522727 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ce650-d2bf-4187-bdb8-27d1cf46d5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:27.540503 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-759ce650-d2bf-4187-bdb8-27d1cf46d5e7 None None] MFA Rules not processed for user `a93401007dd64d88af5e41ff08679a28`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:27.541875 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-759ce650-d2bf-4187-bdb8-27d1cf46d5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:27.549045 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1130/2261] 10.222.0.32 () {58 vars in 968 bytes} [Wed Sep 15 02:31:27 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:31:27.561671 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7ec98-4b90-4280-b62c-5d7e68e25991 service swift] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:27.572494 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7ec98-4b90-4280-b62c-5d7e68e25991 service swift] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:27.578581 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955016ce-46f8-4771-a3ad-c2e9d7fa26c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea510f540b2d47dcb19c8715fd247786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:27.579244 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955016ce-46f8-4771-a3ad-c2e9d7fa26c5 service swift] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:27.579525 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955016ce-46f8-4771-a3ad-c2e9d7fa26c5 service swift] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:27.579800 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955016ce-46f8-4771-a3ad-c2e9d7fa26c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:27.588689 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955016ce-46f8-4771-a3ad-c2e9d7fa26c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:27.590504 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955016ce-46f8-4771-a3ad-c2e9d7fa26c5 service swift] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:27.601173 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1132/2262] 10.222.0.32 () {60 vars in 1385 bytes} [Wed Sep 15 02:31:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 02:31:33.238175 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ce650-d2bf-4187-bdb8-27d1cf46d5e7 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:33.239612 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-759ce650-d2bf-4187-bdb8-27d1cf46d5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:33.301899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ce650-d2bf-4187-bdb8-27d1cf46d5e7 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:33.306335 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42700c35-c138-4737-a41f-53cd8169c015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:33.307189 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42700c35-c138-4737-a41f-53cd8169c015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:33.307476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42700c35-c138-4737-a41f-53cd8169c015 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:33.307754 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42700c35-c138-4737-a41f-53cd8169c015 admin admin] PATH_INFO: `/v3/users/3879810326344546ba8e000419b9f253` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:33.308979 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42700c35-c138-4737-a41f-53cd8169c015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3879810326344546ba8e000419b9f253)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:33.311517 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42700c35-c138-4737-a41f-53cd8169c015 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:33.357296 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-42700c35-c138-4737-a41f-53cd8169c015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3879810326344546ba8e000419b9f253'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:33.357945 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-42700c35-c138-4737-a41f-53cd8169c015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3879810326344546ba8e000419b9f253'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:33.364771 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-42700c35-c138-4737-a41f-53cd8169c015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3879810326344546ba8e000419b9f253'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:33.365409 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-42700c35-c138-4737-a41f-53cd8169c015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3879810326344546ba8e000419b9f253'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:33.377349 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-42700c35-c138-4737-a41f-53cd8169c015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3879810326344546ba8e000419b9f253'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:33.388848 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1131/2263] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:31:33 2021] DELETE /identity/v3/users/3879810326344546ba8e000419b9f253 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:31:33.393914 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c7f00-f18b-4042-8df8-46b4acbee4c0 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:33.394429 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c7f00-f18b-4042-8df8-46b4acbee4c0 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:33.394540 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c7f00-f18b-4042-8df8-46b4acbee4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:33.413762 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-8f0c7f00-f18b-4042-8df8-46b4acbee4c0 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:33.414952 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-8f0c7f00-f18b-4042-8df8-46b4acbee4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:33.471148 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1133/2264] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:31:33.481210 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42700c35-c138-4737-a41f-53cd8169c015 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:33.482595 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-42700c35-c138-4737-a41f-53cd8169c015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:33.541806 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42700c35-c138-4737-a41f-53cd8169c015 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:33.545970 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61780b0c-676a-4838-9b51-c9885a58a317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:33.546605 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61780b0c-676a-4838-9b51-c9885a58a317 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:33.546882 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61780b0c-676a-4838-9b51-c9885a58a317 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:33.547153 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61780b0c-676a-4838-9b51-c9885a58a317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:33.555817 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61780b0c-676a-4838-9b51-c9885a58a317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:33.557202 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61780b0c-676a-4838-9b51-c9885a58a317 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:33.567233 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1132/2265] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:31:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:31:33.794254 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c7f00-f18b-4042-8df8-46b4acbee4c0 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:33.796262 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-8f0c7f00-f18b-4042-8df8-46b4acbee4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:33.817071 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c7f00-f18b-4042-8df8-46b4acbee4c0 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:33.822140 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effc9f9-32d2-4612-9b3f-90219c8f9d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:33.823162 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effc9f9-32d2-4612-9b3f-90219c8f9d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:33.823627 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effc9f9-32d2-4612-9b3f-90219c8f9d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:33.823968 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effc9f9-32d2-4612-9b3f-90219c8f9d75 admin admin] PATH_INFO: `/v3/projects/e095af2da2b34e03b63dbdf57a25389d` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:33.826416 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effc9f9-32d2-4612-9b3f-90219c8f9d75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e095af2da2b34e03b63dbdf57a25389d)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:33.828540 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effc9f9-32d2-4612-9b3f-90219c8f9d75 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:33.887106 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-7effc9f9-32d2-4612-9b3f-90219c8f9d75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e095af2da2b34e03b63dbdf57a25389d', 'request_id': 'req-7effc9f9-32d2-4612-9b3f-90219c8f9d75'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:33.893439 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-7effc9f9-32d2-4612-9b3f-90219c8f9d75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e095af2da2b34e03b63dbdf57a25389d', 'request_id': 'req-7effc9f9-32d2-4612-9b3f-90219c8f9d75'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:33.901363 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-7effc9f9-32d2-4612-9b3f-90219c8f9d75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e095af2da2b34e03b63dbdf57a25389d', 'request_id': 'req-7effc9f9-32d2-4612-9b3f-90219c8f9d75'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:33.912206 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-7effc9f9-32d2-4612-9b3f-90219c8f9d75 admin admin] The token cache is being invalidate because project e095af2da2b34e03b63dbdf57a25389d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:31:33.912497 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-7effc9f9-32d2-4612-9b3f-90219c8f9d75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:33.913155 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-7effc9f9-32d2-4612-9b3f-90219c8f9d75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:31:33.914773 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1134/2266] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:31:33 2021] DELETE /identity/v3/projects/e095af2da2b34e03b63dbdf57a25389d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:31:33.920999 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679394e-a9f9-4fc4-9eee-36bd520e1de3 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:33.921292 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679394e-a9f9-4fc4-9eee-36bd520e1de3 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:33.921568 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679394e-a9f9-4fc4-9eee-36bd520e1de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:33.938813 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-f679394e-a9f9-4fc4-9eee-36bd520e1de3 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:33.939987 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-f679394e-a9f9-4fc4-9eee-36bd520e1de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:33.996015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1133/2267] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:31:34.003439 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a26611-0b54-439c-ad30-8c78410125f3 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:34.003726 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a26611-0b54-439c-ad30-8c78410125f3 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:34.004000 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a26611-0b54-439c-ad30-8c78410125f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:34.023810 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-23a26611-0b54-439c-ad30-8c78410125f3 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:34.025030 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-23a26611-0b54-439c-ad30-8c78410125f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:34.033808 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1135/2268] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:31:34.038054 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679394e-a9f9-4fc4-9eee-36bd520e1de3 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:34.049191 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679394e-a9f9-4fc4-9eee-36bd520e1de3 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:34.055082 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d8394-240e-4601-9b3e-878168e9158b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:34.055759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d8394-240e-4601-9b3e-878168e9158b admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:34.056053 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d8394-240e-4601-9b3e-878168e9158b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:34.056319 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d8394-240e-4601-9b3e-878168e9158b admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:34.057626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d8394-240e-4601-9b3e-878168e9158b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:31:34.057626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d8394-240e-4601-9b3e-878168e9158b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:34.058967 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d8394-240e-4601-9b3e-878168e9158b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:34.070926 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1134/2269] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:31:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:31:34.075350 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a26611-0b54-439c-ad30-8c78410125f3 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:34.087644 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a26611-0b54-439c-ad30-8c78410125f3 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:34.093364 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c7ff8-0ca3-4e67-9f3f-d421b73f8b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:34.094141 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c7ff8-0ca3-4e67-9f3f-d421b73f8b84 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:34.094512 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c7ff8-0ca3-4e67-9f3f-d421b73f8b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:34.094851 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c7ff8-0ca3-4e67-9f3f-d421b73f8b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:34.095616 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c7ff8-0ca3-4e67-9f3f-d421b73f8b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:34.099601 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c7ff8-0ca3-4e67-9f3f-d421b73f8b84 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:34.124651 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1136/2270] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:31:34 2021] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:31:34.128731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d8394-240e-4601-9b3e-878168e9158b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:34.138572 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d8394-240e-4601-9b3e-878168e9158b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:34.196615 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0e79a-b740-4d9f-a07b-b2dab8bf821e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:34.197311 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0e79a-b740-4d9f-a07b-b2dab8bf821e admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:34.197589 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0e79a-b740-4d9f-a07b-b2dab8bf821e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:34.197860 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0e79a-b740-4d9f-a07b-b2dab8bf821e admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:34.198552 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0e79a-b740-4d9f-a07b-b2dab8bf821e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:34.200418 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0e79a-b740-4d9f-a07b-b2dab8bf821e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:34.221206 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1135/2271] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:31:34 2021] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:31:34.225330 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c7ff8-0ca3-4e67-9f3f-d421b73f8b84 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:34.236082 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c7ff8-0ca3-4e67-9f3f-d421b73f8b84 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:34.240785 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c588b5-f46a-4c0a-8e38-0cc9b42f270f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:34.241462 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c588b5-f46a-4c0a-8e38-0cc9b42f270f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:34.241759 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c588b5-f46a-4c0a-8e38-0cc9b42f270f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:34.242018 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c588b5-f46a-4c0a-8e38-0cc9b42f270f admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:34.242741 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c588b5-f46a-4c0a-8e38-0cc9b42f270f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:34.244320 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c588b5-f46a-4c0a-8e38-0cc9b42f270f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:34.254627 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1137/2272] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:31:34 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:31:34.258759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0e79a-b740-4d9f-a07b-b2dab8bf821e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:34.269349 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0e79a-b740-4d9f-a07b-b2dab8bf821e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:34.274024 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec8d96-44d6-4b91-8a4c-dd1ebcf41171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:34.274680 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec8d96-44d6-4b91-8a4c-dd1ebcf41171 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:34.274963 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec8d96-44d6-4b91-8a4c-dd1ebcf41171 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:34.275239 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec8d96-44d6-4b91-8a4c-dd1ebcf41171 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:34.275958 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec8d96-44d6-4b91-8a4c-dd1ebcf41171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:34.277561 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec8d96-44d6-4b91-8a4c-dd1ebcf41171 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:34.287712 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1136/2273] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:31:34 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:31:34.291827 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c588b5-f46a-4c0a-8e38-0cc9b42f270f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:34.301492 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c588b5-f46a-4c0a-8e38-0cc9b42f270f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:34.306394 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea3aee-d1c9-4fb5-9266-320855448d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:34.307318 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea3aee-d1c9-4fb5-9266-320855448d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:34.307549 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea3aee-d1c9-4fb5-9266-320855448d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:34.307824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea3aee-d1c9-4fb5-9266-320855448d9a admin admin] PATH_INFO: `/v3/projects/fc4c4681aa63450d976c2d413df26639/users/b14ce134390e4a0bb1f40b7bdd994ebc/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:34.321529 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea3aee-d1c9-4fb5-9266-320855448d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4c4681aa63450d976c2d413df26639, user_id=b14ce134390e4a0bb1f40b7bdd994ebc, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:34.324145 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea3aee-d1c9-4fb5-9266-320855448d9a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:34.336970 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1138/2274] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:31:34 2021] PUT /identity/v3/projects/fc4c4681aa63450d976c2d413df26639/users/b14ce134390e4a0bb1f40b7bdd994ebc/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:31:34.350250 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e26aaf-3693-4d9f-b0c6-2ca33c87af8d None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:34.350589 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e26aaf-3693-4d9f-b0c6-2ca33c87af8d None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:34.350870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e26aaf-3693-4d9f-b0c6-2ca33c87af8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:34.376086 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-60e26aaf-3693-4d9f-b0c6-2ca33c87af8d None None] MFA Rules not processed for user `b14ce134390e4a0bb1f40b7bdd994ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:31:34.377325 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-60e26aaf-3693-4d9f-b0c6-2ca33c87af8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:34.437438 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1137/2275] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:31:34 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:31:34.447799 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea3aee-d1c9-4fb5-9266-320855448d9a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:31:34.449576 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-80ea3aee-d1c9-4fb5-9266-320855448d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:31:34.504554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea3aee-d1c9-4fb5-9266-320855448d9a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:31:34.508161 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c7930-cbe5-4749-b75e-9fd92b965a50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:31:34.508792 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c7930-cbe5-4749-b75e-9fd92b965a50 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:31:34.509099 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c7930-cbe5-4749-b75e-9fd92b965a50 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:31:34.509372 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c7930-cbe5-4749-b75e-9fd92b965a50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:31:34.517800 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c7930-cbe5-4749-b75e-9fd92b965a50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:31:34.519216 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c7930-cbe5-4749-b75e-9fd92b965a50 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:31:34.527758 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1139/2276] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:31:34 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:32:17.635809 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086185ad-87f5-4ca0-8e0b-687c03ac13c7 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:17.636338 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086185ad-87f5-4ca0-8e0b-687c03ac13c7 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:17.636440 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086185ad-87f5-4ca0-8e0b-687c03ac13c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:17.665435 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-086185ad-87f5-4ca0-8e0b-687c03ac13c7 None None] MFA Rules not processed for user `6d88e560bc7f48019d584bd7c88d73ab`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:32:17.667085 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-086185ad-87f5-4ca0-8e0b-687c03ac13c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:17.737765 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1138/2277] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:32:17 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:32:23.644197 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c7930-cbe5-4749-b75e-9fd92b965a50 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:23.745738 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c7930-cbe5-4749-b75e-9fd92b965a50 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:23.750730 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ba38c-3409-4420-8334-493f73a8be05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:23.751567 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ba38c-3409-4420-8334-493f73a8be05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:23.751875 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ba38c-3409-4420-8334-493f73a8be05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:23.752157 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ba38c-3409-4420-8334-493f73a8be05 admin admin] PATH_INFO: `/v3/users/b14ce134390e4a0bb1f40b7bdd994ebc` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:23.753383 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ba38c-3409-4420-8334-493f73a8be05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b14ce134390e4a0bb1f40b7bdd994ebc)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:23.755285 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ba38c-3409-4420-8334-493f73a8be05 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:23.798652 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-857ba38c-3409-4420-8334-493f73a8be05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b14ce134390e4a0bb1f40b7bdd994ebc'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:23.810393 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-857ba38c-3409-4420-8334-493f73a8be05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b14ce134390e4a0bb1f40b7bdd994ebc'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:23.811074 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-857ba38c-3409-4420-8334-493f73a8be05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b14ce134390e4a0bb1f40b7bdd994ebc'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:23.817592 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-857ba38c-3409-4420-8334-493f73a8be05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b14ce134390e4a0bb1f40b7bdd994ebc'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:23.824318 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-857ba38c-3409-4420-8334-493f73a8be05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b14ce134390e4a0bb1f40b7bdd994ebc'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:23.830031 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1140/2278] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:32:23 2021] DELETE /identity/v3/users/b14ce134390e4a0bb1f40b7bdd994ebc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:32:23.834541 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83570e42-43e8-403c-8327-252b72ce8c68 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:23.835113 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83570e42-43e8-403c-8327-252b72ce8c68 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:23.835113 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83570e42-43e8-403c-8327-252b72ce8c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:23.874545 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-83570e42-43e8-403c-8327-252b72ce8c68 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:32:23.875751 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-83570e42-43e8-403c-8327-252b72ce8c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:23.934729 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1139/2279] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:32:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:32:23.944479 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ba38c-3409-4420-8334-493f73a8be05 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:23.945902 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-857ba38c-3409-4420-8334-493f73a8be05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:24.040499 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ba38c-3409-4420-8334-493f73a8be05 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:24.046063 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1ef68-5a30-4399-962f-81fb33ed0122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:24.046721 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1ef68-5a30-4399-962f-81fb33ed0122 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:24.047122 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1ef68-5a30-4399-962f-81fb33ed0122 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:24.047400 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1ef68-5a30-4399-962f-81fb33ed0122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:24.058111 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1ef68-5a30-4399-962f-81fb33ed0122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:24.060257 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1ef68-5a30-4399-962f-81fb33ed0122 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:24.071645 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1141/2280] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:32:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:32:24.442760 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83570e42-43e8-403c-8327-252b72ce8c68 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:24.444178 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-83570e42-43e8-403c-8327-252b72ce8c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:24.456495 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83570e42-43e8-403c-8327-252b72ce8c68 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:24.461253 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e19e0-9a84-47ec-9ed6-3084a4bcab25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:24.462108 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e19e0-9a84-47ec-9ed6-3084a4bcab25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:24.462385 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e19e0-9a84-47ec-9ed6-3084a4bcab25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:24.462654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e19e0-9a84-47ec-9ed6-3084a4bcab25 admin admin] PATH_INFO: `/v3/projects/fc4c4681aa63450d976c2d413df26639` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:24.463955 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e19e0-9a84-47ec-9ed6-3084a4bcab25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4c4681aa63450d976c2d413df26639)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:24.470799 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e19e0-9a84-47ec-9ed6-3084a4bcab25 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:24.518272 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-075e19e0-9a84-47ec-9ed6-3084a4bcab25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4c4681aa63450d976c2d413df26639', 'request_id': 'req-075e19e0-9a84-47ec-9ed6-3084a4bcab25'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:24.524870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-075e19e0-9a84-47ec-9ed6-3084a4bcab25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4c4681aa63450d976c2d413df26639', 'request_id': 'req-075e19e0-9a84-47ec-9ed6-3084a4bcab25'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:24.530112 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-075e19e0-9a84-47ec-9ed6-3084a4bcab25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4c4681aa63450d976c2d413df26639', 'request_id': 'req-075e19e0-9a84-47ec-9ed6-3084a4bcab25'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:24.540486 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-075e19e0-9a84-47ec-9ed6-3084a4bcab25 admin admin] The token cache is being invalidate because project fc4c4681aa63450d976c2d413df26639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:32:24.540774 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-075e19e0-9a84-47ec-9ed6-3084a4bcab25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:24.541478 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-075e19e0-9a84-47ec-9ed6-3084a4bcab25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:24.542981 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1140/2281] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:32:24 2021] DELETE /identity/v3/projects/fc4c4681aa63450d976c2d413df26639 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:32:24.549585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e9483-4c06-41fc-9878-78e54256e128 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:24.549873 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e9483-4c06-41fc-9878-78e54256e128 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:24.550177 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e9483-4c06-41fc-9878-78e54256e128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:24.587118 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-e32e9483-4c06-41fc-9878-78e54256e128 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:32:24.588298 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-e32e9483-4c06-41fc-9878-78e54256e128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:24.643997 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1142/2282] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:32:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:32:24.651216 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bc331-f50c-4dcf-a407-26917761966f None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:24.651576 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bc331-f50c-4dcf-a407-26917761966f None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:24.651863 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bc331-f50c-4dcf-a407-26917761966f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:24.672905 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-9c8bc331-f50c-4dcf-a407-26917761966f None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:32:24.674123 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-9c8bc331-f50c-4dcf-a407-26917761966f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:24.682015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1141/2283] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:32:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:32:24.686617 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e9483-4c06-41fc-9878-78e54256e128 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:24.696318 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e9483-4c06-41fc-9878-78e54256e128 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:24.701113 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d052f-e943-40c8-a59f-18fc65218514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:24.701813 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d052f-e943-40c8-a59f-18fc65218514 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:24.702123 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d052f-e943-40c8-a59f-18fc65218514 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:24.702399 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d052f-e943-40c8-a59f-18fc65218514 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:24.703126 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d052f-e943-40c8-a59f-18fc65218514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:32:24.703740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d052f-e943-40c8-a59f-18fc65218514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:24.705374 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d052f-e943-40c8-a59f-18fc65218514 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:24.716851 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1143/2284] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:32:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:32:24.721209 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bc331-f50c-4dcf-a407-26917761966f None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:24.731442 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bc331-f50c-4dcf-a407-26917761966f None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:24.736369 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbafaa4-be3f-4a19-bdef-8d5407a857b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:24.737061 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbafaa4-be3f-4a19-bdef-8d5407a857b2 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:24.737341 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbafaa4-be3f-4a19-bdef-8d5407a857b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:24.737609 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbafaa4-be3f-4a19-bdef-8d5407a857b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:24.738296 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbafaa4-be3f-4a19-bdef-8d5407a857b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:24.740182 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbafaa4-be3f-4a19-bdef-8d5407a857b2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:24.767959 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1142/2285] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:32:24 2021] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:32:24.772065 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d052f-e943-40c8-a59f-18fc65218514 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:24.782779 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d052f-e943-40c8-a59f-18fc65218514 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:24.841591 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e42e45-5603-4491-94cf-ce990f4067c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:24.842944 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e42e45-5603-4491-94cf-ce990f4067c8 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:24.843225 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e42e45-5603-4491-94cf-ce990f4067c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:24.843498 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e42e45-5603-4491-94cf-ce990f4067c8 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:24.844184 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e42e45-5603-4491-94cf-ce990f4067c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:24.846135 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e42e45-5603-4491-94cf-ce990f4067c8 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:24.875097 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1144/2286] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:32:24 2021] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:32:24.876329 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbafaa4-be3f-4a19-bdef-8d5407a857b2 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:24.886506 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbafaa4-be3f-4a19-bdef-8d5407a857b2 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:24.891441 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f7975-9f50-4a44-85ff-3b9ba67779b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:24.892321 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f7975-9f50-4a44-85ff-3b9ba67779b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:24.892470 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f7975-9f50-4a44-85ff-3b9ba67779b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:24.892964 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f7975-9f50-4a44-85ff-3b9ba67779b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:24.894082 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f7975-9f50-4a44-85ff-3b9ba67779b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:24.895615 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f7975-9f50-4a44-85ff-3b9ba67779b5 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:24.906719 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1143/2287] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:32:24 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:32:24.910752 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e42e45-5603-4491-94cf-ce990f4067c8 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:24.921212 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e42e45-5603-4491-94cf-ce990f4067c8 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:24.926024 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287338d-d848-4d1a-9f35-9c890200ec82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:24.926550 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287338d-d848-4d1a-9f35-9c890200ec82 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:24.926833 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287338d-d848-4d1a-9f35-9c890200ec82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:24.927112 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287338d-d848-4d1a-9f35-9c890200ec82 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:24.927869 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287338d-d848-4d1a-9f35-9c890200ec82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:24.929482 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287338d-d848-4d1a-9f35-9c890200ec82 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:24.940163 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1145/2288] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:32:24 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:32:24.943924 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f7975-9f50-4a44-85ff-3b9ba67779b5 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:24.954967 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f7975-9f50-4a44-85ff-3b9ba67779b5 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:24.959804 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cce75-8710-445b-baaa-39bdab561d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:24.960675 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cce75-8710-445b-baaa-39bdab561d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:24.960984 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cce75-8710-445b-baaa-39bdab561d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:24.961261 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5cce75-8710-445b-baaa-39bdab561d66 admin admin] PATH_INFO: `/v3/projects/1b4ef7dbeb754af3ac01621e1d530f99/users/69c9827f7fd94918b597b7ce5b687400/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:24.975614 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cce75-8710-445b-baaa-39bdab561d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b4ef7dbeb754af3ac01621e1d530f99, user_id=69c9827f7fd94918b597b7ce5b687400, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:24.978469 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5cce75-8710-445b-baaa-39bdab561d66 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:24.993311 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1144/2289] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:32:24 2021] PUT /identity/v3/projects/1b4ef7dbeb754af3ac01621e1d530f99/users/69c9827f7fd94918b597b7ce5b687400/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:32:24.998758 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2f76e-7980-4a77-ba81-fa0564d6f52e None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:24.999050 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2f76e-7980-4a77-ba81-fa0564d6f52e None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:24.999332 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2f76e-7980-4a77-ba81-fa0564d6f52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:25.017922 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-80f2f76e-7980-4a77-ba81-fa0564d6f52e None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:32:25.019116 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-80f2f76e-7980-4a77-ba81-fa0564d6f52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:25.078688 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1146/2290] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:32:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:32:25.089641 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cce75-8710-445b-baaa-39bdab561d66 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:25.092097 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-6e5cce75-8710-445b-baaa-39bdab561d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:25.148928 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5cce75-8710-445b-baaa-39bdab561d66 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:25.153719 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf790bc-3167-44ee-bc03-e6e163944956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:25.154028 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf790bc-3167-44ee-bc03-e6e163944956 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:25.154313 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf790bc-3167-44ee-bc03-e6e163944956 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:25.154592 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf790bc-3167-44ee-bc03-e6e163944956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:25.163712 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf790bc-3167-44ee-bc03-e6e163944956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:25.165179 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf790bc-3167-44ee-bc03-e6e163944956 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:25.176065 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1145/2291] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:32:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:32:29.523763 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba26b0-eda5-41fd-9758-c6bad72f2da7 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:29.524310 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba26b0-eda5-41fd-9758-c6bad72f2da7 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:29.524407 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba26b0-eda5-41fd-9758-c6bad72f2da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:29.553425 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-8fba26b0-eda5-41fd-9758-c6bad72f2da7 None None] MFA Rules not processed for user `69c9827f7fd94918b597b7ce5b687400`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:32:29.554516 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-8fba26b0-eda5-41fd-9758-c6bad72f2da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:29.631494 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1147/2292] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:32:29 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:32:29.636071 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf790bc-3167-44ee-bc03-e6e163944956 service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:29.646295 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf790bc-3167-44ee-bc03-e6e163944956 service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:29.651159 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f55f3c-db90-4841-a608-c828402bf17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:29.651880 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f55f3c-db90-4841-a608-c828402bf17c admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:29.652201 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f55f3c-db90-4841-a608-c828402bf17c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:29.652479 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f55f3c-db90-4841-a608-c828402bf17c admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:29.653214 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f55f3c-db90-4841-a608-c828402bf17c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:29.655106 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f55f3c-db90-4841-a608-c828402bf17c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:29.686093 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1146/2293] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:32:29 2021] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:32:29.690698 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba26b0-eda5-41fd-9758-c6bad72f2da7 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:29.702362 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba26b0-eda5-41fd-9758-c6bad72f2da7 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:29.763112 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1400f-2375-424e-95ef-8536ece0bb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:29.763797 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1400f-2375-424e-95ef-8536ece0bb88 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:29.764079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1400f-2375-424e-95ef-8536ece0bb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:29.764350 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1400f-2375-424e-95ef-8536ece0bb88 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:29.765389 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1400f-2375-424e-95ef-8536ece0bb88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:29.767711 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1400f-2375-424e-95ef-8536ece0bb88 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:29.790500 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1148/2294] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:32:29 2021] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:32:29.794766 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f55f3c-db90-4841-a608-c828402bf17c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:29.805235 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f55f3c-db90-4841-a608-c828402bf17c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:29.810475 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cefeb5-ebae-4d6f-9e7a-1688c36d561e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:29.811132 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cefeb5-ebae-4d6f-9e7a-1688c36d561e admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:29.811416 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cefeb5-ebae-4d6f-9e7a-1688c36d561e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:29.811693 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cefeb5-ebae-4d6f-9e7a-1688c36d561e admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:29.812418 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cefeb5-ebae-4d6f-9e7a-1688c36d561e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:29.814041 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cefeb5-ebae-4d6f-9e7a-1688c36d561e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:29.824219 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1147/2295] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:32:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:32:29.828343 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1400f-2375-424e-95ef-8536ece0bb88 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:29.838301 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1400f-2375-424e-95ef-8536ece0bb88 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:29.843659 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e6f4b-91cc-4351-a703-cdb7ebed1122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:29.844535 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e6f4b-91cc-4351-a703-cdb7ebed1122 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:29.844817 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e6f4b-91cc-4351-a703-cdb7ebed1122 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:29.845117 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e6f4b-91cc-4351-a703-cdb7ebed1122 admin admin] PATH_INFO: `/v3/projects/42a939f0e5b14dd8b43d0176da894ad0/users/4725e00ac9d44219998882485f65aff8/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:29.859892 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e6f4b-91cc-4351-a703-cdb7ebed1122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42a939f0e5b14dd8b43d0176da894ad0, user_id=4725e00ac9d44219998882485f65aff8, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:29.862580 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e6f4b-91cc-4351-a703-cdb7ebed1122 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:29.875735 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1149/2296] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:32:29 2021] PUT /identity/v3/projects/42a939f0e5b14dd8b43d0176da894ad0/users/4725e00ac9d44219998882485f65aff8/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:32:29.879619 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cefeb5-ebae-4d6f-9e7a-1688c36d561e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:29.889521 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cefeb5-ebae-4d6f-9e7a-1688c36d561e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:29.943356 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88893ed-766f-466d-9828-747d8e7a2cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:29.944033 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88893ed-766f-466d-9828-747d8e7a2cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:29.944321 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88893ed-766f-466d-9828-747d8e7a2cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:29.944601 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88893ed-766f-466d-9828-747d8e7a2cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:29.945376 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88893ed-766f-466d-9828-747d8e7a2cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:29.946936 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88893ed-766f-466d-9828-747d8e7a2cd8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:29.956227 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1148/2297] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:32:29 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:32:29.960531 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e6f4b-91cc-4351-a703-cdb7ebed1122 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:29.974684 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e6f4b-91cc-4351-a703-cdb7ebed1122 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:29.981235 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8b274-c9f4-4db7-ae70-62167a9007db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:29.982299 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8b274-c9f4-4db7-ae70-62167a9007db admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:29.982598 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8b274-c9f4-4db7-ae70-62167a9007db admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:29.982858 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8b274-c9f4-4db7-ae70-62167a9007db admin admin] PATH_INFO: `/v3/projects/42a939f0e5b14dd8b43d0176da894ad0/users/4725e00ac9d44219998882485f65aff8/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:29.984923 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8b274-c9f4-4db7-ae70-62167a9007db admin admin] RBAC: Authorizing `identity:create_grant(project_id=42a939f0e5b14dd8b43d0176da894ad0, user_id=4725e00ac9d44219998882485f65aff8, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:29.987562 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8b274-c9f4-4db7-ae70-62167a9007db admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:29.998926 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1150/2298] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:32:29 2021] PUT /identity/v3/projects/42a939f0e5b14dd8b43d0176da894ad0/users/4725e00ac9d44219998882485f65aff8/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:32:35.878462 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb3f20-4ad2-4274-bb2b-4216726d9afe None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:35.879053 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb3f20-4ad2-4274-bb2b-4216726d9afe None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:35.879053 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb3f20-4ad2-4274-bb2b-4216726d9afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:35.905700 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-92fb3f20-4ad2-4274-bb2b-4216726d9afe None None] MFA Rules not processed for user `4725e00ac9d44219998882485f65aff8`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:32:35.906846 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-92fb3f20-4ad2-4274-bb2b-4216726d9afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:35.973404 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1149/2299] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:32:35 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:32:35.985001 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8b274-c9f4-4db7-ae70-62167a9007db admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:35.986735 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-dcf8b274-c9f4-4db7-ae70-62167a9007db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:36.059592 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8b274-c9f4-4db7-ae70-62167a9007db admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:36.065263 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59467ec4-a41c-4fa4-b713-42bc0875ca4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:36.065944 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59467ec4-a41c-4fa4-b713-42bc0875ca4a service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:36.066228 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59467ec4-a41c-4fa4-b713-42bc0875ca4a service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:36.066507 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59467ec4-a41c-4fa4-b713-42bc0875ca4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:36.122447 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59467ec4-a41c-4fa4-b713-42bc0875ca4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:36.124027 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59467ec4-a41c-4fa4-b713-42bc0875ca4a service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:36.132789 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1151/2300] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:32:35 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:32:37.565036 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f5ad1-46cd-4694-9702-a01d0763b7fb None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:37.565571 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f5ad1-46cd-4694-9702-a01d0763b7fb None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:37.565777 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f5ad1-46cd-4694-9702-a01d0763b7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:37.582822 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-7e9f5ad1-46cd-4694-9702-a01d0763b7fb None None] MFA Rules not processed for user `69c9827f7fd94918b597b7ce5b687400`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:32:37.584020 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7e9f5ad1-46cd-4694-9702-a01d0763b7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:37.591914 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1150/2301] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:32:37 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:32:46.119825 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59467ec4-a41c-4fa4-b713-42bc0875ca4a service nova] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:46.121275 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-59467ec4-a41c-4fa4-b713-42bc0875ca4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:46.183994 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59467ec4-a41c-4fa4-b713-42bc0875ca4a service nova] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:46.189139 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec196668-f556-474f-953f-4e224752a4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:46.190030 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec196668-f556-474f-953f-4e224752a4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:46.190307 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec196668-f556-474f-953f-4e224752a4db admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:46.190577 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec196668-f556-474f-953f-4e224752a4db admin admin] PATH_INFO: `/v3/users/4953f526fabf4db399fe6f829bdbeb78` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:46.191786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec196668-f556-474f-953f-4e224752a4db admin admin] RBAC: Authorizing `identity:delete_user(user_id=4953f526fabf4db399fe6f829bdbeb78)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:46.194031 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec196668-f556-474f-953f-4e224752a4db admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:46.243973 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-ec196668-f556-474f-953f-4e224752a4db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4953f526fabf4db399fe6f829bdbeb78'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:46.256117 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-ec196668-f556-474f-953f-4e224752a4db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4953f526fabf4db399fe6f829bdbeb78'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:46.256801 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-ec196668-f556-474f-953f-4e224752a4db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4953f526fabf4db399fe6f829bdbeb78'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:46.264180 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-ec196668-f556-474f-953f-4e224752a4db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4953f526fabf4db399fe6f829bdbeb78'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:46.271045 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-ec196668-f556-474f-953f-4e224752a4db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4953f526fabf4db399fe6f829bdbeb78'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:46.282770 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1152/2302] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:32:46 2021] DELETE /identity/v3/users/4953f526fabf4db399fe6f829bdbeb78 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:32:46.287299 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e89589-098e-4c18-869a-8f46f71a9120 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:46.287759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e89589-098e-4c18-869a-8f46f71a9120 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:46.287891 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e89589-098e-4c18-869a-8f46f71a9120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:46.304815 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-d9e89589-098e-4c18-869a-8f46f71a9120 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:32:46.306030 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-d9e89589-098e-4c18-869a-8f46f71a9120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:46.362076 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1151/2303] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:32:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:32:46.371812 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec196668-f556-474f-953f-4e224752a4db admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:46.373244 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ec196668-f556-474f-953f-4e224752a4db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:46.429255 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec196668-f556-474f-953f-4e224752a4db admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:46.432857 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b4fae-bdfe-4477-9380-a8ef424cb972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:46.433524 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b4fae-bdfe-4477-9380-a8ef424cb972 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:46.433805 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b4fae-bdfe-4477-9380-a8ef424cb972 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:46.434079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b4fae-bdfe-4477-9380-a8ef424cb972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:46.443201 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b4fae-bdfe-4477-9380-a8ef424cb972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:46.444651 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b4fae-bdfe-4477-9380-a8ef424cb972 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:46.454708 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1153/2304] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:32:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:32:46.727438 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e89589-098e-4c18-869a-8f46f71a9120 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:46.728978 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-d9e89589-098e-4c18-869a-8f46f71a9120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:46.741131 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e89589-098e-4c18-869a-8f46f71a9120 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:46.754810 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a206977-3bfe-4dc1-9aea-d41af52e8c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:46.755776 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a206977-3bfe-4dc1-9aea-d41af52e8c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:46.756061 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a206977-3bfe-4dc1-9aea-d41af52e8c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:46.756434 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a206977-3bfe-4dc1-9aea-d41af52e8c46 admin admin] PATH_INFO: `/v3/projects/8a1b8612adb24c1595c3aebc8ecbcc8a` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:46.757635 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a206977-3bfe-4dc1-9aea-d41af52e8c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a1b8612adb24c1595c3aebc8ecbcc8a)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:46.762838 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a206977-3bfe-4dc1-9aea-d41af52e8c46 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:46.810687 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9a206977-3bfe-4dc1-9aea-d41af52e8c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a1b8612adb24c1595c3aebc8ecbcc8a', 'request_id': 'req-9a206977-3bfe-4dc1-9aea-d41af52e8c46'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:46.818175 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9a206977-3bfe-4dc1-9aea-d41af52e8c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a1b8612adb24c1595c3aebc8ecbcc8a', 'request_id': 'req-9a206977-3bfe-4dc1-9aea-d41af52e8c46'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:46.823842 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9a206977-3bfe-4dc1-9aea-d41af52e8c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a1b8612adb24c1595c3aebc8ecbcc8a', 'request_id': 'req-9a206977-3bfe-4dc1-9aea-d41af52e8c46'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:46.835034 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9a206977-3bfe-4dc1-9aea-d41af52e8c46 admin admin] The token cache is being invalidate because project 8a1b8612adb24c1595c3aebc8ecbcc8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:32:46.835322 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9a206977-3bfe-4dc1-9aea-d41af52e8c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:46.835938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9a206977-3bfe-4dc1-9aea-d41af52e8c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:46.837537 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1152/2305] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:32:46 2021] DELETE /identity/v3/projects/8a1b8612adb24c1595c3aebc8ecbcc8a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:32:48.405938 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b4fae-bdfe-4477-9380-a8ef424cb972 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:48.407324 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-db9b4fae-bdfe-4477-9380-a8ef424cb972 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:48.419600 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b4fae-bdfe-4477-9380-a8ef424cb972 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:48.478614 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a4f17-4fb8-4dcb-a7bc-bb2cbac217bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:48.479968 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a4f17-4fb8-4dcb-a7bc-bb2cbac217bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:48.480646 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a4f17-4fb8-4dcb-a7bc-bb2cbac217bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:48.480646 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a4f17-4fb8-4dcb-a7bc-bb2cbac217bb admin admin] PATH_INFO: `/v3/users/ab7e4f6036924452b4b019bcac929f69` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:48.481726 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a4f17-4fb8-4dcb-a7bc-bb2cbac217bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab7e4f6036924452b4b019bcac929f69)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:48.483690 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9a4f17-4fb8-4dcb-a7bc-bb2cbac217bb admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:48.528765 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-7c9a4f17-4fb8-4dcb-a7bc-bb2cbac217bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab7e4f6036924452b4b019bcac929f69'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:48.542505 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-7c9a4f17-4fb8-4dcb-a7bc-bb2cbac217bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab7e4f6036924452b4b019bcac929f69'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:48.543252 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-7c9a4f17-4fb8-4dcb-a7bc-bb2cbac217bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab7e4f6036924452b4b019bcac929f69'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:48.549926 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-7c9a4f17-4fb8-4dcb-a7bc-bb2cbac217bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab7e4f6036924452b4b019bcac929f69'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:48.556864 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-7c9a4f17-4fb8-4dcb-a7bc-bb2cbac217bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab7e4f6036924452b4b019bcac929f69'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:48.563379 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1154/2306] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:32:48 2021] DELETE /identity/v3/users/ab7e4f6036924452b4b019bcac929f69 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:32:48.567893 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bbf48-7b4e-4bac-b6e9-9148e0cea060 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:48.568359 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bbf48-7b4e-4bac-b6e9-9148e0cea060 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:48.568485 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bbf48-7b4e-4bac-b6e9-9148e0cea060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:48.585398 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-f50bbf48-7b4e-4bac-b6e9-9148e0cea060 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:32:48.586590 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-f50bbf48-7b4e-4bac-b6e9-9148e0cea060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:48.645821 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1153/2307] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:32:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:32:48.655716 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a4f17-4fb8-4dcb-a7bc-bb2cbac217bb admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:48.657142 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-7c9a4f17-4fb8-4dcb-a7bc-bb2cbac217bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:48.712957 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9a4f17-4fb8-4dcb-a7bc-bb2cbac217bb admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:48.716893 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60d6e7-3fad-4f2a-b217-17293941d290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:48.717542 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60d6e7-3fad-4f2a-b217-17293941d290 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:48.717825 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60d6e7-3fad-4f2a-b217-17293941d290 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:48.718099 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60d6e7-3fad-4f2a-b217-17293941d290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:48.727005 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60d6e7-3fad-4f2a-b217-17293941d290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:48.728423 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60d6e7-3fad-4f2a-b217-17293941d290 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:48.738124 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1155/2308] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:32:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:32:49.019664 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bbf48-7b4e-4bac-b6e9-9148e0cea060 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:49.021323 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-f50bbf48-7b4e-4bac-b6e9-9148e0cea060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:49.034361 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bbf48-7b4e-4bac-b6e9-9148e0cea060 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:49.039303 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ee44e-ce09-41d5-9123-3e6da05d64f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:49.040243 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ee44e-ce09-41d5-9123-3e6da05d64f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:49.040533 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ee44e-ce09-41d5-9123-3e6da05d64f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:49.040805 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ee44e-ce09-41d5-9123-3e6da05d64f1 admin admin] PATH_INFO: `/v3/projects/cfdda32417c8466bb74c29c2031a1003` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:49.042693 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ee44e-ce09-41d5-9123-3e6da05d64f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfdda32417c8466bb74c29c2031a1003)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:49.044657 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ee44e-ce09-41d5-9123-3e6da05d64f1 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:49.090071 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-de3ee44e-ce09-41d5-9123-3e6da05d64f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfdda32417c8466bb74c29c2031a1003', 'request_id': 'req-de3ee44e-ce09-41d5-9123-3e6da05d64f1'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:49.098603 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-de3ee44e-ce09-41d5-9123-3e6da05d64f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfdda32417c8466bb74c29c2031a1003', 'request_id': 'req-de3ee44e-ce09-41d5-9123-3e6da05d64f1'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:49.104023 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-de3ee44e-ce09-41d5-9123-3e6da05d64f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfdda32417c8466bb74c29c2031a1003', 'request_id': 'req-de3ee44e-ce09-41d5-9123-3e6da05d64f1'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:49.115178 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-de3ee44e-ce09-41d5-9123-3e6da05d64f1 admin admin] The token cache is being invalidate because project cfdda32417c8466bb74c29c2031a1003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:32:49.115465 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-de3ee44e-ce09-41d5-9123-3e6da05d64f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:49.116080 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-de3ee44e-ce09-41d5-9123-3e6da05d64f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:49.117653 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1154/2309] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:32:49 2021] DELETE /identity/v3/projects/cfdda32417c8466bb74c29c2031a1003 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:32:49.123574 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510be120-6e9d-4289-a72d-419262071f36 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:49.123862 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510be120-6e9d-4289-a72d-419262071f36 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:49.124145 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510be120-6e9d-4289-a72d-419262071f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:49.150979 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-510be120-6e9d-4289-a72d-419262071f36 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:32:49.152725 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-510be120-6e9d-4289-a72d-419262071f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:49.208953 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1156/2310] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:32:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:32:49.217811 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c270e6-1e90-43ea-ba89-b9d2c879c96e None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:49.218127 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c270e6-1e90-43ea-ba89-b9d2c879c96e None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:49.218403 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c270e6-1e90-43ea-ba89-b9d2c879c96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:49.236721 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-54c270e6-1e90-43ea-ba89-b9d2c879c96e None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:32:49.238235 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-54c270e6-1e90-43ea-ba89-b9d2c879c96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:49.246908 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1155/2311] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:32:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:32:49.251106 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510be120-6e9d-4289-a72d-419262071f36 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:49.260476 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510be120-6e9d-4289-a72d-419262071f36 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:49.265123 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78588859-f8b1-4395-9f4b-9a2efc418b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:49.265774 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78588859-f8b1-4395-9f4b-9a2efc418b17 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:49.266057 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78588859-f8b1-4395-9f4b-9a2efc418b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:49.266334 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78588859-f8b1-4395-9f4b-9a2efc418b17 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:49.267051 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78588859-f8b1-4395-9f4b-9a2efc418b17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:32:49.267357 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78588859-f8b1-4395-9f4b-9a2efc418b17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:49.268969 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78588859-f8b1-4395-9f4b-9a2efc418b17 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:49.281185 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1157/2312] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:32:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:32:49.285100 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c270e6-1e90-43ea-ba89-b9d2c879c96e None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:49.295257 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c270e6-1e90-43ea-ba89-b9d2c879c96e None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:49.300180 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996ea0c-e082-4e73-afb1-66aa9b4ef2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:49.300836 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996ea0c-e082-4e73-afb1-66aa9b4ef2c8 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:49.301156 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996ea0c-e082-4e73-afb1-66aa9b4ef2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:49.301434 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996ea0c-e082-4e73-afb1-66aa9b4ef2c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:49.302144 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996ea0c-e082-4e73-afb1-66aa9b4ef2c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:49.304054 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996ea0c-e082-4e73-afb1-66aa9b4ef2c8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:49.329129 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1156/2313] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:32:49 2021] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:32:49.333341 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78588859-f8b1-4395-9f4b-9a2efc418b17 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:49.343365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78588859-f8b1-4395-9f4b-9a2efc418b17 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:49.400432 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c816775-64d3-4055-8b22-cad8998f210a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:49.401128 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c816775-64d3-4055-8b22-cad8998f210a admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:49.402067 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c816775-64d3-4055-8b22-cad8998f210a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:49.402348 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c816775-64d3-4055-8b22-cad8998f210a admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:49.403044 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c816775-64d3-4055-8b22-cad8998f210a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:49.404987 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c816775-64d3-4055-8b22-cad8998f210a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:49.424114 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1158/2314] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:32:49 2021] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:32:49.428034 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996ea0c-e082-4e73-afb1-66aa9b4ef2c8 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:49.438086 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996ea0c-e082-4e73-afb1-66aa9b4ef2c8 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:49.442720 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f0b16-5268-4b85-86e4-75592ececf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:49.443372 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f0b16-5268-4b85-86e4-75592ececf88 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:49.443658 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f0b16-5268-4b85-86e4-75592ececf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:49.443934 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f0b16-5268-4b85-86e4-75592ececf88 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:49.444657 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f0b16-5268-4b85-86e4-75592ececf88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:49.446284 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f0b16-5268-4b85-86e4-75592ececf88 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:49.459365 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1157/2315] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:32:49 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:32:49.463424 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c816775-64d3-4055-8b22-cad8998f210a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:49.474540 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c816775-64d3-4055-8b22-cad8998f210a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:49.479319 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38893c-7a0b-412b-84e9-19cd5135d9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:49.479960 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38893c-7a0b-412b-84e9-19cd5135d9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:49.480246 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38893c-7a0b-412b-84e9-19cd5135d9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:49.480520 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38893c-7a0b-412b-84e9-19cd5135d9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:49.481276 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38893c-7a0b-412b-84e9-19cd5135d9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:49.482870 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38893c-7a0b-412b-84e9-19cd5135d9b0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:49.492633 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1159/2316] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:32:49 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:32:49.496668 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f0b16-5268-4b85-86e4-75592ececf88 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:49.506774 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f0b16-5268-4b85-86e4-75592ececf88 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:49.512092 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e97efd-c1e6-4abe-a243-6f8631aad4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:49.513028 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e97efd-c1e6-4abe-a243-6f8631aad4cc admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:49.513314 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e97efd-c1e6-4abe-a243-6f8631aad4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:49.513590 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e97efd-c1e6-4abe-a243-6f8631aad4cc admin admin] PATH_INFO: `/v3/projects/a35c6ea51c1248579444390caa4acf61/users/40f5a88e693848f58227c6147b995d34/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:49.528205 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e97efd-c1e6-4abe-a243-6f8631aad4cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a35c6ea51c1248579444390caa4acf61, user_id=40f5a88e693848f58227c6147b995d34, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:49.530849 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e97efd-c1e6-4abe-a243-6f8631aad4cc admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:49.556398 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1158/2317] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:32:49 2021] PUT /identity/v3/projects/a35c6ea51c1248579444390caa4acf61/users/40f5a88e693848f58227c6147b995d34/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:32:49.559575 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c6725-ac9f-4c0c-a5e2-d1e1e49f0ceb None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:49.559870 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c6725-ac9f-4c0c-a5e2-d1e1e49f0ceb None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:49.560146 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c6725-ac9f-4c0c-a5e2-d1e1e49f0ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:49.586127 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-e81c6725-ac9f-4c0c-a5e2-d1e1e49f0ceb None None] MFA Rules not processed for user `40f5a88e693848f58227c6147b995d34`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:32:49.587362 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-e81c6725-ac9f-4c0c-a5e2-d1e1e49f0ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:49.651770 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1160/2318] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:32:49 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:32:49.662006 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e97efd-c1e6-4abe-a243-6f8631aad4cc admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:49.663677 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-40e97efd-c1e6-4abe-a243-6f8631aad4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:49.739589 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e97efd-c1e6-4abe-a243-6f8631aad4cc admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:49.743300 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da41772-a320-4af0-a1dc-158169f420b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:49.743937 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da41772-a320-4af0-a1dc-158169f420b6 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:49.744218 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da41772-a320-4af0-a1dc-158169f420b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:49.744492 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da41772-a320-4af0-a1dc-158169f420b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:49.753315 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da41772-a320-4af0-a1dc-158169f420b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:49.754829 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da41772-a320-4af0-a1dc-158169f420b6 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:49.764541 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1159/2319] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:32:49 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:32:49.788163 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c6725-ac9f-4c0c-a5e2-d1e1e49f0ceb None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:49.848593 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c6725-ac9f-4c0c-a5e2-d1e1e49f0ceb None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:49.853159 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235fda6-9071-4e7e-855c-c253fa544755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:49.854015 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235fda6-9071-4e7e-855c-c253fa544755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:49.854294 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235fda6-9071-4e7e-855c-c253fa544755 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:49.854570 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235fda6-9071-4e7e-855c-c253fa544755 admin admin] PATH_INFO: `/v3/users/40f5a88e693848f58227c6147b995d34` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:49.855747 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235fda6-9071-4e7e-855c-c253fa544755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f5a88e693848f58227c6147b995d34)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:49.857682 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235fda6-9071-4e7e-855c-c253fa544755 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:49.905260 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d235fda6-9071-4e7e-855c-c253fa544755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f5a88e693848f58227c6147b995d34'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:49.917711 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d235fda6-9071-4e7e-855c-c253fa544755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f5a88e693848f58227c6147b995d34'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:49.918421 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d235fda6-9071-4e7e-855c-c253fa544755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f5a88e693848f58227c6147b995d34'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:49.926168 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d235fda6-9071-4e7e-855c-c253fa544755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f5a88e693848f58227c6147b995d34'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:49.933478 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d235fda6-9071-4e7e-855c-c253fa544755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f5a88e693848f58227c6147b995d34'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:49.939203 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1161/2320] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:32:49 2021] DELETE /identity/v3/users/40f5a88e693848f58227c6147b995d34 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:32:49.943659 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c5b68-cc3d-44c1-a246-0f13a4c869d6 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:49.943945 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c5b68-cc3d-44c1-a246-0f13a4c869d6 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:49.944222 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c5b68-cc3d-44c1-a246-0f13a4c869d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:49.962169 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-1a9c5b68-cc3d-44c1-a246-0f13a4c869d6 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:32:49.963561 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-1a9c5b68-cc3d-44c1-a246-0f13a4c869d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:50.022823 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1160/2321] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:32:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:32:50.032738 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235fda6-9071-4e7e-855c-c253fa544755 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:50.034142 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d235fda6-9071-4e7e-855c-c253fa544755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:50.089517 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235fda6-9071-4e7e-855c-c253fa544755 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:50.093472 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75dfb6-ff25-4b13-8874-2745042c2685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:50.094114 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75dfb6-ff25-4b13-8874-2745042c2685 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:50.094397 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75dfb6-ff25-4b13-8874-2745042c2685 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:50.094671 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75dfb6-ff25-4b13-8874-2745042c2685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:50.103333 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75dfb6-ff25-4b13-8874-2745042c2685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:50.105236 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75dfb6-ff25-4b13-8874-2745042c2685 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:50.114334 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1162/2322] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:32:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:32:50.391623 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c5b68-cc3d-44c1-a246-0f13a4c869d6 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:50.393048 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-1a9c5b68-cc3d-44c1-a246-0f13a4c869d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:50.405009 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c5b68-cc3d-44c1-a246-0f13a4c869d6 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:50.410060 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda17371-cd8e-4e25-a659-12884ec34209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:50.414480 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda17371-cd8e-4e25-a659-12884ec34209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:50.414480 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda17371-cd8e-4e25-a659-12884ec34209 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:50.414480 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda17371-cd8e-4e25-a659-12884ec34209 admin admin] PATH_INFO: `/v3/projects/a35c6ea51c1248579444390caa4acf61` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:50.416593 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda17371-cd8e-4e25-a659-12884ec34209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a35c6ea51c1248579444390caa4acf61)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:50.420536 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda17371-cd8e-4e25-a659-12884ec34209 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:50.463559 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-bda17371-cd8e-4e25-a659-12884ec34209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a35c6ea51c1248579444390caa4acf61', 'request_id': 'req-bda17371-cd8e-4e25-a659-12884ec34209'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:50.471150 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-bda17371-cd8e-4e25-a659-12884ec34209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a35c6ea51c1248579444390caa4acf61', 'request_id': 'req-bda17371-cd8e-4e25-a659-12884ec34209'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:50.476475 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-bda17371-cd8e-4e25-a659-12884ec34209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a35c6ea51c1248579444390caa4acf61', 'request_id': 'req-bda17371-cd8e-4e25-a659-12884ec34209'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:50.487833 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-bda17371-cd8e-4e25-a659-12884ec34209 admin admin] The token cache is being invalidate because project a35c6ea51c1248579444390caa4acf61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:32:50.488121 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-bda17371-cd8e-4e25-a659-12884ec34209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:50.488755 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-bda17371-cd8e-4e25-a659-12884ec34209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:32:50.490316 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1161/2323] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:32:50 2021] DELETE /identity/v3/projects/a35c6ea51c1248579444390caa4acf61 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:32:50.496101 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de27764-6721-497a-893e-d84f1aa4e513 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:50.496551 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de27764-6721-497a-893e-d84f1aa4e513 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:50.496652 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de27764-6721-497a-893e-d84f1aa4e513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:50.515134 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-5de27764-6721-497a-893e-d84f1aa4e513 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:32:50.516336 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-5de27764-6721-497a-893e-d84f1aa4e513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:50.574104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1163/2324] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:32:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:32:50.581929 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f08b53-a785-4e72-88db-db170ab0c8b8 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:50.582215 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f08b53-a785-4e72-88db-db170ab0c8b8 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:50.582492 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f08b53-a785-4e72-88db-db170ab0c8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:50.606153 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-81f08b53-a785-4e72-88db-db170ab0c8b8 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:32:50.607390 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-81f08b53-a785-4e72-88db-db170ab0c8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:50.615577 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1162/2325] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:32:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:32:50.619917 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de27764-6721-497a-893e-d84f1aa4e513 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:50.630122 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de27764-6721-497a-893e-d84f1aa4e513 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:50.634867 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5657e56-eb9f-49c8-8764-a2e4971b710c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:50.635459 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5657e56-eb9f-49c8-8764-a2e4971b710c admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:50.636383 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5657e56-eb9f-49c8-8764-a2e4971b710c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:50.636667 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5657e56-eb9f-49c8-8764-a2e4971b710c admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:50.637432 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5657e56-eb9f-49c8-8764-a2e4971b710c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:32:50.637744 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5657e56-eb9f-49c8-8764-a2e4971b710c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:50.639341 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5657e56-eb9f-49c8-8764-a2e4971b710c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:50.650436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1164/2326] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:32:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:32:50.654509 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f08b53-a785-4e72-88db-db170ab0c8b8 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:50.663643 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f08b53-a785-4e72-88db-db170ab0c8b8 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:50.668328 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2a8fd-44be-47af-8f39-8a6185a2c56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:50.669005 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2a8fd-44be-47af-8f39-8a6185a2c56b admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:50.669291 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2a8fd-44be-47af-8f39-8a6185a2c56b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:50.669566 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2a8fd-44be-47af-8f39-8a6185a2c56b admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:50.670236 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2a8fd-44be-47af-8f39-8a6185a2c56b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:50.672119 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2a8fd-44be-47af-8f39-8a6185a2c56b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:50.702210 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1163/2327] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:32:50 2021] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:32:50.703375 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5657e56-eb9f-49c8-8764-a2e4971b710c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:50.713363 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5657e56-eb9f-49c8-8764-a2e4971b710c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:50.767703 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c923b3f-ca9a-4754-8151-849ba665ec31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:50.768417 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c923b3f-ca9a-4754-8151-849ba665ec31 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:50.768701 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c923b3f-ca9a-4754-8151-849ba665ec31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:50.769005 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c923b3f-ca9a-4754-8151-849ba665ec31 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:50.769706 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c923b3f-ca9a-4754-8151-849ba665ec31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:50.771626 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c923b3f-ca9a-4754-8151-849ba665ec31 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:50.790786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1165/2328] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:32:50 2021] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:32:50.795497 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2a8fd-44be-47af-8f39-8a6185a2c56b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:50.806089 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2a8fd-44be-47af-8f39-8a6185a2c56b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:50.811349 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474674a3-2a4a-4ab8-abeb-18f5d7baff81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:50.812000 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474674a3-2a4a-4ab8-abeb-18f5d7baff81 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:50.812304 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474674a3-2a4a-4ab8-abeb-18f5d7baff81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:50.812580 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474674a3-2a4a-4ab8-abeb-18f5d7baff81 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:50.813339 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474674a3-2a4a-4ab8-abeb-18f5d7baff81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:50.814920 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474674a3-2a4a-4ab8-abeb-18f5d7baff81 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:50.825120 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1164/2329] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:32:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:32:50.829047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c923b3f-ca9a-4754-8151-849ba665ec31 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:50.838908 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c923b3f-ca9a-4754-8151-849ba665ec31 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:50.844048 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d0fff-a0bd-47b7-8360-28f106ee765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:50.844729 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d0fff-a0bd-47b7-8360-28f106ee765e admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:50.845051 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d0fff-a0bd-47b7-8360-28f106ee765e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:50.845334 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d0fff-a0bd-47b7-8360-28f106ee765e admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:50.846073 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d0fff-a0bd-47b7-8360-28f106ee765e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:50.847685 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d0fff-a0bd-47b7-8360-28f106ee765e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:50.858779 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1166/2330] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:32:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:32:50.862701 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474674a3-2a4a-4ab8-abeb-18f5d7baff81 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:50.873023 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474674a3-2a4a-4ab8-abeb-18f5d7baff81 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:50.877628 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af68b8a-80b1-4421-980b-454221a32099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:50.878489 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af68b8a-80b1-4421-980b-454221a32099 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:50.878767 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af68b8a-80b1-4421-980b-454221a32099 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:50.879037 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af68b8a-80b1-4421-980b-454221a32099 admin admin] PATH_INFO: `/v3/projects/b6b60c448c3c4a5aa84f68579f2d4c40/users/adc6287aa5b94df5bd6c411cc369eed4/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:50.892606 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af68b8a-80b1-4421-980b-454221a32099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b60c448c3c4a5aa84f68579f2d4c40, user_id=adc6287aa5b94df5bd6c411cc369eed4, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:50.895200 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af68b8a-80b1-4421-980b-454221a32099 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:50.907301 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1165/2331] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:32:50 2021] PUT /identity/v3/projects/b6b60c448c3c4a5aa84f68579f2d4c40/users/adc6287aa5b94df5bd6c411cc369eed4/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:32:50.919716 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5603fc7-8309-4c35-a39a-8bbf4e307ab9 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:50.920112 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5603fc7-8309-4c35-a39a-8bbf4e307ab9 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:50.920418 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5603fc7-8309-4c35-a39a-8bbf4e307ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:50.948626 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-c5603fc7-8309-4c35-a39a-8bbf4e307ab9 None None] MFA Rules not processed for user `adc6287aa5b94df5bd6c411cc369eed4`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:32:50.949839 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-c5603fc7-8309-4c35-a39a-8bbf4e307ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:51.013436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1167/2332] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:32:50 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:32:51.023458 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af68b8a-80b1-4421-980b-454221a32099 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:32:51.025248 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7af68b8a-80b1-4421-980b-454221a32099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:32:51.079231 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af68b8a-80b1-4421-980b-454221a32099 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:32:51.088437 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d04ba1-3e2a-4e74-ab42-d9acc1150af5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:32:51.089621 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d04ba1-3e2a-4e74-ab42-d9acc1150af5 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:32:51.089896 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d04ba1-3e2a-4e74-ab42-d9acc1150af5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:32:51.090163 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d04ba1-3e2a-4e74-ab42-d9acc1150af5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:32:51.099330 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d04ba1-3e2a-4e74-ab42-d9acc1150af5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:32:51.100742 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d04ba1-3e2a-4e74-ab42-d9acc1150af5 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:32:51.109902 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1166/2333] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:32:51 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:33:30.274449 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2927f50-6f4d-4567-a502-05128a63f188 None None] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:33:30.274911 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2927f50-6f4d-4567-a502-05128a63f188 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:33:30.275015 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2927f50-6f4d-4567-a502-05128a63f188 None None] PATH_INFO: `/` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:33:30.277311 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1168/2334] 10.222.0.32 () {54 vars in 960 bytes} [Wed Sep 15 02:33:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 02:33:30.282532 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a86481-7096-4955-9ab3-dc58d09bace8 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:33:30.283013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a86481-7096-4955-9ab3-dc58d09bace8 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:33:30.283110 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a86481-7096-4955-9ab3-dc58d09bace8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:33:30.338942 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-01a86481-7096-4955-9ab3-dc58d09bace8 None None] MFA Rules not processed for user `9312539f749645d38ed87a0a47e52aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:33:30.340524 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-01a86481-7096-4955-9ab3-dc58d09bace8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:33:30.408704 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1167/2335] 10.222.0.32 () {58 vars in 1058 bytes} [Wed Sep 15 02:33:30 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:33:30.416526 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2927f50-6f4d-4567-a502-05128a63f188 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:33:30.429449 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2927f50-6f4d-4567-a502-05128a63f188 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:33:30.434433 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafcdf9-7cac-4d03-a66f-2bf0f0394024 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:33:30.435074 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafcdf9-7cac-4d03-a66f-2bf0f0394024 service placement] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:33:30.435354 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafcdf9-7cac-4d03-a66f-2bf0f0394024 service placement] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:33:30.435625 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafcdf9-7cac-4d03-a66f-2bf0f0394024 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:33:30.437378 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-fcafcdf9-7cac-4d03-a66f-2bf0f0394024 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:33:30.452297 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafcdf9-7cac-4d03-a66f-2bf0f0394024 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:33:30.453927 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafcdf9-7cac-4d03-a66f-2bf0f0394024 service placement] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:33:30.465216 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1169/2336] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:33:30 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:34:27.402448 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a86481-7096-4955-9ab3-dc58d09bace8 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:34:27.403930 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-01a86481-7096-4955-9ab3-dc58d09bace8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:34:27.414938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a86481-7096-4955-9ab3-dc58d09bace8 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:34:27.419036 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353d6ba-2edb-4bf0-9355-19b357f0fa86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:34:27.419670 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353d6ba-2edb-4bf0-9355-19b357f0fa86 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:34:27.419953 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353d6ba-2edb-4bf0-9355-19b357f0fa86 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:34:27.420225 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353d6ba-2edb-4bf0-9355-19b357f0fa86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:34:27.422008 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-0353d6ba-2edb-4bf0-9355-19b357f0fa86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:34:27.480987 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353d6ba-2edb-4bf0-9355-19b357f0fa86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:34:27.482430 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353d6ba-2edb-4bf0-9355-19b357f0fa86 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:34:27.491562 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1168/2337] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:34:27 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:34:31.772042 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafcdf9-7cac-4d03-a66f-2bf0f0394024 service placement] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:34:31.773496 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-fcafcdf9-7cac-4d03-a66f-2bf0f0394024 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:34:31.868310 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafcdf9-7cac-4d03-a66f-2bf0f0394024 service placement] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:34:31.874334 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d8d53-f1dd-47f0-b24f-1831288ecd00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:34:31.874972 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d8d53-f1dd-47f0-b24f-1831288ecd00 service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:34:31.875251 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d8d53-f1dd-47f0-b24f-1831288ecd00 service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:34:31.875524 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d8d53-f1dd-47f0-b24f-1831288ecd00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:34:31.877271 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f21d8d53-f1dd-47f0-b24f-1831288ecd00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:34:31.935413 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d8d53-f1dd-47f0-b24f-1831288ecd00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:34:31.937021 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d8d53-f1dd-47f0-b24f-1831288ecd00 service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:34:31.945769 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1170/2338] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:34:31 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:35:21.052678 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353d6ba-2edb-4bf0-9355-19b357f0fa86 service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:35:21.061007 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353d6ba-2edb-4bf0-9355-19b357f0fa86 service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:35:21.064799 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba6aa1-2a37-4a37-8242-3bbe48c8c98b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:35:21.065479 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba6aa1-2a37-4a37-8242-3bbe48c8c98b service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:35:21.065759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba6aa1-2a37-4a37-8242-3bbe48c8c98b service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:35:21.066033 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba6aa1-2a37-4a37-8242-3bbe48c8c98b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:35:21.067737 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-60ba6aa1-2a37-4a37-8242-3bbe48c8c98b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:35:21.123198 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba6aa1-2a37-4a37-8242-3bbe48c8c98b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:35:21.124541 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba6aa1-2a37-4a37-8242-3bbe48c8c98b service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:35:21.133143 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1169/2339] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:35:21 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:35:34.682399 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d8d53-f1dd-47f0-b24f-1831288ecd00 service nova] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:35:34.683808 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f21d8d53-f1dd-47f0-b24f-1831288ecd00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:35:34.744329 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d8d53-f1dd-47f0-b24f-1831288ecd00 service nova] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:35:34.747887 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6ea76-34e7-4dcc-ad05-bf7e979e75be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:35:34.748541 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6ea76-34e7-4dcc-ad05-bf7e979e75be service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:35:34.748820 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6ea76-34e7-4dcc-ad05-bf7e979e75be service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:35:34.749120 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6ea76-34e7-4dcc-ad05-bf7e979e75be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:35:34.750826 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4dd6ea76-34e7-4dcc-ad05-bf7e979e75be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:35:34.760901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6ea76-34e7-4dcc-ad05-bf7e979e75be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:35:34.762327 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd6ea76-34e7-4dcc-ad05-bf7e979e75be service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:35:34.769847 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1171/2340] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:35:34 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:36:08.716609 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba6aa1-2a37-4a37-8242-3bbe48c8c98b service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:36:08.718090 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-60ba6aa1-2a37-4a37-8242-3bbe48c8c98b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:36:08.733851 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba6aa1-2a37-4a37-8242-3bbe48c8c98b service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:36:08.739197 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b309ee3-0cde-45e1-b714-bbe6fd14efd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:36:08.739828 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b309ee3-0cde-45e1-b714-bbe6fd14efd7 service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:36:08.740108 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b309ee3-0cde-45e1-b714-bbe6fd14efd7 service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:36:08.740377 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b309ee3-0cde-45e1-b714-bbe6fd14efd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:36:08.742050 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-0b309ee3-0cde-45e1-b714-bbe6fd14efd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:36:08.796503 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b309ee3-0cde-45e1-b714-bbe6fd14efd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:36:08.798234 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b309ee3-0cde-45e1-b714-bbe6fd14efd7 service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:36:08.807014 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1170/2341] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:36:08 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:37:35.412570 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6ea76-34e7-4dcc-ad05-bf7e979e75be service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:37:35.421874 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6ea76-34e7-4dcc-ad05-bf7e979e75be service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:37:35.425449 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06486b25-8a3a-4c04-91c5-1e430f18290a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:37:35.426105 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06486b25-8a3a-4c04-91c5-1e430f18290a service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:37:35.426387 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06486b25-8a3a-4c04-91c5-1e430f18290a service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:37:35.426662 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06486b25-8a3a-4c04-91c5-1e430f18290a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:37:35.428390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-06486b25-8a3a-4c04-91c5-1e430f18290a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:37:35.486825 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06486b25-8a3a-4c04-91c5-1e430f18290a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:37:35.488210 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06486b25-8a3a-4c04-91c5-1e430f18290a service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:37:35.497767 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1172/2342] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:37:35 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:37:51.498807 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b309ee3-0cde-45e1-b714-bbe6fd14efd7 service nova] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:37:51.508702 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b309ee3-0cde-45e1-b714-bbe6fd14efd7 service nova] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:37:51.512376 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfab345-b56d-4f40-9a9d-f2c4e48dbd7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:37:51.513045 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfab345-b56d-4f40-9a9d-f2c4e48dbd7a service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:37:51.513329 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfab345-b56d-4f40-9a9d-f2c4e48dbd7a service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:37:51.513602 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfab345-b56d-4f40-9a9d-f2c4e48dbd7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:37:51.521768 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfab345-b56d-4f40-9a9d-f2c4e48dbd7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:37:51.523172 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfab345-b56d-4f40-9a9d-f2c4e48dbd7a service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:37:51.532046 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1171/2343] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:37:51 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:38:36.241394 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06486b25-8a3a-4c04-91c5-1e430f18290a service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:38:36.242786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-06486b25-8a3a-4c04-91c5-1e430f18290a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:38:36.256708 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06486b25-8a3a-4c04-91c5-1e430f18290a service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:38:36.262037 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a2b96-a8d4-450c-9b14-c119d99d70c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:38:36.262683 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a2b96-a8d4-450c-9b14-c119d99d70c5 service placement] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:38:36.262963 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a2b96-a8d4-450c-9b14-c119d99d70c5 service placement] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:38:36.263266 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a2b96-a8d4-450c-9b14-c119d99d70c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:38:36.271796 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a2b96-a8d4-450c-9b14-c119d99d70c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:38:36.273413 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a2b96-a8d4-450c-9b14-c119d99d70c5 service placement] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:38:36.283295 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1173/2344] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:38:36 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:38:38.831572 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfab345-b56d-4f40-9a9d-f2c4e48dbd7a service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:38:38.841411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfab345-b56d-4f40-9a9d-f2c4e48dbd7a service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:38:38.845301 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b422ad0-99cb-41cd-bf22-203c0a4e099b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:38:38.845942 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b422ad0-99cb-41cd-bf22-203c0a4e099b service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:38:38.846218 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b422ad0-99cb-41cd-bf22-203c0a4e099b service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:38:38.846486 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b422ad0-99cb-41cd-bf22-203c0a4e099b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:38:38.848248 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-5b422ad0-99cb-41cd-bf22-203c0a4e099b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:38:38.907798 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b422ad0-99cb-41cd-bf22-203c0a4e099b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:38:38.909227 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b422ad0-99cb-41cd-bf22-203c0a4e099b service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:38:38.918412 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1172/2345] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:38:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:38:45.476890 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a2b96-a8d4-450c-9b14-c119d99d70c5 service placement] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:38:45.478331 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-770a2b96-a8d4-450c-9b14-c119d99d70c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:38:45.492612 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a2b96-a8d4-450c-9b14-c119d99d70c5 service placement] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:38:45.497191 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6892c-d710-4a17-b5f4-ce336ddd28d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:38:45.498038 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6892c-d710-4a17-b5f4-ce336ddd28d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:38:45.498316 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6892c-d710-4a17-b5f4-ce336ddd28d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:38:45.498586 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6892c-d710-4a17-b5f4-ce336ddd28d3 admin admin] PATH_INFO: `/v3/users/69c9827f7fd94918b597b7ce5b687400` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:38:45.499787 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6892c-d710-4a17-b5f4-ce336ddd28d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c9827f7fd94918b597b7ce5b687400)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:38:45.501741 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6892c-d710-4a17-b5f4-ce336ddd28d3 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:38:45.545348 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-13d6892c-d710-4a17-b5f4-ce336ddd28d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c9827f7fd94918b597b7ce5b687400'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:38:45.556948 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-13d6892c-d710-4a17-b5f4-ce336ddd28d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c9827f7fd94918b597b7ce5b687400'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:38:45.557628 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-13d6892c-d710-4a17-b5f4-ce336ddd28d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c9827f7fd94918b597b7ce5b687400'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:38:45.564224 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-13d6892c-d710-4a17-b5f4-ce336ddd28d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c9827f7fd94918b597b7ce5b687400'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:38:45.571298 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-13d6892c-d710-4a17-b5f4-ce336ddd28d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c9827f7fd94918b597b7ce5b687400'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:38:45.576987 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1174/2346] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:38:45 2021] DELETE /identity/v3/users/69c9827f7fd94918b597b7ce5b687400 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:38:45.746454 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b422ad0-99cb-41cd-bf22-203c0a4e099b service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:38:45.756472 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b422ad0-99cb-41cd-bf22-203c0a4e099b service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:38:45.809605 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe9ad3-f5da-4b31-9892-ad8ec497a902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:38:45.810456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe9ad3-f5da-4b31-9892-ad8ec497a902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:38:45.810732 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe9ad3-f5da-4b31-9892-ad8ec497a902 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:38:45.810999 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe9ad3-f5da-4b31-9892-ad8ec497a902 admin admin] PATH_INFO: `/v3/projects/1b4ef7dbeb754af3ac01621e1d530f99` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:38:45.812156 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe9ad3-f5da-4b31-9892-ad8ec497a902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b4ef7dbeb754af3ac01621e1d530f99)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:38:45.814061 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe9ad3-f5da-4b31-9892-ad8ec497a902 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:38:45.856336 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c8fe9ad3-f5da-4b31-9892-ad8ec497a902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b4ef7dbeb754af3ac01621e1d530f99', 'request_id': 'req-c8fe9ad3-f5da-4b31-9892-ad8ec497a902'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:38:45.863122 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c8fe9ad3-f5da-4b31-9892-ad8ec497a902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b4ef7dbeb754af3ac01621e1d530f99', 'request_id': 'req-c8fe9ad3-f5da-4b31-9892-ad8ec497a902'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:38:45.869119 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c8fe9ad3-f5da-4b31-9892-ad8ec497a902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b4ef7dbeb754af3ac01621e1d530f99', 'request_id': 'req-c8fe9ad3-f5da-4b31-9892-ad8ec497a902'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:38:45.879456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c8fe9ad3-f5da-4b31-9892-ad8ec497a902 admin admin] The token cache is being invalidate because project 1b4ef7dbeb754af3ac01621e1d530f99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:38:45.879743 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c8fe9ad3-f5da-4b31-9892-ad8ec497a902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:38:45.880362 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c8fe9ad3-f5da-4b31-9892-ad8ec497a902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:38:45.881888 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1173/2347] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:38:45 2021] DELETE /identity/v3/projects/1b4ef7dbeb754af3ac01621e1d530f99 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:38:45.885777 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6892c-d710-4a17-b5f4-ce336ddd28d3 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:38:45.887132 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-13d6892c-d710-4a17-b5f4-ce336ddd28d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:38:45.899615 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6892c-d710-4a17-b5f4-ce336ddd28d3 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:38:45.954888 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc941817-e325-4f96-8717-a5c0efa9d962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:38:45.955854 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc941817-e325-4f96-8717-a5c0efa9d962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:38:45.956135 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc941817-e325-4f96-8717-a5c0efa9d962 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:38:45.956407 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc941817-e325-4f96-8717-a5c0efa9d962 admin admin] PATH_INFO: `/v3/users/4725e00ac9d44219998882485f65aff8` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:38:45.957614 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc941817-e325-4f96-8717-a5c0efa9d962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4725e00ac9d44219998882485f65aff8)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:38:45.959586 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc941817-e325-4f96-8717-a5c0efa9d962 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:38:46.003500 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-bc941817-e325-4f96-8717-a5c0efa9d962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4725e00ac9d44219998882485f65aff8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:38:46.014351 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-bc941817-e325-4f96-8717-a5c0efa9d962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4725e00ac9d44219998882485f65aff8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:38:46.015000 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-bc941817-e325-4f96-8717-a5c0efa9d962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4725e00ac9d44219998882485f65aff8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:38:46.022100 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-bc941817-e325-4f96-8717-a5c0efa9d962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4725e00ac9d44219998882485f65aff8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:38:46.028498 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-bc941817-e325-4f96-8717-a5c0efa9d962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4725e00ac9d44219998882485f65aff8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:38:46.034257 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1175/2348] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:38:45 2021] DELETE /identity/v3/users/4725e00ac9d44219998882485f65aff8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:38:46.196002 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe9ad3-f5da-4b31-9892-ad8ec497a902 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:38:46.197538 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c8fe9ad3-f5da-4b31-9892-ad8ec497a902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:38:46.218774 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe9ad3-f5da-4b31-9892-ad8ec497a902 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:38:46.278196 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d28c9-42f2-45ce-9a35-74011b067679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:38:46.279047 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d28c9-42f2-45ce-9a35-74011b067679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:38:46.279320 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d28c9-42f2-45ce-9a35-74011b067679 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:38:46.279588 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d28c9-42f2-45ce-9a35-74011b067679 admin admin] PATH_INFO: `/v3/projects/42a939f0e5b14dd8b43d0176da894ad0` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:38:46.280753 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d28c9-42f2-45ce-9a35-74011b067679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42a939f0e5b14dd8b43d0176da894ad0)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:38:46.282659 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d28c9-42f2-45ce-9a35-74011b067679 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:38:46.326116 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8e5d28c9-42f2-45ce-9a35-74011b067679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42a939f0e5b14dd8b43d0176da894ad0', 'request_id': 'req-8e5d28c9-42f2-45ce-9a35-74011b067679'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:38:46.334054 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8e5d28c9-42f2-45ce-9a35-74011b067679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42a939f0e5b14dd8b43d0176da894ad0', 'request_id': 'req-8e5d28c9-42f2-45ce-9a35-74011b067679'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:38:46.339239 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8e5d28c9-42f2-45ce-9a35-74011b067679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42a939f0e5b14dd8b43d0176da894ad0', 'request_id': 'req-8e5d28c9-42f2-45ce-9a35-74011b067679'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:38:46.350126 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8e5d28c9-42f2-45ce-9a35-74011b067679 admin admin] The token cache is being invalidate because project 42a939f0e5b14dd8b43d0176da894ad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:38:46.350409 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8e5d28c9-42f2-45ce-9a35-74011b067679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:38:46.351047 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8e5d28c9-42f2-45ce-9a35-74011b067679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:38:46.352537 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1174/2349] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:38:46 2021] DELETE /identity/v3/projects/42a939f0e5b14dd8b43d0176da894ad0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:39:01.082385 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc941817-e325-4f96-8717-a5c0efa9d962 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:39:01.083767 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-bc941817-e325-4f96-8717-a5c0efa9d962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:39:01.137726 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc941817-e325-4f96-8717-a5c0efa9d962 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:39:01.181962 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606772fc-b53c-491f-a21b-0572126894d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:39:01.182545 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606772fc-b53c-491f-a21b-0572126894d4 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:39:01.182833 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606772fc-b53c-491f-a21b-0572126894d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:39:01.183113 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606772fc-b53c-491f-a21b-0572126894d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:39:01.184822 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-606772fc-b53c-491f-a21b-0572126894d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:39:01.251055 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606772fc-b53c-491f-a21b-0572126894d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:39:01.252480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606772fc-b53c-491f-a21b-0572126894d4 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:39:01.263660 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1176/2350] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:39:01 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:39:21.823453 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d28c9-42f2-45ce-9a35-74011b067679 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:39:21.824956 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8e5d28c9-42f2-45ce-9a35-74011b067679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:39:21.879435 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d28c9-42f2-45ce-9a35-74011b067679 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:39:21.882987 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1b225-b946-4c34-b87f-4c74608ec68e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:39:21.883625 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1b225-b946-4c34-b87f-4c74608ec68e service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:39:21.883905 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1b225-b946-4c34-b87f-4c74608ec68e service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:39:21.884179 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1b225-b946-4c34-b87f-4c74608ec68e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:39:21.885924 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-5af1b225-b946-4c34-b87f-4c74608ec68e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:39:21.898681 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1b225-b946-4c34-b87f-4c74608ec68e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:39:21.900091 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1b225-b946-4c34-b87f-4c74608ec68e service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:39:21.910769 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1175/2351] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:39:21 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:39:23.873010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606772fc-b53c-491f-a21b-0572126894d4 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:39:23.874456 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-606772fc-b53c-491f-a21b-0572126894d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:39:23.889801 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606772fc-b53c-491f-a21b-0572126894d4 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:39:23.897159 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36af6c-7cfa-4e68-b1e3-82ff65775131 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:39:23.897966 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36af6c-7cfa-4e68-b1e3-82ff65775131 service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:39:23.898454 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36af6c-7cfa-4e68-b1e3-82ff65775131 service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:39:23.898671 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36af6c-7cfa-4e68-b1e3-82ff65775131 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:39:23.901677 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-9c36af6c-7cfa-4e68-b1e3-82ff65775131 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:39:23.916011 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36af6c-7cfa-4e68-b1e3-82ff65775131 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:39:23.917772 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36af6c-7cfa-4e68-b1e3-82ff65775131 service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:39:23.929189 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1177/2352] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:39:23 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:39:27.608058 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2d199-0cbd-460c-8dc5-c7a6d4dd7e20 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:39:27.608550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2d199-0cbd-460c-8dc5-c7a6d4dd7e20 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:39:27.608692 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2d199-0cbd-460c-8dc5-c7a6d4dd7e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:39:27.655193 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-c2e2d199-0cbd-460c-8dc5-c7a6d4dd7e20 None None] MFA Rules not processed for user `1a349783f06c414db888ac4f02a6e878`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:39:27.656407 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c2e2d199-0cbd-460c-8dc5-c7a6d4dd7e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:39:27.718303 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1176/2353] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:39:27 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:39:27.729724 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36af6c-7cfa-4e68-b1e3-82ff65775131 service nova] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:39:27.731097 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-9c36af6c-7cfa-4e68-b1e3-82ff65775131 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:39:27.744681 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36af6c-7cfa-4e68-b1e3-82ff65775131 service nova] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:39:27.750102 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e69c4-a3c8-4993-8e4f-5f38e6d71eb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:39:27.750754 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e69c4-a3c8-4993-8e4f-5f38e6d71eb5 service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:39:27.751204 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e69c4-a3c8-4993-8e4f-5f38e6d71eb5 service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:39:27.751478 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e69c4-a3c8-4993-8e4f-5f38e6d71eb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:39:27.753294 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-038e69c4-a3c8-4993-8e4f-5f38e6d71eb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:39:27.763648 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e69c4-a3c8-4993-8e4f-5f38e6d71eb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:39:27.765317 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e69c4-a3c8-4993-8e4f-5f38e6d71eb5 service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:39:27.779480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1178/2354] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:39:27 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:39:28.072036 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2d199-0cbd-460c-8dc5-c7a6d4dd7e20 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:39:28.073465 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c2e2d199-0cbd-460c-8dc5-c7a6d4dd7e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:39:28.085357 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2d199-0cbd-460c-8dc5-c7a6d4dd7e20 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:39:28.088951 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94139c-7564-4246-987f-c35a83dc6f94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:39:28.089585 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94139c-7564-4246-987f-c35a83dc6f94 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:39:28.089865 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94139c-7564-4246-987f-c35a83dc6f94 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:39:28.090137 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94139c-7564-4246-987f-c35a83dc6f94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:39:28.091804 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-db94139c-7564-4246-987f-c35a83dc6f94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:39:28.100616 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94139c-7564-4246-987f-c35a83dc6f94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:39:28.102059 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94139c-7564-4246-987f-c35a83dc6f94 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:39:28.109694 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1177/2355] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:39:28 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:39:28.407888 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e69c4-a3c8-4993-8e4f-5f38e6d71eb5 service nova] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:39:28.409428 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-038e69c4-a3c8-4993-8e4f-5f38e6d71eb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:39:28.486031 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e69c4-a3c8-4993-8e4f-5f38e6d71eb5 service nova] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:39:28.492330 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e1b1d-89bc-48cd-a965-1bbe46d51580 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:39:28.493010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e1b1d-89bc-48cd-a965-1bbe46d51580 service placement] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:39:28.493286 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e1b1d-89bc-48cd-a965-1bbe46d51580 service placement] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:39:28.493624 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e1b1d-89bc-48cd-a965-1bbe46d51580 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:39:28.495440 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ac2e1b1d-89bc-48cd-a965-1bbe46d51580 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:39:28.507108 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e1b1d-89bc-48cd-a965-1bbe46d51580 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:39:28.508673 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e1b1d-89bc-48cd-a965-1bbe46d51580 service placement] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:39:28.518230 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1179/2356] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:39:28 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:39:31.850998 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94139c-7564-4246-987f-c35a83dc6f94 service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:39:31.863980 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94139c-7564-4246-987f-c35a83dc6f94 service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:39:31.869707 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5e7f5-bb47-4d06-a591-5cdaea05e3ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:39:31.870366 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5e7f5-bb47-4d06-a591-5cdaea05e3ac service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:39:31.870645 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5e7f5-bb47-4d06-a591-5cdaea05e3ac service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:39:31.870923 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5e7f5-bb47-4d06-a591-5cdaea05e3ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:39:31.872680 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-92c5e7f5-bb47-4d06-a591-5cdaea05e3ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:39:31.950997 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5e7f5-bb47-4d06-a591-5cdaea05e3ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:39:31.952579 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5e7f5-bb47-4d06-a591-5cdaea05e3ac service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:39:31.972528 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1178/2357] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:39:31 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:39:38.725059 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e1b1d-89bc-48cd-a965-1bbe46d51580 service placement] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:39:38.739141 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e1b1d-89bc-48cd-a965-1bbe46d51580 service placement] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:39:38.745234 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521d64c-aa72-4af3-a729-8d901d63e1cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:39:38.745880 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521d64c-aa72-4af3-a729-8d901d63e1cd service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:39:38.746164 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521d64c-aa72-4af3-a729-8d901d63e1cd service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:39:38.746439 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521d64c-aa72-4af3-a729-8d901d63e1cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:39:38.748203 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-e521d64c-aa72-4af3-a729-8d901d63e1cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:39:38.760741 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521d64c-aa72-4af3-a729-8d901d63e1cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:39:38.762339 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521d64c-aa72-4af3-a729-8d901d63e1cd service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:39:38.772856 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1180/2358] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:39:38 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:40:21.617562 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5e7f5-bb47-4d06-a591-5cdaea05e3ac service nova] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:40:21.618972 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-92c5e7f5-bb47-4d06-a591-5cdaea05e3ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:40:21.630379 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5e7f5-bb47-4d06-a591-5cdaea05e3ac service nova] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:40:21.633991 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8a61f-e285-44e1-9b56-9c2f9e77f70f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:40:21.634626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8a61f-e285-44e1-9b56-9c2f9e77f70f service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:40:21.634909 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8a61f-e285-44e1-9b56-9c2f9e77f70f service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:40:21.635187 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8a61f-e285-44e1-9b56-9c2f9e77f70f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:40:21.636872 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-d1e8a61f-e285-44e1-9b56-9c2f9e77f70f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:40:21.712386 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8a61f-e285-44e1-9b56-9c2f9e77f70f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:40:21.713759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8a61f-e285-44e1-9b56-9c2f9e77f70f service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:40:21.732640 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1179/2359] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:40:21 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:40:36.932854 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521d64c-aa72-4af3-a729-8d901d63e1cd service nova] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:40:36.941786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521d64c-aa72-4af3-a729-8d901d63e1cd service nova] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:40:36.945823 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52896d0-8269-484a-a513-30c350aa506e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:40:36.946453 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52896d0-8269-484a-a513-30c350aa506e service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:40:36.946735 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52896d0-8269-484a-a513-30c350aa506e service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:40:36.947008 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52896d0-8269-484a-a513-30c350aa506e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:40:36.948736 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d52896d0-8269-484a-a513-30c350aa506e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:40:36.958551 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52896d0-8269-484a-a513-30c350aa506e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:40:36.959968 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52896d0-8269-484a-a513-30c350aa506e service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:40:36.967614 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1181/2360] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:40:36 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:41:08.617455 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8a61f-e285-44e1-9b56-9c2f9e77f70f service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:41:08.618923 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-d1e8a61f-e285-44e1-9b56-9c2f9e77f70f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:41:08.629952 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8a61f-e285-44e1-9b56-9c2f9e77f70f service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:41:08.633649 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47512822-75a2-4774-a415-4d3154c8cb18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:41:08.634279 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47512822-75a2-4774-a415-4d3154c8cb18 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:41:08.634554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47512822-75a2-4774-a415-4d3154c8cb18 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:41:08.634824 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47512822-75a2-4774-a415-4d3154c8cb18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:41:08.636480 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-47512822-75a2-4774-a415-4d3154c8cb18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:41:08.710976 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47512822-75a2-4774-a415-4d3154c8cb18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:41:08.712392 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47512822-75a2-4774-a415-4d3154c8cb18 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:41:08.730173 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1180/2361] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:41:08 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:42:51.675256 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52896d0-8269-484a-a513-30c350aa506e service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:42:51.712553 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52896d0-8269-484a-a513-30c350aa506e service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:42:51.716263 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ebe3b-906a-4b33-89e0-3deb04cb7369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:42:51.716939 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ebe3b-906a-4b33-89e0-3deb04cb7369 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:42:51.717227 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ebe3b-906a-4b33-89e0-3deb04cb7369 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:42:51.717505 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ebe3b-906a-4b33-89e0-3deb04cb7369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:42:51.719327 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-566ebe3b-906a-4b33-89e0-3deb04cb7369 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:42:51.815502 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ebe3b-906a-4b33-89e0-3deb04cb7369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:42:51.817086 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ebe3b-906a-4b33-89e0-3deb04cb7369 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:42:51.836495 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1182/2362] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:42:51 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:43:40.183664 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47512822-75a2-4774-a415-4d3154c8cb18 service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:43:40.234814 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47512822-75a2-4774-a415-4d3154c8cb18 service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:43:40.240037 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d3765-f391-4c5b-991a-c6e355926d8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:43:40.240724 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d3765-f391-4c5b-991a-c6e355926d8b service placement] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:43:40.241035 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d3765-f391-4c5b-991a-c6e355926d8b service placement] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:43:40.241308 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d3765-f391-4c5b-991a-c6e355926d8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:43:40.243119 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-666d3765-f391-4c5b-991a-c6e355926d8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:43:40.266371 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d3765-f391-4c5b-991a-c6e355926d8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:43:40.267860 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d3765-f391-4c5b-991a-c6e355926d8b service placement] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:43:40.277841 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1181/2363] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:43:40 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:44:27.348209 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ebe3b-906a-4b33-89e0-3deb04cb7369 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:44:27.356503 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ebe3b-906a-4b33-89e0-3deb04cb7369 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:44:27.360583 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1457d57-cfe4-4885-977f-8241a230e69b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:44:27.361246 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1457d57-cfe4-4885-977f-8241a230e69b service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:44:27.361525 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1457d57-cfe4-4885-977f-8241a230e69b service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:44:27.361797 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1457d57-cfe4-4885-977f-8241a230e69b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:44:27.369932 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1457d57-cfe4-4885-977f-8241a230e69b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:44:27.371339 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1457d57-cfe4-4885-977f-8241a230e69b service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:44:27.380609 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1183/2364] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:44:27 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:44:31.333776 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d3765-f391-4c5b-991a-c6e355926d8b service placement] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:44:31.342800 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d3765-f391-4c5b-991a-c6e355926d8b service placement] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:44:31.346385 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f545a12-3c35-4f90-bc4e-5c9536048ab7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:44:31.347012 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f545a12-3c35-4f90-bc4e-5c9536048ab7 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:44:31.347290 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f545a12-3c35-4f90-bc4e-5c9536048ab7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:44:31.347590 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f545a12-3c35-4f90-bc4e-5c9536048ab7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:44:31.355647 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f545a12-3c35-4f90-bc4e-5c9536048ab7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:44:31.357071 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f545a12-3c35-4f90-bc4e-5c9536048ab7 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:44:31.365655 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1182/2365] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:44:31 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:44:45.090460 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b4364-c113-4f32-954b-7ed593fcc32d None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:44:45.091054 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b4364-c113-4f32-954b-7ed593fcc32d None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:44:45.091054 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b4364-c113-4f32-954b-7ed593fcc32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:44:45.116570 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-f51b4364-c113-4f32-954b-7ed593fcc32d None None] MFA Rules not processed for user `6d88e560bc7f48019d584bd7c88d73ab`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:44:45.117813 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f51b4364-c113-4f32-954b-7ed593fcc32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:44:45.125238 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1184/2366] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:44:45 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:44:45.163123 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f545a12-3c35-4f90-bc4e-5c9536048ab7 service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:44:45.164553 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-5f545a12-3c35-4f90-bc4e-5c9536048ab7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:44:45.238395 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f545a12-3c35-4f90-bc4e-5c9536048ab7 service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:44:45.242042 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d24f38-81a4-40dc-8016-e15bede2765d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d661d14d94fa597aee037599de7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:44:45.242763 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d24f38-81a4-40dc-8016-e15bede2765d service glance] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:44:45.243046 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d24f38-81a4-40dc-8016-e15bede2765d service glance] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:44:45.243314 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d24f38-81a4-40dc-8016-e15bede2765d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:44:45.260862 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d24f38-81a4-40dc-8016-e15bede2765d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:44:45.262309 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d24f38-81a4-40dc-8016-e15bede2765d service glance] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:44:45.292297 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1183/2367] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:44:45 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:44:45.505334 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b4364-c113-4f32-954b-7ed593fcc32d None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:44:45.524819 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b4364-c113-4f32-954b-7ed593fcc32d None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:44:45.528524 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb8571-551e-4a2f-9516-141a48b3a6e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:44:45.529209 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb8571-551e-4a2f-9516-141a48b3a6e7 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:44:45.530075 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb8571-551e-4a2f-9516-141a48b3a6e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:44:45.530357 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb8571-551e-4a2f-9516-141a48b3a6e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:44:45.537516 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb8571-551e-4a2f-9516-141a48b3a6e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:44:45.538945 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb8571-551e-4a2f-9516-141a48b3a6e7 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:44:45.546707 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1185/2368] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:44:45 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:44:45.856145 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d24f38-81a4-40dc-8016-e15bede2765d service glance] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:44:45.864112 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb8571-551e-4a2f-9516-141a48b3a6e7 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:44:45.868699 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d24f38-81a4-40dc-8016-e15bede2765d service glance] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:44:45.872508 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb8571-551e-4a2f-9516-141a48b3a6e7 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:44:45.874086 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac03002-8858-44c5-9f09-a8bc6c248fe7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:44:45.874734 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac03002-8858-44c5-9f09-a8bc6c248fe7 service placement] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:44:45.875018 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac03002-8858-44c5-9f09-a8bc6c248fe7 service placement] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:44:45.875295 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac03002-8858-44c5-9f09-a8bc6c248fe7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:44:45.876276 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9ba5c-5866-45f9-b61a-9625aead0b0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:44:45.876930 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9ba5c-5866-45f9-b61a-9625aead0b0d service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:44:45.877250 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9ba5c-5866-45f9-b61a-9625aead0b0d service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:44:45.877527 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9ba5c-5866-45f9-b61a-9625aead0b0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:44:45.884233 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac03002-8858-44c5-9f09-a8bc6c248fe7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:44:45.885752 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac03002-8858-44c5-9f09-a8bc6c248fe7 service placement] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:44:45.887498 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9ba5c-5866-45f9-b61a-9625aead0b0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:44:45.888972 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9ba5c-5866-45f9-b61a-9625aead0b0d service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:44:45.895585 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1184/2369] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:44:45 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:44:45.899852 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1186/2370] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:44:45 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:44:48.305086 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac03002-8858-44c5-9f09-a8bc6c248fe7 service placement] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:44:48.320323 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac03002-8858-44c5-9f09-a8bc6c248fe7 service placement] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:44:48.336944 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538c989-165f-4794-84ab-f70a9220c090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:44:48.337706 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538c989-165f-4794-84ab-f70a9220c090 service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:44:48.338243 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538c989-165f-4794-84ab-f70a9220c090 service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:44:48.338590 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538c989-165f-4794-84ab-f70a9220c090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:44:48.348249 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538c989-165f-4794-84ab-f70a9220c090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:44:48.349956 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538c989-165f-4794-84ab-f70a9220c090 service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:44:48.363822 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1185/2371] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:44:48 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:44:54.481766 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9ba5c-5866-45f9-b61a-9625aead0b0d service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:44:54.494472 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9ba5c-5866-45f9-b61a-9625aead0b0d service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:44:54.500709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6cba2-1436-4ac3-b2a3-e0fff3970bb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:44:54.501394 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6cba2-1436-4ac3-b2a3-e0fff3970bb8 service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:44:54.501673 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6cba2-1436-4ac3-b2a3-e0fff3970bb8 service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:44:54.501949 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6cba2-1436-4ac3-b2a3-e0fff3970bb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:44:54.510824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6cba2-1436-4ac3-b2a3-e0fff3970bb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:44:54.512426 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6cba2-1436-4ac3-b2a3-e0fff3970bb8 service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:44:54.522617 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1187/2372] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:44:54 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:45:21.523913 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538c989-165f-4794-84ab-f70a9220c090 service nova] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:45:21.534829 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538c989-165f-4794-84ab-f70a9220c090 service nova] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:45:21.540314 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d39ed3-9ba3-48f7-bd89-a56244539492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:45:21.540972 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d39ed3-9ba3-48f7-bd89-a56244539492 service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:45:21.541254 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d39ed3-9ba3-48f7-bd89-a56244539492 service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:45:21.541528 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d39ed3-9ba3-48f7-bd89-a56244539492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:45:21.549760 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d39ed3-9ba3-48f7-bd89-a56244539492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:45:21.551363 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d39ed3-9ba3-48f7-bd89-a56244539492 service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:45:21.560119 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1186/2373] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:45:21 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:45:42.898488 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6cba2-1436-4ac3-b2a3-e0fff3970bb8 service nova] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:45:42.907589 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6cba2-1436-4ac3-b2a3-e0fff3970bb8 service nova] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:45:42.911269 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1ddae-1d2e-4cab-83e3-905c7618bc79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:45:42.911903 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1ddae-1d2e-4cab-83e3-905c7618bc79 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:45:42.912180 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1ddae-1d2e-4cab-83e3-905c7618bc79 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:45:42.912544 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1ddae-1d2e-4cab-83e3-905c7618bc79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:45:42.919589 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1ddae-1d2e-4cab-83e3-905c7618bc79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:45:42.921521 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1ddae-1d2e-4cab-83e3-905c7618bc79 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:45:42.929244 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1188/2374] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:45:42 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:46:09.148738 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d39ed3-9ba3-48f7-bd89-a56244539492 service nova] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:46:09.157733 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d39ed3-9ba3-48f7-bd89-a56244539492 service nova] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:46:09.161265 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577fb80-e056-4b0a-ae96-39b8c8d73a37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:46:09.161890 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577fb80-e056-4b0a-ae96-39b8c8d73a37 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:46:09.162166 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577fb80-e056-4b0a-ae96-39b8c8d73a37 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:46:09.162441 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577fb80-e056-4b0a-ae96-39b8c8d73a37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:46:09.170347 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577fb80-e056-4b0a-ae96-39b8c8d73a37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:46:09.172250 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577fb80-e056-4b0a-ae96-39b8c8d73a37 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:46:09.180751 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1187/2375] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:46:09 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:47:51.636939 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1ddae-1d2e-4cab-83e3-905c7618bc79 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:47:51.646152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1ddae-1d2e-4cab-83e3-905c7618bc79 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:47:51.649774 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed2827-77b4-413d-8c3f-32fde4af2d99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:47:51.650410 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed2827-77b4-413d-8c3f-32fde4af2d99 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:47:51.650692 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed2827-77b4-413d-8c3f-32fde4af2d99 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:47:51.650966 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed2827-77b4-413d-8c3f-32fde4af2d99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:47:51.659494 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed2827-77b4-413d-8c3f-32fde4af2d99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:47:51.660936 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed2827-77b4-413d-8c3f-32fde4af2d99 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:47:51.669466 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1189/2376] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:47:51 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:48:46.231952 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577fb80-e056-4b0a-ae96-39b8c8d73a37 service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:48:46.233346 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-1577fb80-e056-4b0a-ae96-39b8c8d73a37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:48:46.247151 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577fb80-e056-4b0a-ae96-39b8c8d73a37 service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:48:46.252100 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea49ca7-caab-462a-a0a4-4dbbed20acba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:48:46.252727 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea49ca7-caab-462a-a0a4-4dbbed20acba service placement] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:48:46.253041 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea49ca7-caab-462a-a0a4-4dbbed20acba service placement] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:48:46.253809 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea49ca7-caab-462a-a0a4-4dbbed20acba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:48:46.262239 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea49ca7-caab-462a-a0a4-4dbbed20acba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:48:46.263791 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea49ca7-caab-462a-a0a4-4dbbed20acba service placement] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:48:46.273856 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1188/2377] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:48:46 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:49:28.449317 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed2827-77b4-413d-8c3f-32fde4af2d99 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:49:28.500020 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed2827-77b4-413d-8c3f-32fde4af2d99 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:49:28.503734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd8291-e4a0-4207-a403-8dbec390be00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:49:28.504372 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd8291-e4a0-4207-a403-8dbec390be00 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:49:28.504656 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd8291-e4a0-4207-a403-8dbec390be00 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:49:28.504964 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd8291-e4a0-4207-a403-8dbec390be00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:49:28.506811 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-fecd8291-e4a0-4207-a403-8dbec390be00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:49:28.580945 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd8291-e4a0-4207-a403-8dbec390be00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:49:28.582424 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd8291-e4a0-4207-a403-8dbec390be00 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:49:28.599742 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1190/2378] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:49:28 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:49:32.290834 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea49ca7-caab-462a-a0a4-4dbbed20acba service placement] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:49:32.299974 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea49ca7-caab-462a-a0a4-4dbbed20acba service placement] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:49:32.303581 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff46c37-7c07-423d-b8b8-68854b666a99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:49:32.304212 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff46c37-7c07-423d-b8b8-68854b666a99 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:49:32.304490 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff46c37-7c07-423d-b8b8-68854b666a99 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:49:32.304762 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff46c37-7c07-423d-b8b8-68854b666a99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:49:32.306650 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-bff46c37-7c07-423d-b8b8-68854b666a99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:49:32.381613 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff46c37-7c07-423d-b8b8-68854b666a99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:49:32.383032 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff46c37-7c07-423d-b8b8-68854b666a99 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:49:32.400801 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1189/2379] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:49:32 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:50:22.557185 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd8291-e4a0-4207-a403-8dbec390be00 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:50:22.558763 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-fecd8291-e4a0-4207-a403-8dbec390be00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:50:22.581516 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd8291-e4a0-4207-a403-8dbec390be00 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:50:22.585179 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf5646-03c0-4e4c-8e94-662fa4c77dff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:50:22.585812 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf5646-03c0-4e4c-8e94-662fa4c77dff service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:50:22.586092 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf5646-03c0-4e4c-8e94-662fa4c77dff service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:50:22.586366 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf5646-03c0-4e4c-8e94-662fa4c77dff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:50:22.588153 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-7daf5646-03c0-4e4c-8e94-662fa4c77dff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:50:22.663732 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf5646-03c0-4e4c-8e94-662fa4c77dff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:50:22.665251 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf5646-03c0-4e4c-8e94-662fa4c77dff service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:50:22.683289 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1191/2380] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:50:22 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:50:49.575128 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff46c37-7c07-423d-b8b8-68854b666a99 service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:50:49.576693 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-bff46c37-7c07-423d-b8b8-68854b666a99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:50:49.643616 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff46c37-7c07-423d-b8b8-68854b666a99 service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:50:49.647116 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c594145-9675-44e9-b762-e37c3d664d58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:50:49.647762 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c594145-9675-44e9-b762-e37c3d664d58 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:50:49.648044 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c594145-9675-44e9-b762-e37c3d664d58 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:50:49.648321 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c594145-9675-44e9-b762-e37c3d664d58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:50:49.650192 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-6c594145-9675-44e9-b762-e37c3d664d58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:50:49.659819 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c594145-9675-44e9-b762-e37c3d664d58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:50:49.661280 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c594145-9675-44e9-b762-e37c3d664d58 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:50:49.668976 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1190/2381] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:50:49 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:50:56.952168 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2608f0f-5abe-4cdd-aca1-0f3f5b774b97 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:50:56.952751 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2608f0f-5abe-4cdd-aca1-0f3f5b774b97 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:50:56.952751 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2608f0f-5abe-4cdd-aca1-0f3f5b774b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:50:56.971002 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-d2608f0f-5abe-4cdd-aca1-0f3f5b774b97 None None] MFA Rules not processed for user `6d88e560bc7f48019d584bd7c88d73ab`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:50:56.972230 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d2608f0f-5abe-4cdd-aca1-0f3f5b774b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:50:56.980844 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1192/2382] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:50:56 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:50:57.017505 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c594145-9675-44e9-b762-e37c3d664d58 service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:50:57.026669 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c594145-9675-44e9-b762-e37c3d664d58 service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:50:57.030213 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a445c-d86e-4d6f-b0db-0a4aaf587f4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d661d14d94fa597aee037599de7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:50:57.030843 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a445c-d86e-4d6f-b0db-0a4aaf587f4f service glance] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:50:57.031122 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a445c-d86e-4d6f-b0db-0a4aaf587f4f service glance] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:50:57.031425 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a445c-d86e-4d6f-b0db-0a4aaf587f4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:50:57.033896 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8f5a445c-d86e-4d6f-b0db-0a4aaf587f4f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:50:57.114469 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a445c-d86e-4d6f-b0db-0a4aaf587f4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:50:57.115888 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a445c-d86e-4d6f-b0db-0a4aaf587f4f service glance] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:50:57.127166 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1191/2383] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:50:57 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:50:57.343833 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2608f0f-5abe-4cdd-aca1-0f3f5b774b97 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:50:57.353654 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2608f0f-5abe-4cdd-aca1-0f3f5b774b97 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:50:57.357226 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28c1ac-471e-4103-860c-b6e4f9f6595f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:50:57.357858 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28c1ac-471e-4103-860c-b6e4f9f6595f service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:50:57.358141 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28c1ac-471e-4103-860c-b6e4f9f6595f service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:50:57.358416 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28c1ac-471e-4103-860c-b6e4f9f6595f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:50:57.360261 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ca28c1ac-471e-4103-860c-b6e4f9f6595f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:50:57.370576 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28c1ac-471e-4103-860c-b6e4f9f6595f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:50:57.372040 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28c1ac-471e-4103-860c-b6e4f9f6595f service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:50:57.379913 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1193/2384] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:50:57 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:50:58.699025 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a445c-d86e-4d6f-b0db-0a4aaf587f4f service glance] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:50:58.700858 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8f5a445c-d86e-4d6f-b0db-0a4aaf587f4f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:50:58.707580 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28c1ac-471e-4103-860c-b6e4f9f6595f service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:50:58.709270 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ca28c1ac-471e-4103-860c-b6e4f9f6595f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:50:58.719100 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28c1ac-471e-4103-860c-b6e4f9f6595f service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:50:58.723186 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798ddb6-ee47-4bce-8b2b-9bce035c3792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:50:58.723818 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798ddb6-ee47-4bce-8b2b-9bce035c3792 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:50:58.724099 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798ddb6-ee47-4bce-8b2b-9bce035c3792 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:50:58.724372 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798ddb6-ee47-4bce-8b2b-9bce035c3792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:50:58.726188 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b798ddb6-ee47-4bce-8b2b-9bce035c3792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:50:58.739517 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798ddb6-ee47-4bce-8b2b-9bce035c3792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:50:58.740869 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798ddb6-ee47-4bce-8b2b-9bce035c3792 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:50:58.751547 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1194/2385] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:50:58 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:50:58.767406 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a445c-d86e-4d6f-b0db-0a4aaf587f4f service glance] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:50:58.772423 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71282b6-8559-46cd-9776-5e1ce8c70994 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:50:58.773115 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71282b6-8559-46cd-9776-5e1ce8c70994 service placement] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:50:58.773402 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71282b6-8559-46cd-9776-5e1ce8c70994 service placement] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:50:58.773678 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71282b6-8559-46cd-9776-5e1ce8c70994 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:50:58.775544 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-f71282b6-8559-46cd-9776-5e1ce8c70994 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:50:58.788090 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71282b6-8559-46cd-9776-5e1ce8c70994 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:50:58.789701 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71282b6-8559-46cd-9776-5e1ce8c70994 service placement] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:50:58.800979 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1192/2386] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:50:58 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:51:01.005881 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798ddb6-ee47-4bce-8b2b-9bce035c3792 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:51:01.007446 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b798ddb6-ee47-4bce-8b2b-9bce035c3792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:51:01.025278 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798ddb6-ee47-4bce-8b2b-9bce035c3792 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:51:01.047215 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15538b18-2fec-42d5-8572-80bec1dff344 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:51:01.047884 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15538b18-2fec-42d5-8572-80bec1dff344 service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:51:01.048762 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15538b18-2fec-42d5-8572-80bec1dff344 service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:51:01.049080 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15538b18-2fec-42d5-8572-80bec1dff344 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:51:01.050994 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-15538b18-2fec-42d5-8572-80bec1dff344 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:51:01.066092 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15538b18-2fec-42d5-8572-80bec1dff344 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:51:01.066092 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15538b18-2fec-42d5-8572-80bec1dff344 service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:51:01.076373 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1195/2387] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:51:01 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:51:04.924168 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71282b6-8559-46cd-9776-5e1ce8c70994 service placement] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:51:04.925583 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-f71282b6-8559-46cd-9776-5e1ce8c70994 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:51:05.017550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71282b6-8559-46cd-9776-5e1ce8c70994 service placement] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:51:05.022103 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707d2a2-2f9a-493a-9004-f8289b19d8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:51:05.022953 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707d2a2-2f9a-493a-9004-f8289b19d8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:51:05.023234 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707d2a2-2f9a-493a-9004-f8289b19d8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:51:05.023506 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707d2a2-2f9a-493a-9004-f8289b19d8c3 admin admin] PATH_INFO: `/v3/users/adc6287aa5b94df5bd6c411cc369eed4` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:51:05.024812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707d2a2-2f9a-493a-9004-f8289b19d8c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adc6287aa5b94df5bd6c411cc369eed4)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:51:05.026843 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707d2a2-2f9a-493a-9004-f8289b19d8c3 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:51:05.080934 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9707d2a2-2f9a-493a-9004-f8289b19d8c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adc6287aa5b94df5bd6c411cc369eed4'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:51:05.081682 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9707d2a2-2f9a-493a-9004-f8289b19d8c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adc6287aa5b94df5bd6c411cc369eed4'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:51:05.089016 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9707d2a2-2f9a-493a-9004-f8289b19d8c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adc6287aa5b94df5bd6c411cc369eed4'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:51:05.089717 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9707d2a2-2f9a-493a-9004-f8289b19d8c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adc6287aa5b94df5bd6c411cc369eed4'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:51:05.101853 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-9707d2a2-2f9a-493a-9004-f8289b19d8c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adc6287aa5b94df5bd6c411cc369eed4'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:51:05.113915 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1193/2388] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:51:04 2021] DELETE /identity/v3/users/adc6287aa5b94df5bd6c411cc369eed4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:51:05.118395 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2e8c2-ea93-4b5a-b139-77afb23d7b1f None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:51:05.118906 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2e8c2-ea93-4b5a-b139-77afb23d7b1f None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:51:05.119022 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2e8c2-ea93-4b5a-b139-77afb23d7b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:51:05.145848 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-29c2e8c2-ea93-4b5a-b139-77afb23d7b1f None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:51:05.147048 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-29c2e8c2-ea93-4b5a-b139-77afb23d7b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:51:05.204494 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1196/2389] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:51:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:51:05.214294 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707d2a2-2f9a-493a-9004-f8289b19d8c3 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:51:05.215673 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-9707d2a2-2f9a-493a-9004-f8289b19d8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:51:05.270587 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707d2a2-2f9a-493a-9004-f8289b19d8c3 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:51:05.274322 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ee97d-a9cc-4df8-b482-02b8c095254b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:51:05.274969 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ee97d-a9cc-4df8-b482-02b8c095254b service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:51:05.275250 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ee97d-a9cc-4df8-b482-02b8c095254b service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:51:05.275532 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ee97d-a9cc-4df8-b482-02b8c095254b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:51:05.290858 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ee97d-a9cc-4df8-b482-02b8c095254b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:51:05.292306 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ee97d-a9cc-4df8-b482-02b8c095254b service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:51:05.302234 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1194/2390] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:51:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:51:05.574710 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2e8c2-ea93-4b5a-b139-77afb23d7b1f None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:51:05.576286 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-29c2e8c2-ea93-4b5a-b139-77afb23d7b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:51:05.590740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2e8c2-ea93-4b5a-b139-77afb23d7b1f None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:51:05.597500 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99061c3d-428e-44e6-a7ee-b955279d1fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:51:05.599356 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99061c3d-428e-44e6-a7ee-b955279d1fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:51:05.599690 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99061c3d-428e-44e6-a7ee-b955279d1fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:51:05.599968 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99061c3d-428e-44e6-a7ee-b955279d1fd1 admin admin] PATH_INFO: `/v3/projects/b6b60c448c3c4a5aa84f68579f2d4c40` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:51:05.601230 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99061c3d-428e-44e6-a7ee-b955279d1fd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6b60c448c3c4a5aa84f68579f2d4c40)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:51:05.603302 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99061c3d-428e-44e6-a7ee-b955279d1fd1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:51:05.652513 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-99061c3d-428e-44e6-a7ee-b955279d1fd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6b60c448c3c4a5aa84f68579f2d4c40', 'request_id': 'req-99061c3d-428e-44e6-a7ee-b955279d1fd1'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:51:05.659350 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-99061c3d-428e-44e6-a7ee-b955279d1fd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6b60c448c3c4a5aa84f68579f2d4c40', 'request_id': 'req-99061c3d-428e-44e6-a7ee-b955279d1fd1'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:51:05.668103 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-99061c3d-428e-44e6-a7ee-b955279d1fd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6b60c448c3c4a5aa84f68579f2d4c40', 'request_id': 'req-99061c3d-428e-44e6-a7ee-b955279d1fd1'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:51:05.679709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-99061c3d-428e-44e6-a7ee-b955279d1fd1 admin admin] The token cache is being invalidate because project b6b60c448c3c4a5aa84f68579f2d4c40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:51:05.680001 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-99061c3d-428e-44e6-a7ee-b955279d1fd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:51:05.680649 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-99061c3d-428e-44e6-a7ee-b955279d1fd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:51:05.682209 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1197/2391] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:51:05 2021] DELETE /identity/v3/projects/b6b60c448c3c4a5aa84f68579f2d4c40 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:51:05.689309 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e5ec4-e4ab-412f-8156-554282540f39 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:51:05.689610 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e5ec4-e4ab-412f-8156-554282540f39 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:51:05.689879 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e5ec4-e4ab-412f-8156-554282540f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:51:05.739061 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-e62e5ec4-e4ab-412f-8156-554282540f39 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:51:05.740269 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e62e5ec4-e4ab-412f-8156-554282540f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:51:05.796464 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1195/2392] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:51:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:51:05.805375 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf359e-eee6-4ba0-8ccc-2078f78459f8 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:51:05.805686 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf359e-eee6-4ba0-8ccc-2078f78459f8 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:51:05.806101 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf359e-eee6-4ba0-8ccc-2078f78459f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:51:05.824952 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-9daf359e-eee6-4ba0-8ccc-2078f78459f8 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:51:05.826165 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-9daf359e-eee6-4ba0-8ccc-2078f78459f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:51:05.834391 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1198/2393] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:51:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:51:05.838470 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e5ec4-e4ab-412f-8156-554282540f39 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:51:05.847982 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e5ec4-e4ab-412f-8156-554282540f39 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:51:05.852667 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee98ff2-63d0-4e17-8cdf-748133c9c51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:51:05.853385 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee98ff2-63d0-4e17-8cdf-748133c9c51f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:51:05.853672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee98ff2-63d0-4e17-8cdf-748133c9c51f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:51:05.853972 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee98ff2-63d0-4e17-8cdf-748133c9c51f admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:51:05.854693 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee98ff2-63d0-4e17-8cdf-748133c9c51f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:51:05.855002 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee98ff2-63d0-4e17-8cdf-748133c9c51f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:51:05.856617 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee98ff2-63d0-4e17-8cdf-748133c9c51f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:51:05.868481 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1196/2394] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:51:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 02:51:05.872288 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf359e-eee6-4ba0-8ccc-2078f78459f8 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:51:05.881755 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf359e-eee6-4ba0-8ccc-2078f78459f8 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:51:05.886388 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e80cb-78e9-421b-b353-b8e5daaafb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:51:05.887048 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e80cb-78e9-421b-b353-b8e5daaafb66 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:51:05.887331 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e80cb-78e9-421b-b353-b8e5daaafb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:51:05.887610 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e80cb-78e9-421b-b353-b8e5daaafb66 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:51:05.888297 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e80cb-78e9-421b-b353-b8e5daaafb66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:51:05.890232 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e80cb-78e9-421b-b353-b8e5daaafb66 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:51:05.923469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1199/2395] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:51:05 2021] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:51:05.927352 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee98ff2-63d0-4e17-8cdf-748133c9c51f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:51:05.937076 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee98ff2-63d0-4e17-8cdf-748133c9c51f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:51:05.990137 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ea472-b14c-42ed-a8cb-42f7008b6be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:51:05.990795 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ea472-b14c-42ed-a8cb-42f7008b6be9 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:51:05.991074 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ea472-b14c-42ed-a8cb-42f7008b6be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:51:05.991345 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ea472-b14c-42ed-a8cb-42f7008b6be9 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:51:05.992062 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ea472-b14c-42ed-a8cb-42f7008b6be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:51:05.994072 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ea472-b14c-42ed-a8cb-42f7008b6be9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:51:06.014798 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1197/2396] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:51:05 2021] POST /identity/v3/users => generated 300 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 02:51:06.015905 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e80cb-78e9-421b-b353-b8e5daaafb66 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:51:06.026249 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e80cb-78e9-421b-b353-b8e5daaafb66 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:51:06.030838 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a2caa-afc2-403b-950a-2b48caa3ee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:51:06.031485 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a2caa-afc2-403b-950a-2b48caa3ee2c admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:51:06.031765 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a2caa-afc2-403b-950a-2b48caa3ee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:51:06.032035 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a2caa-afc2-403b-950a-2b48caa3ee2c admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:51:06.033402 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a2caa-afc2-403b-950a-2b48caa3ee2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:51:06.034966 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a2caa-afc2-403b-950a-2b48caa3ee2c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:51:06.044429 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1200/2397] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:51:06 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 02:51:06.048272 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ea472-b14c-42ed-a8cb-42f7008b6be9 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:51:06.057920 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ea472-b14c-42ed-a8cb-42f7008b6be9 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:51:06.062559 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd3738-3cd8-4cad-889b-9e7d5dd8217f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:51:06.063210 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd3738-3cd8-4cad-889b-9e7d5dd8217f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:51:06.063497 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd3738-3cd8-4cad-889b-9e7d5dd8217f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:51:06.063780 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd3738-3cd8-4cad-889b-9e7d5dd8217f admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:51:06.064499 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd3738-3cd8-4cad-889b-9e7d5dd8217f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:51:06.066107 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd3738-3cd8-4cad-889b-9e7d5dd8217f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:51:06.075617 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1198/2398] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:51:06 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:51:06.080092 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a2caa-afc2-403b-950a-2b48caa3ee2c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:51:06.089502 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a2caa-afc2-403b-950a-2b48caa3ee2c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:51:06.094051 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d98a8-c1f8-4d0d-9565-018eb5083417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:51:06.095536 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d98a8-c1f8-4d0d-9565-018eb5083417 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:51:06.095794 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d98a8-c1f8-4d0d-9565-018eb5083417 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:51:06.096065 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d98a8-c1f8-4d0d-9565-018eb5083417 admin admin] PATH_INFO: `/v3/projects/0d3258a135cc498e95ca2ebc646446ea/users/3f53981abf234ba99a688cd37e7d3687/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:51:06.110043 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d98a8-c1f8-4d0d-9565-018eb5083417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3258a135cc498e95ca2ebc646446ea, user_id=3f53981abf234ba99a688cd37e7d3687, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:51:06.112683 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d98a8-c1f8-4d0d-9565-018eb5083417 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:51:06.124898 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1201/2399] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:51:06 2021] PUT /identity/v3/projects/0d3258a135cc498e95ca2ebc646446ea/users/3f53981abf234ba99a688cd37e7d3687/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:51:06.178731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b61f1-dacf-46b0-bafe-b67ef8c2ca90 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:51:06.179034 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b61f1-dacf-46b0-bafe-b67ef8c2ca90 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:51:06.179327 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b61f1-dacf-46b0-bafe-b67ef8c2ca90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:51:06.207263 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-953b61f1-dacf-46b0-bafe-b67ef8c2ca90 None None] MFA Rules not processed for user `3f53981abf234ba99a688cd37e7d3687`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:51:06.208470 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-953b61f1-dacf-46b0-bafe-b67ef8c2ca90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:51:06.268005 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1199/2400] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:51:06 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:51:06.278393 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d98a8-c1f8-4d0d-9565-018eb5083417 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:51:06.280081 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-310d98a8-c1f8-4d0d-9565-018eb5083417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:51:06.338333 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d98a8-c1f8-4d0d-9565-018eb5083417 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:51:06.342092 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa17c0-0cd7-4a65-90ec-61d8b2de726b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:51:06.342742 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa17c0-0cd7-4a65-90ec-61d8b2de726b service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:51:06.343172 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa17c0-0cd7-4a65-90ec-61d8b2de726b service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:51:06.343455 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa17c0-0cd7-4a65-90ec-61d8b2de726b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:51:06.351937 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa17c0-0cd7-4a65-90ec-61d8b2de726b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:51:06.353429 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa17c0-0cd7-4a65-90ec-61d8b2de726b service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:51:06.362084 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1202/2401] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:51:06 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:51:06.509418 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b61f1-dacf-46b0-bafe-b67ef8c2ca90 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:51:06.511083 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-953b61f1-dacf-46b0-bafe-b67ef8c2ca90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:51:06.588470 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b61f1-dacf-46b0-bafe-b67ef8c2ca90 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:51:06.593990 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2019c5-cf5b-47f9-ba89-ec68106947fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:51:06.594632 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2019c5-cf5b-47f9-ba89-ec68106947fb service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:51:06.594942 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2019c5-cf5b-47f9-ba89-ec68106947fb service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:51:06.595213 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2019c5-cf5b-47f9-ba89-ec68106947fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:51:06.597433 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-6a2019c5-cf5b-47f9-ba89-ec68106947fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:51:06.610937 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2019c5-cf5b-47f9-ba89-ec68106947fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:51:06.612600 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2019c5-cf5b-47f9-ba89-ec68106947fb service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:51:06.623589 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1200/2402] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:51:06 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:51:07.943265 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa17c0-0cd7-4a65-90ec-61d8b2de726b service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:51:07.956167 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa17c0-0cd7-4a65-90ec-61d8b2de726b service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:51:07.961554 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5727ba-417e-4f88-8689-d970bc7d6a03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:51:07.962180 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5727ba-417e-4f88-8689-d970bc7d6a03 service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:51:07.962460 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5727ba-417e-4f88-8689-d970bc7d6a03 service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:51:07.962733 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5727ba-417e-4f88-8689-d970bc7d6a03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:51:07.964459 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ab5727ba-417e-4f88-8689-d970bc7d6a03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:51:08.018621 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5727ba-417e-4f88-8689-d970bc7d6a03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:51:08.020188 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5727ba-417e-4f88-8689-d970bc7d6a03 service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:51:08.028723 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1203/2403] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:51:07 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:53:54.209785 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2019c5-cf5b-47f9-ba89-ec68106947fb service nova] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:53:54.211153 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-6a2019c5-cf5b-47f9-ba89-ec68106947fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:53:54.338994 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2019c5-cf5b-47f9-ba89-ec68106947fb service nova] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:53:54.344029 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a805ce9-5ca5-4af5-b40e-9dca9f3a02dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:53:54.344663 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a805ce9-5ca5-4af5-b40e-9dca9f3a02dc service placement] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:53:54.344992 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a805ce9-5ca5-4af5-b40e-9dca9f3a02dc service placement] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:53:54.345269 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a805ce9-5ca5-4af5-b40e-9dca9f3a02dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:53:54.347021 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-4a805ce9-5ca5-4af5-b40e-9dca9f3a02dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:53:54.357648 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a805ce9-5ca5-4af5-b40e-9dca9f3a02dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:53:54.359182 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a805ce9-5ca5-4af5-b40e-9dca9f3a02dc service placement] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:53:54.369053 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1201/2404] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:53:54 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:54:29.233156 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5727ba-417e-4f88-8689-d970bc7d6a03 service nova] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:54:29.233156 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ab5727ba-417e-4f88-8689-d970bc7d6a03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:54:29.272923 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5727ba-417e-4f88-8689-d970bc7d6a03 service nova] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:54:29.276636 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193f1c4-d9fb-4158-b225-141997611860 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:54:29.277306 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193f1c4-d9fb-4158-b225-141997611860 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:54:29.277591 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193f1c4-d9fb-4158-b225-141997611860 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:54:29.277870 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193f1c4-d9fb-4158-b225-141997611860 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:54:29.279628 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-6193f1c4-d9fb-4158-b225-141997611860 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:54:29.335704 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193f1c4-d9fb-4158-b225-141997611860 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:54:29.337164 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193f1c4-d9fb-4158-b225-141997611860 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:54:29.346404 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1204/2405] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:54:29 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 02:54:32.605414 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a805ce9-5ca5-4af5-b40e-9dca9f3a02dc service placement] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:54:32.614582 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a805ce9-5ca5-4af5-b40e-9dca9f3a02dc service placement] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:54:32.618231 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392815e4-ac18-4575-8e3d-f474664eb209 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:54:32.618872 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392815e4-ac18-4575-8e3d-f474664eb209 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:54:32.619148 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392815e4-ac18-4575-8e3d-f474664eb209 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:54:32.619418 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392815e4-ac18-4575-8e3d-f474664eb209 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:54:32.621144 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-392815e4-ac18-4575-8e3d-f474664eb209 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:54:32.678597 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392815e4-ac18-4575-8e3d-f474664eb209 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:54:32.680012 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392815e4-ac18-4575-8e3d-f474664eb209 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:54:32.688754 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1202/2406] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:54:32 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:55:22.540569 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193f1c4-d9fb-4158-b225-141997611860 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:55:22.549401 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193f1c4-d9fb-4158-b225-141997611860 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:55:22.553145 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa4059-e372-443f-822c-c2c11c53cd04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:55:22.553833 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa4059-e372-443f-822c-c2c11c53cd04 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:55:22.554115 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa4059-e372-443f-822c-c2c11c53cd04 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:55:22.554381 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa4059-e372-443f-822c-c2c11c53cd04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:55:22.556121 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-45fa4059-e372-443f-822c-c2c11c53cd04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:55:22.612001 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa4059-e372-443f-822c-c2c11c53cd04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:55:22.613456 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa4059-e372-443f-822c-c2c11c53cd04 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:55:22.622156 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1205/2407] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:55:22 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:55:54.869589 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392815e4-ac18-4575-8e3d-f474664eb209 service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:55:54.871066 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-392815e4-ac18-4575-8e3d-f474664eb209 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:55:54.932168 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392815e4-ac18-4575-8e3d-f474664eb209 service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:55:54.935780 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb9e94-c34d-4f91-aeb6-7b0bec43bdf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:55:54.936408 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb9e94-c34d-4f91-aeb6-7b0bec43bdf5 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:55:54.936685 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb9e94-c34d-4f91-aeb6-7b0bec43bdf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:55:54.936983 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb9e94-c34d-4f91-aeb6-7b0bec43bdf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:55:54.938672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-0edb9e94-c34d-4f91-aeb6-7b0bec43bdf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:55:54.948109 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb9e94-c34d-4f91-aeb6-7b0bec43bdf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:55:54.949804 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb9e94-c34d-4f91-aeb6-7b0bec43bdf5 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:55:54.957321 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1203/2408] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:55:54 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:56:07.076678 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa4059-e372-443f-822c-c2c11c53cd04 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:56:07.085007 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa4059-e372-443f-822c-c2c11c53cd04 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:56:07.088613 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c695c01-ffa8-4038-8d30-0d907d9dcbbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:56:07.089273 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c695c01-ffa8-4038-8d30-0d907d9dcbbb service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:56:07.089553 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c695c01-ffa8-4038-8d30-0d907d9dcbbb service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:56:07.089826 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c695c01-ffa8-4038-8d30-0d907d9dcbbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:56:07.097879 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c695c01-ffa8-4038-8d30-0d907d9dcbbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:56:07.099330 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c695c01-ffa8-4038-8d30-0d907d9dcbbb service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:56:07.107977 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1206/2409] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:56:07 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:56:08.954196 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb9e94-c34d-4f91-aeb6-7b0bec43bdf5 service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:56:08.963908 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb9e94-c34d-4f91-aeb6-7b0bec43bdf5 service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:56:08.967819 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d3d40-6182-4375-899a-77809118050f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:56:08.968449 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d3d40-6182-4375-899a-77809118050f service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:56:08.968729 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d3d40-6182-4375-899a-77809118050f service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:56:08.969040 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d3d40-6182-4375-899a-77809118050f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:56:08.977325 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d3d40-6182-4375-899a-77809118050f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:56:08.978725 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d3d40-6182-4375-899a-77809118050f service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:56:09.004565 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1204/2410] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:56:08 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:57:07.098058 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c695c01-ffa8-4038-8d30-0d907d9dcbbb service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:57:07.157534 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c695c01-ffa8-4038-8d30-0d907d9dcbbb service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:57:07.162082 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d388d-1b21-44d5-9588-8ed23a6c92aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:57:07.162940 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d388d-1b21-44d5-9588-8ed23a6c92aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:57:07.163221 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d388d-1b21-44d5-9588-8ed23a6c92aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:57:07.163501 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d388d-1b21-44d5-9588-8ed23a6c92aa admin admin] PATH_INFO: `/v3/users/3f53981abf234ba99a688cd37e7d3687` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:57:07.165335 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d388d-1b21-44d5-9588-8ed23a6c92aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f53981abf234ba99a688cd37e7d3687)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:57:07.167255 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d388d-1b21-44d5-9588-8ed23a6c92aa admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:57:07.211664 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-7f2d388d-1b21-44d5-9588-8ed23a6c92aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f53981abf234ba99a688cd37e7d3687'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:57:07.222958 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-7f2d388d-1b21-44d5-9588-8ed23a6c92aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f53981abf234ba99a688cd37e7d3687'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:57:07.223615 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-7f2d388d-1b21-44d5-9588-8ed23a6c92aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f53981abf234ba99a688cd37e7d3687'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:57:07.230257 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-7f2d388d-1b21-44d5-9588-8ed23a6c92aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f53981abf234ba99a688cd37e7d3687'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:57:07.236778 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-7f2d388d-1b21-44d5-9588-8ed23a6c92aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f53981abf234ba99a688cd37e7d3687'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:57:07.242401 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1207/2411] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:57:07 2021] DELETE /identity/v3/users/3f53981abf234ba99a688cd37e7d3687 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:57:07.247076 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f0533-05a5-4cb5-8510-4482c329a0d7 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:57:07.247581 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f0533-05a5-4cb5-8510-4482c329a0d7 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:57:07.247700 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f0533-05a5-4cb5-8510-4482c329a0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:57:07.264399 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-ae4f0533-05a5-4cb5-8510-4482c329a0d7 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:57:07.265552 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-ae4f0533-05a5-4cb5-8510-4482c329a0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:57:07.321876 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1205/2412] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:57:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:57:07.333131 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d388d-1b21-44d5-9588-8ed23a6c92aa admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:57:07.334520 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-7f2d388d-1b21-44d5-9588-8ed23a6c92aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:57:07.388998 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d388d-1b21-44d5-9588-8ed23a6c92aa admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:57:07.392573 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca12a0-5e9b-4c27-8595-a85961591c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:57:07.393238 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca12a0-5e9b-4c27-8595-a85961591c14 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:57:07.393516 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca12a0-5e9b-4c27-8595-a85961591c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:57:07.393784 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca12a0-5e9b-4c27-8595-a85961591c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:57:07.403140 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca12a0-5e9b-4c27-8595-a85961591c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:57:07.404553 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca12a0-5e9b-4c27-8595-a85961591c14 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:57:07.413805 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1208/2413] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:57:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:57:07.683677 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f0533-05a5-4cb5-8510-4482c329a0d7 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:57:07.685160 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-ae4f0533-05a5-4cb5-8510-4482c329a0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:57:07.698055 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f0533-05a5-4cb5-8510-4482c329a0d7 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:57:07.704309 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c011c-5e2e-4b8a-b137-ec9ab8d6f186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:57:07.705368 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c011c-5e2e-4b8a-b137-ec9ab8d6f186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:57:07.705571 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c011c-5e2e-4b8a-b137-ec9ab8d6f186 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:57:07.705863 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c011c-5e2e-4b8a-b137-ec9ab8d6f186 admin admin] PATH_INFO: `/v3/projects/0d3258a135cc498e95ca2ebc646446ea` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:57:07.707043 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c011c-5e2e-4b8a-b137-ec9ab8d6f186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d3258a135cc498e95ca2ebc646446ea)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:57:07.708965 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c011c-5e2e-4b8a-b137-ec9ab8d6f186 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:57:07.753655 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-981c011c-5e2e-4b8a-b137-ec9ab8d6f186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d3258a135cc498e95ca2ebc646446ea', 'request_id': 'req-981c011c-5e2e-4b8a-b137-ec9ab8d6f186'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:57:07.760793 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-981c011c-5e2e-4b8a-b137-ec9ab8d6f186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d3258a135cc498e95ca2ebc646446ea', 'request_id': 'req-981c011c-5e2e-4b8a-b137-ec9ab8d6f186'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:57:07.765991 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-981c011c-5e2e-4b8a-b137-ec9ab8d6f186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d3258a135cc498e95ca2ebc646446ea', 'request_id': 'req-981c011c-5e2e-4b8a-b137-ec9ab8d6f186'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:57:07.776264 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-981c011c-5e2e-4b8a-b137-ec9ab8d6f186 admin admin] The token cache is being invalidate because project 0d3258a135cc498e95ca2ebc646446ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:57:07.776494 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-981c011c-5e2e-4b8a-b137-ec9ab8d6f186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:57:07.777135 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-981c011c-5e2e-4b8a-b137-ec9ab8d6f186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:57:07.778635 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1206/2414] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:57:07 2021] DELETE /identity/v3/projects/0d3258a135cc498e95ca2ebc646446ea => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:58:17.515886 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca12a0-5e9b-4c27-8595-a85961591c14 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:58:17.517461 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4dca12a0-5e9b-4c27-8595-a85961591c14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:58:17.529003 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca12a0-5e9b-4c27-8595-a85961591c14 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:58:17.576192 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63a2c4-c444-4ade-9c2b-1fabf85b29c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:58:17.576829 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63a2c4-c444-4ade-9c2b-1fabf85b29c6 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:58:17.577147 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63a2c4-c444-4ade-9c2b-1fabf85b29c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:58:17.577424 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63a2c4-c444-4ade-9c2b-1fabf85b29c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:58:17.579196 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-af63a2c4-c444-4ade-9c2b-1fabf85b29c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:58:17.650877 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63a2c4-c444-4ade-9c2b-1fabf85b29c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:58:17.652307 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63a2c4-c444-4ade-9c2b-1fabf85b29c6 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:58:17.671565 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1209/2415] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:58:17 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:58:18.735242 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c011c-5e2e-4b8a-b137-ec9ab8d6f186 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:58:18.737394 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-981c011c-5e2e-4b8a-b137-ec9ab8d6f186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:58:18.754753 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c011c-5e2e-4b8a-b137-ec9ab8d6f186 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:58:18.760445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd911f-f969-4c4f-8bd3-3c39a1dcb71a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:58:18.761127 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd911f-f969-4c4f-8bd3-3c39a1dcb71a service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:58:18.761408 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd911f-f969-4c4f-8bd3-3c39a1dcb71a service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:58:18.761677 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd911f-f969-4c4f-8bd3-3c39a1dcb71a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:58:18.763444 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-becd911f-f969-4c4f-8bd3-3c39a1dcb71a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:58:18.777032 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd911f-f969-4c4f-8bd3-3c39a1dcb71a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:58:18.779349 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd911f-f969-4c4f-8bd3-3c39a1dcb71a service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:58:18.792830 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1207/2416] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:58:18 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:58:20.119968 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63a2c4-c444-4ade-9c2b-1fabf85b29c6 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:58:20.121437 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-af63a2c4-c444-4ade-9c2b-1fabf85b29c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:58:20.132301 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63a2c4-c444-4ade-9c2b-1fabf85b29c6 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:58:20.135874 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201cdd3-43cc-4ab6-b30f-1203a7c074ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:58:20.136499 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201cdd3-43cc-4ab6-b30f-1203a7c074ea service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:58:20.136778 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201cdd3-43cc-4ab6-b30f-1203a7c074ea service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:58:20.137085 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201cdd3-43cc-4ab6-b30f-1203a7c074ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:58:20.138745 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-7201cdd3-43cc-4ab6-b30f-1203a7c074ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:58:20.151841 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201cdd3-43cc-4ab6-b30f-1203a7c074ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:58:20.153292 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201cdd3-43cc-4ab6-b30f-1203a7c074ea service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:58:20.163917 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1210/2417] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:58:20 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:58:59.152743 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd911f-f969-4c4f-8bd3-3c39a1dcb71a service nova] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:58:59.154157 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-becd911f-f969-4c4f-8bd3-3c39a1dcb71a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:58:59.221494 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd911f-f969-4c4f-8bd3-3c39a1dcb71a service nova] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:58:59.227193 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e30b8-6a1b-4b3d-864a-f6a75210f144 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:58:59.227859 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e30b8-6a1b-4b3d-864a-f6a75210f144 service placement] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:58:59.228141 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e30b8-6a1b-4b3d-864a-f6a75210f144 service placement] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:58:59.228576 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e30b8-6a1b-4b3d-864a-f6a75210f144 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:58:59.230195 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-d87e30b8-6a1b-4b3d-864a-f6a75210f144 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:58:59.241508 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e30b8-6a1b-4b3d-864a-f6a75210f144 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:58:59.243068 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e30b8-6a1b-4b3d-864a-f6a75210f144 service placement] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:58:59.252940 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1208/2418] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:58:59 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:59:02.414506 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201cdd3-43cc-4ab6-b30f-1203a7c074ea service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:59:02.415863 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-7201cdd3-43cc-4ab6-b30f-1203a7c074ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:59:02.426103 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201cdd3-43cc-4ab6-b30f-1203a7c074ea service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:59:02.429660 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db80b92-18ad-40ef-9e9b-799e1012e484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:59:02.430288 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db80b92-18ad-40ef-9e9b-799e1012e484 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:59:02.430565 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db80b92-18ad-40ef-9e9b-799e1012e484 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:59:02.430836 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db80b92-18ad-40ef-9e9b-799e1012e484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:59:02.432452 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4db80b92-18ad-40ef-9e9b-799e1012e484 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:59:02.491314 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db80b92-18ad-40ef-9e9b-799e1012e484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:59:02.492741 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db80b92-18ad-40ef-9e9b-799e1012e484 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:59:02.502081 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1211/2419] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:59:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:59:05.435146 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e30b8-6a1b-4b3d-864a-f6a75210f144 service placement] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:59:05.436675 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-d87e30b8-6a1b-4b3d-864a-f6a75210f144 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:59:05.451751 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e30b8-6a1b-4b3d-864a-f6a75210f144 service placement] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:59:05.456326 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6576f-e21e-4d97-abf9-d537097fd0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:59:05.457216 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6576f-e21e-4d97-abf9-d537097fd0a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:59:05.457489 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6576f-e21e-4d97-abf9-d537097fd0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:59:05.457756 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6576f-e21e-4d97-abf9-d537097fd0a8 admin admin] PATH_INFO: `/v3/users/1a349783f06c414db888ac4f02a6e878` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:59:05.458931 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6576f-e21e-4d97-abf9-d537097fd0a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a349783f06c414db888ac4f02a6e878)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:59:05.460841 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6576f-e21e-4d97-abf9-d537097fd0a8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:59:05.511821 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5aa6576f-e21e-4d97-abf9-d537097fd0a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a349783f06c414db888ac4f02a6e878'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:59:05.512477 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5aa6576f-e21e-4d97-abf9-d537097fd0a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a349783f06c414db888ac4f02a6e878'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:59:05.519317 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5aa6576f-e21e-4d97-abf9-d537097fd0a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a349783f06c414db888ac4f02a6e878'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:59:05.520125 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5aa6576f-e21e-4d97-abf9-d537097fd0a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a349783f06c414db888ac4f02a6e878'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:59:05.532113 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5aa6576f-e21e-4d97-abf9-d537097fd0a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a349783f06c414db888ac4f02a6e878'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:59:05.544433 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1209/2420] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 02:59:05 2021] DELETE /identity/v3/users/1a349783f06c414db888ac4f02a6e878 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:59:05.723435 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db80b92-18ad-40ef-9e9b-799e1012e484 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:59:05.738060 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db80b92-18ad-40ef-9e9b-799e1012e484 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:59:05.804662 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fad7a-44a0-4ebc-9163-c4274d635479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:59:05.806058 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fad7a-44a0-4ebc-9163-c4274d635479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:59:05.806374 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fad7a-44a0-4ebc-9163-c4274d635479 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:59:05.806737 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fad7a-44a0-4ebc-9163-c4274d635479 admin admin] PATH_INFO: `/v3/projects/cc2ce4399ef144efb17b4474c8f97969` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:59:05.808317 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929fad7a-44a0-4ebc-9163-c4274d635479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc2ce4399ef144efb17b4474c8f97969)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:59:05.810461 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929fad7a-44a0-4ebc-9163-c4274d635479 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:59:05.869650 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-929fad7a-44a0-4ebc-9163-c4274d635479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc2ce4399ef144efb17b4474c8f97969', 'request_id': 'req-929fad7a-44a0-4ebc-9163-c4274d635479'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:59:05.877171 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-929fad7a-44a0-4ebc-9163-c4274d635479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc2ce4399ef144efb17b4474c8f97969', 'request_id': 'req-929fad7a-44a0-4ebc-9163-c4274d635479'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:59:05.887262 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-929fad7a-44a0-4ebc-9163-c4274d635479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc2ce4399ef144efb17b4474c8f97969', 'request_id': 'req-929fad7a-44a0-4ebc-9163-c4274d635479'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:59:05.900767 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-929fad7a-44a0-4ebc-9163-c4274d635479 admin admin] The token cache is being invalidate because project cc2ce4399ef144efb17b4474c8f97969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 02:59:05.901105 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-929fad7a-44a0-4ebc-9163-c4274d635479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:59:05.904679 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-929fad7a-44a0-4ebc-9163-c4274d635479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 02:59:05.912050 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1212/2421] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 02:59:05 2021] DELETE /identity/v3/projects/cc2ce4399ef144efb17b4474c8f97969 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 02:59:05.913977 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bae4fa-b310-49a3-946b-e4a1648b18d1 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:59:05.914281 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bae4fa-b310-49a3-946b-e4a1648b18d1 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:59:05.914568 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bae4fa-b310-49a3-946b-e4a1648b18d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:59:05.933654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-f1bae4fa-b310-49a3-946b-e4a1648b18d1 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:59:05.934852 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-f1bae4fa-b310-49a3-946b-e4a1648b18d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:59:05.992415 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1210/2422] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:59:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:59:06.000330 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d348e3f-9c20-4990-bd3d-6eede9b82f65 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:59:06.000623 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d348e3f-9c20-4990-bd3d-6eede9b82f65 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:59:06.000936 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d348e3f-9c20-4990-bd3d-6eede9b82f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:59:06.019291 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-1d348e3f-9c20-4990-bd3d-6eede9b82f65 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:59:06.020526 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-1d348e3f-9c20-4990-bd3d-6eede9b82f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:59:06.028410 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1213/2423] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:59:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:59:06.032560 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bae4fa-b310-49a3-946b-e4a1648b18d1 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:59:06.042595 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bae4fa-b310-49a3-946b-e4a1648b18d1 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:59:06.047208 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad984470-8091-4970-b89a-119bc1e64f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:59:06.047851 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad984470-8091-4970-b89a-119bc1e64f7e admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:59:06.048135 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad984470-8091-4970-b89a-119bc1e64f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:59:06.048411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad984470-8091-4970-b89a-119bc1e64f7e admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:59:06.049160 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad984470-8091-4970-b89a-119bc1e64f7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 02:59:06.049468 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad984470-8091-4970-b89a-119bc1e64f7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:59:06.051045 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad984470-8091-4970-b89a-119bc1e64f7e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:59:06.062564 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1211/2424] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 02:59:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 02:59:06.066801 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d348e3f-9c20-4990-bd3d-6eede9b82f65 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:59:06.076111 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d348e3f-9c20-4990-bd3d-6eede9b82f65 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:59:06.080737 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6df3a-54bc-4ba8-87c2-f870108ef59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:59:06.081933 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6df3a-54bc-4ba8-87c2-f870108ef59e admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:59:06.082217 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6df3a-54bc-4ba8-87c2-f870108ef59e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:59:06.082494 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6df3a-54bc-4ba8-87c2-f870108ef59e admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:59:06.083185 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6df3a-54bc-4ba8-87c2-f870108ef59e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:59:06.085108 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6df3a-54bc-4ba8-87c2-f870108ef59e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:59:06.110097 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1214/2425] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 02:59:06 2021] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:59:06.114065 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad984470-8091-4970-b89a-119bc1e64f7e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:59:06.123804 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad984470-8091-4970-b89a-119bc1e64f7e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:59:06.177021 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f272d-a567-439a-940f-4c6d2a80a1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:59:06.177678 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f272d-a567-439a-940f-4c6d2a80a1db admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:59:06.177959 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f272d-a567-439a-940f-4c6d2a80a1db admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:59:06.178236 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f272d-a567-439a-940f-4c6d2a80a1db admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:59:06.178923 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f272d-a567-439a-940f-4c6d2a80a1db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:59:06.180826 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f272d-a567-439a-940f-4c6d2a80a1db admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:59:06.200115 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1212/2426] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 02:59:06 2021] POST /identity/v3/users => generated 289 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 02:59:06.204013 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6df3a-54bc-4ba8-87c2-f870108ef59e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:59:06.214682 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6df3a-54bc-4ba8-87c2-f870108ef59e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:59:06.219786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b05553-669e-4509-9e33-7825663300e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:59:06.220507 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b05553-669e-4509-9e33-7825663300e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:59:06.220855 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b05553-669e-4509-9e33-7825663300e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:59:06.221274 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b05553-669e-4509-9e33-7825663300e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:59:06.222691 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b05553-669e-4509-9e33-7825663300e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:59:06.224338 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b05553-669e-4509-9e33-7825663300e3 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:59:06.234974 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1215/2427] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:59:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:59:06.238851 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f272d-a567-439a-940f-4c6d2a80a1db admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:59:06.248586 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f272d-a567-439a-940f-4c6d2a80a1db admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:59:06.253649 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c878d4-75a5-4c49-8711-b4e9eaadc2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:59:06.254297 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c878d4-75a5-4c49-8711-b4e9eaadc2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:59:06.256617 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c878d4-75a5-4c49-8711-b4e9eaadc2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:59:06.256617 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c878d4-75a5-4c49-8711-b4e9eaadc2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:59:06.256617 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c878d4-75a5-4c49-8711-b4e9eaadc2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:59:06.257542 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c878d4-75a5-4c49-8711-b4e9eaadc2b5 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:59:06.269952 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1213/2428] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 02:59:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 02:59:06.274648 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b05553-669e-4509-9e33-7825663300e3 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:59:06.285601 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b05553-669e-4509-9e33-7825663300e3 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:59:06.290305 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271fda5-71f9-41dc-90f7-9d409346ed55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:59:06.291177 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271fda5-71f9-41dc-90f7-9d409346ed55 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:59:06.291456 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271fda5-71f9-41dc-90f7-9d409346ed55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:59:06.291728 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271fda5-71f9-41dc-90f7-9d409346ed55 admin admin] PATH_INFO: `/v3/projects/2d44af7c3f99444b98d4422982551f2a/users/826e7ceb2e914a289a850340a0be1d05/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:59:06.307651 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271fda5-71f9-41dc-90f7-9d409346ed55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d44af7c3f99444b98d4422982551f2a, user_id=826e7ceb2e914a289a850340a0be1d05, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:59:06.310356 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271fda5-71f9-41dc-90f7-9d409346ed55 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:59:06.322669 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1216/2429] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 02:59:06 2021] PUT /identity/v3/projects/2d44af7c3f99444b98d4422982551f2a/users/826e7ceb2e914a289a850340a0be1d05/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 02:59:06.327652 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ace52-287e-49fc-99aa-51ab6b4df676 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:59:06.327942 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ace52-287e-49fc-99aa-51ab6b4df676 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:59:06.328222 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ace52-287e-49fc-99aa-51ab6b4df676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:59:06.345637 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-a02ace52-287e-49fc-99aa-51ab6b4df676 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:59:06.347344 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a02ace52-287e-49fc-99aa-51ab6b4df676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:59:06.401791 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1214/2430] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:59:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:59:06.412060 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271fda5-71f9-41dc-90f7-9d409346ed55 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:59:06.413834 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b271fda5-71f9-41dc-90f7-9d409346ed55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:59:06.467634 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271fda5-71f9-41dc-90f7-9d409346ed55 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:59:06.471379 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f81a9-f293-41df-989d-4aeca86e57db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:59:06.472563 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f81a9-f293-41df-989d-4aeca86e57db service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:59:06.472843 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f81a9-f293-41df-989d-4aeca86e57db service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:59:06.473146 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f81a9-f293-41df-989d-4aeca86e57db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:59:06.482186 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f81a9-f293-41df-989d-4aeca86e57db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:59:06.483604 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f81a9-f293-41df-989d-4aeca86e57db service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:59:06.493327 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1217/2431] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:59:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:59:10.414423 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2014b8-129f-443c-a4c1-c0dd210d8de7 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:59:10.414904 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2014b8-129f-443c-a4c1-c0dd210d8de7 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:59:10.415024 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2014b8-129f-443c-a4c1-c0dd210d8de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:59:10.449240 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-9a2014b8-129f-443c-a4c1-c0dd210d8de7 None None] MFA Rules not processed for user `826e7ceb2e914a289a850340a0be1d05`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:59:10.450961 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-9a2014b8-129f-443c-a4c1-c0dd210d8de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:59:10.522015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1215/2432] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:59:10 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 02:59:10.533529 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f81a9-f293-41df-989d-4aeca86e57db service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:59:10.535515 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-498f81a9-f293-41df-989d-4aeca86e57db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:59:10.627842 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f81a9-f293-41df-989d-4aeca86e57db service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:59:10.633851 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fc5e6-11ff-4ec5-8146-d0aff247b9f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:59:10.634499 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fc5e6-11ff-4ec5-8146-d0aff247b9f3 service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:59:10.634784 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fc5e6-11ff-4ec5-8146-d0aff247b9f3 service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:59:10.635060 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fc5e6-11ff-4ec5-8146-d0aff247b9f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:59:10.643070 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fc5e6-11ff-4ec5-8146-d0aff247b9f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:59:10.644916 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fc5e6-11ff-4ec5-8146-d0aff247b9f3 service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:59:10.654908 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1218/2433] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:59:10 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:59:13.341343 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67d26a-97c1-464d-8cac-fc6105614e88 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:59:13.342713 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67d26a-97c1-464d-8cac-fc6105614e88 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:59:13.343508 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67d26a-97c1-464d-8cac-fc6105614e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:59:13.363432 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-8a67d26a-97c1-464d-8cac-fc6105614e88 None None] MFA Rules not processed for user `826e7ceb2e914a289a850340a0be1d05`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 02:59:13.364826 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8a67d26a-97c1-464d-8cac-fc6105614e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:59:13.372515 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1216/2434] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 02:59:13 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 02:59:13.722025 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fc5e6-11ff-4ec5-8146-d0aff247b9f3 service nova] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:59:13.723575 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-e76fc5e6-11ff-4ec5-8146-d0aff247b9f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:59:13.739727 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fc5e6-11ff-4ec5-8146-d0aff247b9f3 service nova] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:59:13.743843 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728eebe0-8107-433d-8623-31219eb8eba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:59:13.744753 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728eebe0-8107-433d-8623-31219eb8eba7 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:59:13.745139 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728eebe0-8107-433d-8623-31219eb8eba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:59:13.745483 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728eebe0-8107-433d-8623-31219eb8eba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:59:13.747372 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-728eebe0-8107-433d-8623-31219eb8eba7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:59:13.759462 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728eebe0-8107-433d-8623-31219eb8eba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:59:13.761216 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728eebe0-8107-433d-8623-31219eb8eba7 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:59:13.770293 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1219/2435] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:59:13 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:59:15.135809 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67d26a-97c1-464d-8cac-fc6105614e88 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:59:15.137450 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8a67d26a-97c1-464d-8cac-fc6105614e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:59:15.208807 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67d26a-97c1-464d-8cac-fc6105614e88 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:59:15.213732 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b181e-c738-413f-ad6d-3a9cee9bb904 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:59:15.214383 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b181e-c738-413f-ad6d-3a9cee9bb904 service placement] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:59:15.214665 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b181e-c738-413f-ad6d-3a9cee9bb904 service placement] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:59:15.214945 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b181e-c738-413f-ad6d-3a9cee9bb904 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:59:15.216789 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-600b181e-c738-413f-ad6d-3a9cee9bb904 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:59:15.229266 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b181e-c738-413f-ad6d-3a9cee9bb904 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:59:15.230972 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b181e-c738-413f-ad6d-3a9cee9bb904 service placement] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:59:15.241983 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1217/2436] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:59:15 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:59:26.967289 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728eebe0-8107-433d-8623-31219eb8eba7 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:59:26.982323 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728eebe0-8107-433d-8623-31219eb8eba7 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:59:26.988049 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f613b-0dab-4f1f-8fa2-bb5ba6d8bc15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:59:26.988708 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f613b-0dab-4f1f-8fa2-bb5ba6d8bc15 service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:59:26.989027 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f613b-0dab-4f1f-8fa2-bb5ba6d8bc15 service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:59:26.989362 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f613b-0dab-4f1f-8fa2-bb5ba6d8bc15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:59:26.991146 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-596f613b-0dab-4f1f-8fa2-bb5ba6d8bc15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:59:27.004084 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f613b-0dab-4f1f-8fa2-bb5ba6d8bc15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:59:27.005823 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f613b-0dab-4f1f-8fa2-bb5ba6d8bc15 service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:59:27.016219 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1220/2437] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:59:26 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:59:31.381486 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b181e-c738-413f-ad6d-3a9cee9bb904 service placement] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:59:31.393611 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b181e-c738-413f-ad6d-3a9cee9bb904 service placement] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:59:31.399313 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba949e-a5d2-4b9a-9389-f6a5d2b97b96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:59:31.400117 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba949e-a5d2-4b9a-9389-f6a5d2b97b96 service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:59:31.400400 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba949e-a5d2-4b9a-9389-f6a5d2b97b96 service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:59:31.400671 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba949e-a5d2-4b9a-9389-f6a5d2b97b96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:59:31.402666 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-0aba949e-a5d2-4b9a-9389-f6a5d2b97b96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:59:31.416366 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba949e-a5d2-4b9a-9389-f6a5d2b97b96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:59:31.417883 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba949e-a5d2-4b9a-9389-f6a5d2b97b96 service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:59:31.428889 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1218/2438] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:59:31 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 02:59:32.643451 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f613b-0dab-4f1f-8fa2-bb5ba6d8bc15 service nova] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 02:59:32.654996 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f613b-0dab-4f1f-8fa2-bb5ba6d8bc15 service nova] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 02:59:32.660998 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea70ed-33d4-480b-b13e-fff5f3f33f87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 02:59:32.661550 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea70ed-33d4-480b-b13e-fff5f3f33f87 service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 02:59:32.661821 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea70ed-33d4-480b-b13e-fff5f3f33f87 service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 02:59:32.662094 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea70ed-33d4-480b-b13e-fff5f3f33f87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 02:59:32.663799 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-13ea70ed-33d4-480b-b13e-fff5f3f33f87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 02:59:32.739591 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea70ed-33d4-480b-b13e-fff5f3f33f87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 02:59:32.741108 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea70ed-33d4-480b-b13e-fff5f3f33f87 service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 02:59:32.758934 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1221/2439] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 02:59:32 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:00:22.604180 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba949e-a5d2-4b9a-9389-f6a5d2b97b96 service nova] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:00:22.605637 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-0aba949e-a5d2-4b9a-9389-f6a5d2b97b96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:00:22.672321 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba949e-a5d2-4b9a-9389-f6a5d2b97b96 service nova] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:00:22.676048 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07655d48-fab3-4888-835b-dd06afc8337b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:00:22.676731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07655d48-fab3-4888-835b-dd06afc8337b service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:22.677058 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07655d48-fab3-4888-835b-dd06afc8337b service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:22.677358 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07655d48-fab3-4888-835b-dd06afc8337b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:22.679109 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-07655d48-fab3-4888-835b-dd06afc8337b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:00:22.755993 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07655d48-fab3-4888-835b-dd06afc8337b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:00:22.757439 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07655d48-fab3-4888-835b-dd06afc8337b service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:00:22.775661 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1219/2440] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:00:22 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:00:23.151452 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea70ed-33d4-480b-b13e-fff5f3f33f87 service nova] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:00:23.160393 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea70ed-33d4-480b-b13e-fff5f3f33f87 service nova] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:00:23.163963 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbe1b7-39e8-4430-bb6f-da4f5e71e851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:00:23.164598 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbe1b7-39e8-4430-bb6f-da4f5e71e851 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:23.164907 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbe1b7-39e8-4430-bb6f-da4f5e71e851 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:23.165184 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbe1b7-39e8-4430-bb6f-da4f5e71e851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:23.166898 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ccbbe1b7-39e8-4430-bb6f-da4f5e71e851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:00:23.178644 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbe1b7-39e8-4430-bb6f-da4f5e71e851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:00:23.180098 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbe1b7-39e8-4430-bb6f-da4f5e71e851 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:00:23.190020 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1222/2441] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:00:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:00:26.005912 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07655d48-fab3-4888-835b-dd06afc8337b service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:00:26.007964 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-07655d48-fab3-4888-835b-dd06afc8337b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:00:26.021947 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07655d48-fab3-4888-835b-dd06afc8337b service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:00:26.026768 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcc794-7b55-44a4-b0aa-4c110c1111cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:00:26.027713 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcc794-7b55-44a4-b0aa-4c110c1111cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:26.027999 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcc794-7b55-44a4-b0aa-4c110c1111cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:26.028274 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcc794-7b55-44a4-b0aa-4c110c1111cd admin admin] PATH_INFO: `/v3/users/a704df4e1ba0458c8f84f62330ff342e` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:26.029492 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcc794-7b55-44a4-b0aa-4c110c1111cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a704df4e1ba0458c8f84f62330ff342e)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:00:26.032110 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcc794-7b55-44a4-b0aa-4c110c1111cd admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:00:26.077022 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a4fcc794-7b55-44a4-b0aa-4c110c1111cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a704df4e1ba0458c8f84f62330ff342e'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:00:26.077699 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a4fcc794-7b55-44a4-b0aa-4c110c1111cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a704df4e1ba0458c8f84f62330ff342e'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:00:26.085020 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a4fcc794-7b55-44a4-b0aa-4c110c1111cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a704df4e1ba0458c8f84f62330ff342e'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:00:26.085727 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a4fcc794-7b55-44a4-b0aa-4c110c1111cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a704df4e1ba0458c8f84f62330ff342e'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:00:26.101209 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a4fcc794-7b55-44a4-b0aa-4c110c1111cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a704df4e1ba0458c8f84f62330ff342e'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:00:26.113781 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1220/2442] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:00:26 2021] DELETE /identity/v3/users/a704df4e1ba0458c8f84f62330ff342e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:00:26.283581 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbe1b7-39e8-4430-bb6f-da4f5e71e851 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:00:26.296999 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbe1b7-39e8-4430-bb6f-da4f5e71e851 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:00:26.352253 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8634f71-9c7e-498d-849c-91eac39d450a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:00:26.353138 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8634f71-9c7e-498d-849c-91eac39d450a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:26.353429 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8634f71-9c7e-498d-849c-91eac39d450a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:26.353705 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8634f71-9c7e-498d-849c-91eac39d450a admin admin] PATH_INFO: `/v3/projects/b5a6cceb24aa44478bc4e8452b794c34` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:26.354899 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8634f71-9c7e-498d-849c-91eac39d450a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a6cceb24aa44478bc4e8452b794c34)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:00:26.356790 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8634f71-9c7e-498d-849c-91eac39d450a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:00:26.400005 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-f8634f71-9c7e-498d-849c-91eac39d450a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a6cceb24aa44478bc4e8452b794c34', 'request_id': 'req-f8634f71-9c7e-498d-849c-91eac39d450a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:00:26.405754 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-f8634f71-9c7e-498d-849c-91eac39d450a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a6cceb24aa44478bc4e8452b794c34', 'request_id': 'req-f8634f71-9c7e-498d-849c-91eac39d450a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:00:26.413111 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-f8634f71-9c7e-498d-849c-91eac39d450a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a6cceb24aa44478bc4e8452b794c34', 'request_id': 'req-f8634f71-9c7e-498d-849c-91eac39d450a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:00:26.422758 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-f8634f71-9c7e-498d-849c-91eac39d450a admin admin] The token cache is being invalidate because project b5a6cceb24aa44478bc4e8452b794c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:00:26.422996 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-f8634f71-9c7e-498d-849c-91eac39d450a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:00:26.423616 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-f8634f71-9c7e-498d-849c-91eac39d450a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:00:26.425147 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1223/2443] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:00:26 2021] DELETE /identity/v3/projects/b5a6cceb24aa44478bc4e8452b794c34 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:00:26.437427 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df083a93-d05b-42e6-ab29-75d35564aa19 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:26.437709 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df083a93-d05b-42e6-ab29-75d35564aa19 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:26.437984 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df083a93-d05b-42e6-ab29-75d35564aa19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:26.456447 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-df083a93-d05b-42e6-ab29-75d35564aa19 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:00:26.457718 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-df083a93-d05b-42e6-ab29-75d35564aa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:00:26.515075 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1221/2444] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:00:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:00:26.523635 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1bcab-ebff-4f30-93cd-b456ab5b2ba0 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:26.523921 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1bcab-ebff-4f30-93cd-b456ab5b2ba0 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:26.524197 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1bcab-ebff-4f30-93cd-b456ab5b2ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:26.542149 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-add1bcab-ebff-4f30-93cd-b456ab5b2ba0 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:00:26.543579 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-add1bcab-ebff-4f30-93cd-b456ab5b2ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:00:26.551318 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1224/2445] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:00:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:00:26.555307 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df083a93-d05b-42e6-ab29-75d35564aa19 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:00:26.565334 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df083a93-d05b-42e6-ab29-75d35564aa19 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:00:26.570320 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b25906-32bb-4f46-a41e-34c8c7977534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:00:26.571010 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b25906-32bb-4f46-a41e-34c8c7977534 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:26.571298 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b25906-32bb-4f46-a41e-34c8c7977534 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:26.571579 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b25906-32bb-4f46-a41e-34c8c7977534 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:26.572326 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b25906-32bb-4f46-a41e-34c8c7977534 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 03:00:26.572631 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b25906-32bb-4f46-a41e-34c8c7977534 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:00:26.574273 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b25906-32bb-4f46-a41e-34c8c7977534 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:00:26.586192 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1222/2446] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 03:00:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 03:00:26.590389 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1bcab-ebff-4f30-93cd-b456ab5b2ba0 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:00:26.599703 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1bcab-ebff-4f30-93cd-b456ab5b2ba0 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:00:26.604466 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512eac1-1e29-4dab-a47b-fe41eea3c16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:00:26.605157 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512eac1-1e29-4dab-a47b-fe41eea3c16f admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:26.605469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512eac1-1e29-4dab-a47b-fe41eea3c16f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:26.605747 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512eac1-1e29-4dab-a47b-fe41eea3c16f admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:26.606448 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512eac1-1e29-4dab-a47b-fe41eea3c16f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:00:26.608376 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512eac1-1e29-4dab-a47b-fe41eea3c16f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:00:26.636687 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1225/2447] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:00:26 2021] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:00:26.641346 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b25906-32bb-4f46-a41e-34c8c7977534 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:00:26.650962 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b25906-32bb-4f46-a41e-34c8c7977534 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:00:26.702929 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d54ddc-b1cb-4493-8922-4fc6b965e22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:00:26.704192 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d54ddc-b1cb-4493-8922-4fc6b965e22a admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:26.704635 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d54ddc-b1cb-4493-8922-4fc6b965e22a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:26.704802 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d54ddc-b1cb-4493-8922-4fc6b965e22a admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:26.705671 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d54ddc-b1cb-4493-8922-4fc6b965e22a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:00:26.707567 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d54ddc-b1cb-4493-8922-4fc6b965e22a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:00:26.726789 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1223/2448] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:00:26 2021] POST /identity/v3/users => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:00:26.730761 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512eac1-1e29-4dab-a47b-fe41eea3c16f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:00:26.740988 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512eac1-1e29-4dab-a47b-fe41eea3c16f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:00:26.745659 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b1701-731d-4722-9e08-cca4385c193f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:00:26.746311 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b1701-731d-4722-9e08-cca4385c193f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:26.746600 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b1701-731d-4722-9e08-cca4385c193f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:26.746878 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b1701-731d-4722-9e08-cca4385c193f admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:26.747603 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b1701-731d-4722-9e08-cca4385c193f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:00:26.749253 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b1701-731d-4722-9e08-cca4385c193f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:00:26.759775 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1226/2449] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:00:26 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:00:26.763321 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d54ddc-b1cb-4493-8922-4fc6b965e22a admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:00:26.774049 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d54ddc-b1cb-4493-8922-4fc6b965e22a admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:00:26.779127 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e08de9-b5d1-4d77-aa75-97686114b2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:00:26.779706 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e08de9-b5d1-4d77-aa75-97686114b2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:26.779987 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e08de9-b5d1-4d77-aa75-97686114b2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:26.780261 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e08de9-b5d1-4d77-aa75-97686114b2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:26.781005 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e08de9-b5d1-4d77-aa75-97686114b2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:00:26.782552 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e08de9-b5d1-4d77-aa75-97686114b2a4 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:00:26.792733 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1224/2450] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:00:26 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:00:26.795880 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b1701-731d-4722-9e08-cca4385c193f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:00:26.806337 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b1701-731d-4722-9e08-cca4385c193f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:00:26.810938 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb499a-3c5a-4c32-8a73-b4356518d29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:00:26.811794 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb499a-3c5a-4c32-8a73-b4356518d29f admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:26.812071 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb499a-3c5a-4c32-8a73-b4356518d29f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:26.812356 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb499a-3c5a-4c32-8a73-b4356518d29f admin admin] PATH_INFO: `/v3/projects/6d39317cebfb4781b9fa3fb198496e8a/users/922b264e45a847b683bc609c14704e71/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:26.827099 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb499a-3c5a-4c32-8a73-b4356518d29f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d39317cebfb4781b9fa3fb198496e8a, user_id=922b264e45a847b683bc609c14704e71, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:00:26.830340 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb499a-3c5a-4c32-8a73-b4356518d29f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:00:26.842571 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1227/2451] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:00:26 2021] PUT /identity/v3/projects/6d39317cebfb4781b9fa3fb198496e8a/users/922b264e45a847b683bc609c14704e71/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:00:26.852312 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e68243-e8b3-4f0f-b972-932e17f43955 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:26.852600 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e68243-e8b3-4f0f-b972-932e17f43955 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:26.852892 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e68243-e8b3-4f0f-b972-932e17f43955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:26.879678 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-c7e68243-e8b3-4f0f-b972-932e17f43955 None None] MFA Rules not processed for user `922b264e45a847b683bc609c14704e71`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:00:26.880911 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c7e68243-e8b3-4f0f-b972-932e17f43955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:00:26.942070 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1225/2452] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:00:26 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:00:26.946692 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb499a-3c5a-4c32-8a73-b4356518d29f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:00:27.008500 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb499a-3c5a-4c32-8a73-b4356518d29f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:00:27.013340 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e102f-10d0-4f9b-93e6-a9e305ec5264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:00:27.013999 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e102f-10d0-4f9b-93e6-a9e305ec5264 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:27.014286 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e102f-10d0-4f9b-93e6-a9e305ec5264 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:27.014566 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e102f-10d0-4f9b-93e6-a9e305ec5264 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:27.015268 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e102f-10d0-4f9b-93e6-a9e305ec5264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:00:27.017325 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e102f-10d0-4f9b-93e6-a9e305ec5264 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:00:27.043629 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1228/2453] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:00:26 2021] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:00:27.047958 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e68243-e8b3-4f0f-b972-932e17f43955 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:00:27.058616 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e68243-e8b3-4f0f-b972-932e17f43955 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:00:27.112755 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc060624-e142-4ce6-87b5-f4d98cd2ae26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:00:27.113450 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc060624-e142-4ce6-87b5-f4d98cd2ae26 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:27.113738 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc060624-e142-4ce6-87b5-f4d98cd2ae26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:27.114019 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc060624-e142-4ce6-87b5-f4d98cd2ae26 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:27.114751 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc060624-e142-4ce6-87b5-f4d98cd2ae26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:00:27.116678 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc060624-e142-4ce6-87b5-f4d98cd2ae26 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:00:27.136142 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1226/2454] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:00:27 2021] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:00:27.140118 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e102f-10d0-4f9b-93e6-a9e305ec5264 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:00:27.150082 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e102f-10d0-4f9b-93e6-a9e305ec5264 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:00:27.154713 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d592c-b273-44e1-aaeb-db7679f3018f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:00:27.155367 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d592c-b273-44e1-aaeb-db7679f3018f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:27.155649 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d592c-b273-44e1-aaeb-db7679f3018f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:27.155928 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d592c-b273-44e1-aaeb-db7679f3018f admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:27.156677 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d592c-b273-44e1-aaeb-db7679f3018f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:00:27.158378 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d592c-b273-44e1-aaeb-db7679f3018f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:00:27.168519 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1229/2455] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:00:27 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:00:27.173204 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc060624-e142-4ce6-87b5-f4d98cd2ae26 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:00:27.182982 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc060624-e142-4ce6-87b5-f4d98cd2ae26 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:00:27.188282 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9ea70-08c4-41ff-9a0b-aebe6015e7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:00:27.189193 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9ea70-08c4-41ff-9a0b-aebe6015e7e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:27.189499 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9ea70-08c4-41ff-9a0b-aebe6015e7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:27.189778 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9ea70-08c4-41ff-9a0b-aebe6015e7e5 admin admin] PATH_INFO: `/v3/projects/abba8dfb947548778aaf4c35b202fb99/users/01e8a15e15564198a436fd9b9d1fa1a8/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:27.204662 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9ea70-08c4-41ff-9a0b-aebe6015e7e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abba8dfb947548778aaf4c35b202fb99, user_id=01e8a15e15564198a436fd9b9d1fa1a8, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:00:27.207450 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9ea70-08c4-41ff-9a0b-aebe6015e7e5 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:00:27.220568 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1227/2456] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:00:27 2021] PUT /identity/v3/projects/abba8dfb947548778aaf4c35b202fb99/users/01e8a15e15564198a436fd9b9d1fa1a8/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:00:27.224402 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d592c-b273-44e1-aaeb-db7679f3018f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:00:27.234133 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d592c-b273-44e1-aaeb-db7679f3018f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:00:27.288400 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f98089-f0bd-4996-82f4-8a988a8600dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:00:27.289068 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f98089-f0bd-4996-82f4-8a988a8600dc admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:27.289294 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f98089-f0bd-4996-82f4-8a988a8600dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:27.289569 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f98089-f0bd-4996-82f4-8a988a8600dc admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:27.290282 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f98089-f0bd-4996-82f4-8a988a8600dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:00:27.291889 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f98089-f0bd-4996-82f4-8a988a8600dc admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:00:27.301831 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1230/2457] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:00:27 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 03:00:27.305939 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9ea70-08c4-41ff-9a0b-aebe6015e7e5 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:00:27.316561 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9ea70-08c4-41ff-9a0b-aebe6015e7e5 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:00:27.321515 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec3338-8d6f-49f7-9835-8ac4035877be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:00:27.322403 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec3338-8d6f-49f7-9835-8ac4035877be admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:27.322684 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec3338-8d6f-49f7-9835-8ac4035877be admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:27.322956 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec3338-8d6f-49f7-9835-8ac4035877be admin admin] PATH_INFO: `/v3/projects/abba8dfb947548778aaf4c35b202fb99/users/01e8a15e15564198a436fd9b9d1fa1a8/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:27.324896 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec3338-8d6f-49f7-9835-8ac4035877be admin admin] RBAC: Authorizing `identity:create_grant(project_id=abba8dfb947548778aaf4c35b202fb99, user_id=01e8a15e15564198a436fd9b9d1fa1a8, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:00:27.327484 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec3338-8d6f-49f7-9835-8ac4035877be admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:00:27.337293 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1228/2458] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:00:27 2021] PUT /identity/v3/projects/abba8dfb947548778aaf4c35b202fb99/users/01e8a15e15564198a436fd9b9d1fa1a8/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:00:27.349499 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cff23a-3760-4e23-ac9d-67792caf4ad3 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:27.349791 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cff23a-3760-4e23-ac9d-67792caf4ad3 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:27.350092 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cff23a-3760-4e23-ac9d-67792caf4ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:27.377159 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-d7cff23a-3760-4e23-ac9d-67792caf4ad3 None None] MFA Rules not processed for user `01e8a15e15564198a436fd9b9d1fa1a8`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:00:27.378361 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d7cff23a-3760-4e23-ac9d-67792caf4ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:00:27.441896 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1231/2459] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:00:27 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:00:27.452324 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec3338-8d6f-49f7-9835-8ac4035877be admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:00:27.454070 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-17ec3338-8d6f-49f7-9835-8ac4035877be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:00:27.509159 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec3338-8d6f-49f7-9835-8ac4035877be admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:00:27.512867 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3aeec-adc6-43b9-b8d2-13a432c4bed3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:00:27.513534 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3aeec-adc6-43b9-b8d2-13a432c4bed3 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:27.513818 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3aeec-adc6-43b9-b8d2-13a432c4bed3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:27.514093 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3aeec-adc6-43b9-b8d2-13a432c4bed3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:27.522869 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3aeec-adc6-43b9-b8d2-13a432c4bed3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:00:27.524291 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3aeec-adc6-43b9-b8d2-13a432c4bed3 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:00:27.534348 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1229/2460] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:00:27 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:00:27.602683 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cff23a-3760-4e23-ac9d-67792caf4ad3 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:00:27.604075 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d7cff23a-3760-4e23-ac9d-67792caf4ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:00:27.616151 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cff23a-3760-4e23-ac9d-67792caf4ad3 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:00:27.619747 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d57ace-a871-479e-90ac-d43f056e4b12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:00:27.620378 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d57ace-a871-479e-90ac-d43f056e4b12 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:00:27.620658 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d57ace-a871-479e-90ac-d43f056e4b12 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:00:27.620962 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d57ace-a871-479e-90ac-d43f056e4b12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:00:27.683910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d57ace-a871-479e-90ac-d43f056e4b12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:00:27.685625 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d57ace-a871-479e-90ac-d43f056e4b12 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:00:27.695486 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1232/2461] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:00:27 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:01:02.855095 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3aeec-adc6-43b9-b8d2-13a432c4bed3 service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:01:02.856594 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c4e3aeec-adc6-43b9-b8d2-13a432c4bed3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:01:02.922974 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3aeec-adc6-43b9-b8d2-13a432c4bed3 service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:01:02.926595 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac280c-aaab-4a8e-836e-da4d35f5253d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:01:02.927238 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac280c-aaab-4a8e-836e-da4d35f5253d service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:01:02.927518 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac280c-aaab-4a8e-836e-da4d35f5253d service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:01:02.927789 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac280c-aaab-4a8e-836e-da4d35f5253d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:01:02.929534 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-26ac280c-aaab-4a8e-836e-da4d35f5253d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:01:02.939269 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac280c-aaab-4a8e-836e-da4d35f5253d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:01:02.940685 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac280c-aaab-4a8e-836e-da4d35f5253d service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:01:02.948988 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1230/2462] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:01:02 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:01:08.502091 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d57ace-a871-479e-90ac-d43f056e4b12 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:01:08.510373 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d57ace-a871-479e-90ac-d43f056e4b12 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:01:08.514005 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d899f1-f500-4196-a2ae-59f419180b5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:01:08.514643 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d899f1-f500-4196-a2ae-59f419180b5c service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:01:08.514922 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d899f1-f500-4196-a2ae-59f419180b5c service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:01:08.515191 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d899f1-f500-4196-a2ae-59f419180b5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:01:08.516947 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-26d899f1-f500-4196-a2ae-59f419180b5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:01:08.583071 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d899f1-f500-4196-a2ae-59f419180b5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:01:08.584502 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d899f1-f500-4196-a2ae-59f419180b5c service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:01:08.594135 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1233/2463] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:01:08 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:04:01.778229 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac280c-aaab-4a8e-836e-da4d35f5253d service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:01.779629 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-26ac280c-aaab-4a8e-836e-da4d35f5253d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:04:01.863298 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac280c-aaab-4a8e-836e-da4d35f5253d service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:01.866856 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae254207-f349-46ae-9092-9c05acb2b91a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d661d14d94fa597aee037599de7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:01.867487 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae254207-f349-46ae-9092-9c05acb2b91a service glance] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:01.867766 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae254207-f349-46ae-9092-9c05acb2b91a service glance] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:01.868036 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae254207-f349-46ae-9092-9c05acb2b91a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:01.869748 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-ae254207-f349-46ae-9092-9c05acb2b91a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:04:01.880246 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: WARNING keystone.server.flask.application [None req-ae254207-f349-46ae-9092-9c05acb2b91a service glance] Could not find project: 1b4ef7dbeb754af3ac01621e1d530f99.: keystone.exception.ProjectNotFound: Could not find project: 1b4ef7dbeb754af3ac01621e1d530f99. Sep 15 03:04:01.881431 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1231/2464] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:04:01 2021] GET /identity/v3/auth/tokens => generated 113 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Sep 15 03:04:05.137551 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d899f1-f500-4196-a2ae-59f419180b5c service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:05.138954 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-26d899f1-f500-4196-a2ae-59f419180b5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:04:05.243211 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d899f1-f500-4196-a2ae-59f419180b5c service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:05.248196 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6baff-f517-4f86-9569-4c355a47fcc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:05.248836 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6baff-f517-4f86-9569-4c355a47fcc2 service placement] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:05.249155 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6baff-f517-4f86-9569-4c355a47fcc2 service placement] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:05.249432 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6baff-f517-4f86-9569-4c355a47fcc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:05.251687 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-69c6baff-f517-4f86-9569-4c355a47fcc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:04:05.262599 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6baff-f517-4f86-9569-4c355a47fcc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:05.264170 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6baff-f517-4f86-9569-4c355a47fcc2 service placement] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:05.275155 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1234/2465] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:04:05 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:04:06.757524 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae254207-f349-46ae-9092-9c05acb2b91a service glance] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:06.766444 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae254207-f349-46ae-9092-9c05acb2b91a service glance] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:06.770546 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f0909-fe64-4e8c-939a-92c4151a2aa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:06.771175 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f0909-fe64-4e8c-939a-92c4151a2aa5 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:06.771459 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f0909-fe64-4e8c-939a-92c4151a2aa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:06.771734 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f0909-fe64-4e8c-939a-92c4151a2aa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:06.773532 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e29f0909-fe64-4e8c-939a-92c4151a2aa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:04:06.853919 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f0909-fe64-4e8c-939a-92c4151a2aa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:06.855255 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f0909-fe64-4e8c-939a-92c4151a2aa5 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:06.866299 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1232/2466] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:04:06 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:04:10.326702 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6baff-f517-4f86-9569-4c355a47fcc2 service placement] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:10.335845 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6baff-f517-4f86-9569-4c355a47fcc2 service placement] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:10.339449 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6ddd8-85d9-4aec-a1dd-1a7b08b24513 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:10.340082 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6ddd8-85d9-4aec-a1dd-1a7b08b24513 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:10.340362 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6ddd8-85d9-4aec-a1dd-1a7b08b24513 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:10.340637 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6ddd8-85d9-4aec-a1dd-1a7b08b24513 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:10.342550 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-3cb6ddd8-85d9-4aec-a1dd-1a7b08b24513 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:04:10.397781 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6ddd8-85d9-4aec-a1dd-1a7b08b24513 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:10.399215 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6ddd8-85d9-4aec-a1dd-1a7b08b24513 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:10.408432 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1235/2467] 10.222.0.32 () {60 vars in 1397 bytes} [Wed Sep 15 03:04:10 2021] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3397 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:04:25.697295 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f0909-fe64-4e8c-939a-92c4151a2aa5 service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:25.698789 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e29f0909-fe64-4e8c-939a-92c4151a2aa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:04:25.710560 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f0909-fe64-4e8c-939a-92c4151a2aa5 service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:25.714436 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32e413-437f-48b6-958f-f8a0046a3d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:25.714786 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32e413-437f-48b6-958f-f8a0046a3d37 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:25.715063 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32e413-437f-48b6-958f-f8a0046a3d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:25.715333 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32e413-437f-48b6-958f-f8a0046a3d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:25.717045 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-2c32e413-437f-48b6-958f-f8a0046a3d37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:04:25.731285 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32e413-437f-48b6-958f-f8a0046a3d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:25.732681 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32e413-437f-48b6-958f-f8a0046a3d37 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:25.743508 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1233/2468] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:04:25 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:04:47.182353 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6ddd8-85d9-4aec-a1dd-1a7b08b24513 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:47.201798 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6ddd8-85d9-4aec-a1dd-1a7b08b24513 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:47.205546 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cac538-d505-4c46-ad88-362323715b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:47.206211 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cac538-d505-4c46-ad88-362323715b3f service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:47.206489 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cac538-d505-4c46-ad88-362323715b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:47.206766 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cac538-d505-4c46-ad88-362323715b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:47.208676 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-a5cac538-d505-4c46-ad88-362323715b3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:04:47.299856 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cac538-d505-4c46-ad88-362323715b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:47.301326 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cac538-d505-4c46-ad88-362323715b3f service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:47.320512 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1236/2469] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:04:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:04:47.802414 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32e413-437f-48b6-958f-f8a0046a3d37 service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:47.803879 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-2c32e413-437f-48b6-958f-f8a0046a3d37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:04:47.831939 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32e413-437f-48b6-958f-f8a0046a3d37 service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:47.836506 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e883a-5bf9-4dec-82ef-c883d48a55fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:47.837390 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e883a-5bf9-4dec-82ef-c883d48a55fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:47.837673 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e883a-5bf9-4dec-82ef-c883d48a55fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:47.837946 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e883a-5bf9-4dec-82ef-c883d48a55fd admin admin] PATH_INFO: `/v3/users/04a00a7c706f455492d87c2d6419823d` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:47.839107 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e883a-5bf9-4dec-82ef-c883d48a55fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=04a00a7c706f455492d87c2d6419823d)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:47.841029 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e883a-5bf9-4dec-82ef-c883d48a55fd admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:47.886664 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-b57e883a-5bf9-4dec-82ef-c883d48a55fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04a00a7c706f455492d87c2d6419823d'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:04:47.887362 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-b57e883a-5bf9-4dec-82ef-c883d48a55fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04a00a7c706f455492d87c2d6419823d'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:04:47.894341 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-b57e883a-5bf9-4dec-82ef-c883d48a55fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04a00a7c706f455492d87c2d6419823d'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:04:47.894950 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-b57e883a-5bf9-4dec-82ef-c883d48a55fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04a00a7c706f455492d87c2d6419823d'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:04:47.909430 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-b57e883a-5bf9-4dec-82ef-c883d48a55fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04a00a7c706f455492d87c2d6419823d'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:04:47.922702 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1234/2470] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:04:47 2021] DELETE /identity/v3/users/04a00a7c706f455492d87c2d6419823d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:04:48.105954 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cac538-d505-4c46-ad88-362323715b3f service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:48.127270 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cac538-d505-4c46-ad88-362323715b3f service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:48.182522 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28cf1b-4856-4e29-87fb-88c12ca762a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:48.183376 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28cf1b-4856-4e29-87fb-88c12ca762a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:48.183652 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28cf1b-4856-4e29-87fb-88c12ca762a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:48.183920 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28cf1b-4856-4e29-87fb-88c12ca762a1 admin admin] PATH_INFO: `/v3/projects/8e744d217341431594415d27dc677212` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:48.185104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28cf1b-4856-4e29-87fb-88c12ca762a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e744d217341431594415d27dc677212)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:48.186986 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28cf1b-4856-4e29-87fb-88c12ca762a1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:48.229065 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2c28cf1b-4856-4e29-87fb-88c12ca762a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e744d217341431594415d27dc677212', 'request_id': 'req-2c28cf1b-4856-4e29-87fb-88c12ca762a1'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:04:48.235217 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2c28cf1b-4856-4e29-87fb-88c12ca762a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e744d217341431594415d27dc677212', 'request_id': 'req-2c28cf1b-4856-4e29-87fb-88c12ca762a1'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:04:48.241366 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2c28cf1b-4856-4e29-87fb-88c12ca762a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e744d217341431594415d27dc677212', 'request_id': 'req-2c28cf1b-4856-4e29-87fb-88c12ca762a1'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:04:48.252363 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2c28cf1b-4856-4e29-87fb-88c12ca762a1 admin admin] The token cache is being invalidate because project 8e744d217341431594415d27dc677212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:04:48.252649 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2c28cf1b-4856-4e29-87fb-88c12ca762a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:04:48.253283 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2c28cf1b-4856-4e29-87fb-88c12ca762a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:04:48.254766 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1237/2471] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:04:48 2021] DELETE /identity/v3/projects/8e744d217341431594415d27dc677212 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:04:48.260431 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a32824-60fd-43ab-a592-35e951a2c4ee None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:48.260722 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a32824-60fd-43ab-a592-35e951a2c4ee None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:48.261038 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a32824-60fd-43ab-a592-35e951a2c4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:48.314135 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-27a32824-60fd-43ab-a592-35e951a2c4ee None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:04:48.315306 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-27a32824-60fd-43ab-a592-35e951a2c4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:04:48.370224 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1235/2472] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:04:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:04:48.378459 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf60865-6995-4317-b46c-1d0e518744b6 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:48.378753 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf60865-6995-4317-b46c-1d0e518744b6 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:48.379030 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf60865-6995-4317-b46c-1d0e518744b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:48.398180 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-3cf60865-6995-4317-b46c-1d0e518744b6 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:04:48.399367 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-3cf60865-6995-4317-b46c-1d0e518744b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:04:48.407412 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1238/2473] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:04:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:04:48.411513 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a32824-60fd-43ab-a592-35e951a2c4ee None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:48.420761 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a32824-60fd-43ab-a592-35e951a2c4ee None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:48.425843 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83529550-f007-4cee-8d90-ddf7596615aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:48.426491 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83529550-f007-4cee-8d90-ddf7596615aa admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:48.426767 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83529550-f007-4cee-8d90-ddf7596615aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:48.427038 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83529550-f007-4cee-8d90-ddf7596615aa admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:48.427746 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83529550-f007-4cee-8d90-ddf7596615aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 03:04:48.428048 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83529550-f007-4cee-8d90-ddf7596615aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:48.429658 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83529550-f007-4cee-8d90-ddf7596615aa admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:48.441314 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1236/2474] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 03:04:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 03:04:48.445505 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf60865-6995-4317-b46c-1d0e518744b6 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:48.454544 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf60865-6995-4317-b46c-1d0e518744b6 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:48.459154 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2995a-1216-4274-87f7-d105afc14d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:48.459792 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2995a-1216-4274-87f7-d105afc14d39 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:48.460073 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2995a-1216-4274-87f7-d105afc14d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:48.460345 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2995a-1216-4274-87f7-d105afc14d39 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:48.461078 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2995a-1216-4274-87f7-d105afc14d39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:48.462965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2995a-1216-4274-87f7-d105afc14d39 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:48.498582 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1239/2475] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:04:48 2021] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:04:48.502941 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83529550-f007-4cee-8d90-ddf7596615aa admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:48.512834 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83529550-f007-4cee-8d90-ddf7596615aa admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:48.566507 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4ab1e-cc91-4b74-a87e-a6bc01261123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:48.567165 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4ab1e-cc91-4b74-a87e-a6bc01261123 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:48.567450 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4ab1e-cc91-4b74-a87e-a6bc01261123 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:48.567729 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4ab1e-cc91-4b74-a87e-a6bc01261123 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:48.568415 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4ab1e-cc91-4b74-a87e-a6bc01261123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:48.570336 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4ab1e-cc91-4b74-a87e-a6bc01261123 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:48.589471 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1237/2476] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:04:48 2021] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:04:48.593699 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2995a-1216-4274-87f7-d105afc14d39 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:48.604161 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2995a-1216-4274-87f7-d105afc14d39 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:48.608786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a827c-6eb2-4aef-9b27-4c52b6a500a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:48.609469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a827c-6eb2-4aef-9b27-4c52b6a500a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:48.610388 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a827c-6eb2-4aef-9b27-4c52b6a500a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:48.610668 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a827c-6eb2-4aef-9b27-4c52b6a500a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:48.611385 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a827c-6eb2-4aef-9b27-4c52b6a500a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:48.612995 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a827c-6eb2-4aef-9b27-4c52b6a500a4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:48.622482 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1240/2477] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:04:48 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:04:48.626282 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4ab1e-cc91-4b74-a87e-a6bc01261123 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:48.635959 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4ab1e-cc91-4b74-a87e-a6bc01261123 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:48.640710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98903971-482b-413e-839e-7f8dc4641f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:48.641391 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98903971-482b-413e-839e-7f8dc4641f21 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:48.641677 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98903971-482b-413e-839e-7f8dc4641f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:48.641954 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98903971-482b-413e-839e-7f8dc4641f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:48.642668 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98903971-482b-413e-839e-7f8dc4641f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:48.644252 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98903971-482b-413e-839e-7f8dc4641f21 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:48.653912 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1238/2478] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:04:48 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:04:48.658386 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a827c-6eb2-4aef-9b27-4c52b6a500a4 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:48.667771 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a827c-6eb2-4aef-9b27-4c52b6a500a4 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:48.673272 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28f2e2-8d11-4249-8b1b-aa4c730840d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:48.674136 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28f2e2-8d11-4249-8b1b-aa4c730840d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:48.674413 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28f2e2-8d11-4249-8b1b-aa4c730840d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:48.674681 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28f2e2-8d11-4249-8b1b-aa4c730840d3 admin admin] PATH_INFO: `/v3/projects/b7eaf10fa4104dc188da24b13f77fad4/users/19c7ffe94d204879a8fff474d67a5969/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:48.688982 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28f2e2-8d11-4249-8b1b-aa4c730840d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7eaf10fa4104dc188da24b13f77fad4, user_id=19c7ffe94d204879a8fff474d67a5969, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:48.691644 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28f2e2-8d11-4249-8b1b-aa4c730840d3 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:48.704138 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1241/2479] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:04:48 2021] PUT /identity/v3/projects/b7eaf10fa4104dc188da24b13f77fad4/users/19c7ffe94d204879a8fff474d67a5969/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:04:48.709171 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739ea5d-7b8f-4e4f-97d8-382d03aac6e6 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:48.709465 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739ea5d-7b8f-4e4f-97d8-382d03aac6e6 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:48.709748 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739ea5d-7b8f-4e4f-97d8-382d03aac6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:48.727292 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-6739ea5d-7b8f-4e4f-97d8-382d03aac6e6 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:04:48.728472 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-6739ea5d-7b8f-4e4f-97d8-382d03aac6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:04:48.785980 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1239/2480] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:04:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:04:48.795907 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28f2e2-8d11-4249-8b1b-aa4c730840d3 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:48.798284 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-9d28f2e2-8d11-4249-8b1b-aa4c730840d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:04:48.851689 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28f2e2-8d11-4249-8b1b-aa4c730840d3 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:48.855300 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c0d6c-519e-4b77-a214-179d5f3ddb73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:48.855932 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c0d6c-519e-4b77-a214-179d5f3ddb73 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:48.856209 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c0d6c-519e-4b77-a214-179d5f3ddb73 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:48.856487 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c0d6c-519e-4b77-a214-179d5f3ddb73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:48.865126 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c0d6c-519e-4b77-a214-179d5f3ddb73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:48.866535 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c0d6c-519e-4b77-a214-179d5f3ddb73 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:48.875568 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1242/2481] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:04:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 03:04:52.837924 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a876d-3a91-4d9a-afb9-6997248584b8 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:52.838497 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a876d-3a91-4d9a-afb9-6997248584b8 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:52.838497 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a876d-3a91-4d9a-afb9-6997248584b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:52.867256 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-b49a876d-3a91-4d9a-afb9-6997248584b8 None None] MFA Rules not processed for user `19c7ffe94d204879a8fff474d67a5969`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:04:52.868473 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b49a876d-3a91-4d9a-afb9-6997248584b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:04:52.931533 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1240/2482] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:04:52 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:04:52.936180 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c0d6c-519e-4b77-a214-179d5f3ddb73 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:52.946988 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c0d6c-519e-4b77-a214-179d5f3ddb73 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:52.951747 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b096339-885a-4f67-b484-c15a48d38c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:52.952535 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b096339-885a-4f67-b484-c15a48d38c21 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:52.952950 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b096339-885a-4f67-b484-c15a48d38c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:52.953952 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b096339-885a-4f67-b484-c15a48d38c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:52.954758 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b096339-885a-4f67-b484-c15a48d38c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:52.956757 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b096339-885a-4f67-b484-c15a48d38c21 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:52.986629 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1243/2483] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:04:52 2021] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:04:52.990640 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a876d-3a91-4d9a-afb9-6997248584b8 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:53.001763 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a876d-3a91-4d9a-afb9-6997248584b8 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:53.055519 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0fe87-cb4c-4195-988a-200330b3eb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:53.056225 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0fe87-cb4c-4195-988a-200330b3eb9c admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:53.056533 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0fe87-cb4c-4195-988a-200330b3eb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:53.056851 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0fe87-cb4c-4195-988a-200330b3eb9c admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:53.057604 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0fe87-cb4c-4195-988a-200330b3eb9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:53.059607 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0fe87-cb4c-4195-988a-200330b3eb9c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:53.080525 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1241/2484] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:04:52 2021] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:04:53.084467 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b096339-885a-4f67-b484-c15a48d38c21 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:53.094455 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b096339-885a-4f67-b484-c15a48d38c21 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:53.099032 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396de52a-d914-4ba0-b3ce-aa76ee694b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:53.099683 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396de52a-d914-4ba0-b3ce-aa76ee694b48 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:53.099966 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396de52a-d914-4ba0-b3ce-aa76ee694b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:53.100242 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396de52a-d914-4ba0-b3ce-aa76ee694b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:53.101003 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396de52a-d914-4ba0-b3ce-aa76ee694b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:53.102587 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396de52a-d914-4ba0-b3ce-aa76ee694b48 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:53.112628 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1244/2485] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:04:53 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:04:53.116538 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0fe87-cb4c-4195-988a-200330b3eb9c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:53.126714 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0fe87-cb4c-4195-988a-200330b3eb9c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:53.131359 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71373f0-8492-48a8-8f5b-56087f2996f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:53.132224 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71373f0-8492-48a8-8f5b-56087f2996f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:53.132504 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71373f0-8492-48a8-8f5b-56087f2996f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:53.132777 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71373f0-8492-48a8-8f5b-56087f2996f1 admin admin] PATH_INFO: `/v3/projects/57971ba5d6be42a1bebaa1799b517bd1/users/c715e777740d4349bb9b3309992dbb0d/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:53.148038 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71373f0-8492-48a8-8f5b-56087f2996f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57971ba5d6be42a1bebaa1799b517bd1, user_id=c715e777740d4349bb9b3309992dbb0d, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:53.150803 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71373f0-8492-48a8-8f5b-56087f2996f1 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:53.163644 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1242/2486] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:04:53 2021] PUT /identity/v3/projects/57971ba5d6be42a1bebaa1799b517bd1/users/c715e777740d4349bb9b3309992dbb0d/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:04:53.167475 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396de52a-d914-4ba0-b3ce-aa76ee694b48 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:53.177333 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396de52a-d914-4ba0-b3ce-aa76ee694b48 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:53.230116 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c13aa-1633-4799-96cd-75075b241d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:53.230702 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c13aa-1633-4799-96cd-75075b241d3b admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:53.230987 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c13aa-1633-4799-96cd-75075b241d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:53.231260 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c13aa-1633-4799-96cd-75075b241d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:53.231977 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c13aa-1633-4799-96cd-75075b241d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:53.233618 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c13aa-1633-4799-96cd-75075b241d3b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:53.243238 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1245/2487] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:04:53 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:04:53.247285 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71373f0-8492-48a8-8f5b-56087f2996f1 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:53.257987 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71373f0-8492-48a8-8f5b-56087f2996f1 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:53.262836 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa5bfc-63e6-40dd-91f3-8f24ddddac88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:53.263744 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa5bfc-63e6-40dd-91f3-8f24ddddac88 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:53.264026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa5bfc-63e6-40dd-91f3-8f24ddddac88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:53.264297 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa5bfc-63e6-40dd-91f3-8f24ddddac88 admin admin] PATH_INFO: `/v3/projects/57971ba5d6be42a1bebaa1799b517bd1/users/c715e777740d4349bb9b3309992dbb0d/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:53.266860 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa5bfc-63e6-40dd-91f3-8f24ddddac88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57971ba5d6be42a1bebaa1799b517bd1, user_id=c715e777740d4349bb9b3309992dbb0d, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:53.269553 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa5bfc-63e6-40dd-91f3-8f24ddddac88 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:53.279349 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1243/2488] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:04:53 2021] PUT /identity/v3/projects/57971ba5d6be42a1bebaa1799b517bd1/users/c715e777740d4349bb9b3309992dbb0d/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:04:57.917589 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee2cc0-d48e-4681-b6bb-0ca3bbbec5e0 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:57.918507 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee2cc0-d48e-4681-b6bb-0ca3bbbec5e0 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:57.918953 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee2cc0-d48e-4681-b6bb-0ca3bbbec5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:57.950956 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-cbee2cc0-d48e-4681-b6bb-0ca3bbbec5e0 None None] MFA Rules not processed for user `c715e777740d4349bb9b3309992dbb0d`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:04:57.952450 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-cbee2cc0-d48e-4681-b6bb-0ca3bbbec5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:04:58.029149 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1246/2489] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:04:57 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:04:58.043416 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa5bfc-63e6-40dd-91f3-8f24ddddac88 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:58.045456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7ffa5bfc-63e6-40dd-91f3-8f24ddddac88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:04:58.113537 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa5bfc-63e6-40dd-91f3-8f24ddddac88 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:58.117243 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03775c0-5452-47d9-890d-6017e192f877 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d661d14d94fa597aee037599de7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:58.117898 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03775c0-5452-47d9-890d-6017e192f877 service glance] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:58.118323 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03775c0-5452-47d9-890d-6017e192f877 service glance] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:58.118774 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03775c0-5452-47d9-890d-6017e192f877 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:58.178731 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03775c0-5452-47d9-890d-6017e192f877 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:58.180235 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03775c0-5452-47d9-890d-6017e192f877 service glance] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:58.192515 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1244/2490] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:04:58 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:04:58.287450 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d63274-08cc-463e-a863-6ca9269249d1 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:58.287734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d63274-08cc-463e-a863-6ca9269249d1 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:58.288194 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d63274-08cc-463e-a863-6ca9269249d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:58.362505 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-e0d63274-08cc-463e-a863-6ca9269249d1 None None] MFA Rules not processed for user `a93401007dd64d88af5e41ff08679a28`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:04:58.365427 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-e0d63274-08cc-463e-a863-6ca9269249d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:04:58.453983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1247/2491] 10.222.0.32 () {58 vars in 1010 bytes} [Wed Sep 15 03:04:58 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:04:58.507256 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03775c0-5452-47d9-890d-6017e192f877 service glance] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:04:58.509101 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a03775c0-5452-47d9-890d-6017e192f877 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:04:58.611009 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03775c0-5452-47d9-890d-6017e192f877 service glance] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:04:58.616035 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82cf31-ebf1-4573-9f0c-dbfe18630fcf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea510f540b2d47dcb19c8715fd247786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:04:58.616672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82cf31-ebf1-4573-9f0c-dbfe18630fcf service swift] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:04:58.616994 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82cf31-ebf1-4573-9f0c-dbfe18630fcf service swift] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:04:58.617270 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82cf31-ebf1-4573-9f0c-dbfe18630fcf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:04:58.625465 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82cf31-ebf1-4573-9f0c-dbfe18630fcf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:04:58.627093 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af82cf31-ebf1-4573-9f0c-dbfe18630fcf service swift] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:04:58.635010 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1245/2492] 10.222.0.32 () {60 vars in 1385 bytes} [Wed Sep 15 03:04:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 03:05:00.316859 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d63274-08cc-463e-a863-6ca9269249d1 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:00.318342 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-e0d63274-08cc-463e-a863-6ca9269249d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:00.402367 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d63274-08cc-463e-a863-6ca9269249d1 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:00.408163 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e7dd0-1d63-4739-9e01-5edff5b7454d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:00.409088 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e7dd0-1d63-4739-9e01-5edff5b7454d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:00.409660 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e7dd0-1d63-4739-9e01-5edff5b7454d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:00.410084 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e7dd0-1d63-4739-9e01-5edff5b7454d admin admin] PATH_INFO: `/v3/users/922b264e45a847b683bc609c14704e71` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:00.411591 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e7dd0-1d63-4739-9e01-5edff5b7454d admin admin] RBAC: Authorizing `identity:delete_user(user_id=922b264e45a847b683bc609c14704e71)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:00.413786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e7dd0-1d63-4739-9e01-5edff5b7454d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:00.499642 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0b6e7dd0-1d63-4739-9e01-5edff5b7454d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '922b264e45a847b683bc609c14704e71'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:00.531485 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0b6e7dd0-1d63-4739-9e01-5edff5b7454d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '922b264e45a847b683bc609c14704e71'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:00.532354 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0b6e7dd0-1d63-4739-9e01-5edff5b7454d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '922b264e45a847b683bc609c14704e71'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:00.547266 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0b6e7dd0-1d63-4739-9e01-5edff5b7454d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '922b264e45a847b683bc609c14704e71'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:00.558849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0b6e7dd0-1d63-4739-9e01-5edff5b7454d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '922b264e45a847b683bc609c14704e71'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:00.568062 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1248/2493] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:05:00 2021] DELETE /identity/v3/users/922b264e45a847b683bc609c14704e71 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:05:00.569910 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ac50d-a8e9-433f-b385-2ef5fdb06c20 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:00.570451 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ac50d-a8e9-433f-b385-2ef5fdb06c20 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:00.570451 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ac50d-a8e9-433f-b385-2ef5fdb06c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:00.605550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-758ac50d-a8e9-433f-b385-2ef5fdb06c20 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:05:00.607135 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-758ac50d-a8e9-433f-b385-2ef5fdb06c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:00.704938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1246/2494] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:05:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:05:00.715101 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e7dd0-1d63-4739-9e01-5edff5b7454d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:00.716522 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-0b6e7dd0-1d63-4739-9e01-5edff5b7454d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:00.796559 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e7dd0-1d63-4739-9e01-5edff5b7454d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:00.801408 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e7edc-5188-4c1b-affd-f7c048025c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:00.802376 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e7edc-5188-4c1b-affd-f7c048025c83 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:00.802880 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e7edc-5188-4c1b-affd-f7c048025c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:00.803277 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e7edc-5188-4c1b-affd-f7c048025c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:00.814969 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e7edc-5188-4c1b-affd-f7c048025c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:00.816582 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e7edc-5188-4c1b-affd-f7c048025c83 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:00.837663 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1249/2495] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:05:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:05:01.238071 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ac50d-a8e9-433f-b385-2ef5fdb06c20 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:01.239974 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-758ac50d-a8e9-433f-b385-2ef5fdb06c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:01.258159 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ac50d-a8e9-433f-b385-2ef5fdb06c20 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:01.282370 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdfbdc-c1d4-4fe5-b971-92e82d38d7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:01.283347 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdfbdc-c1d4-4fe5-b971-92e82d38d7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:01.283736 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdfbdc-c1d4-4fe5-b971-92e82d38d7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:01.284085 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdfbdc-c1d4-4fe5-b971-92e82d38d7e3 admin admin] PATH_INFO: `/v3/projects/6d39317cebfb4781b9fa3fb198496e8a` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:01.288527 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdfbdc-c1d4-4fe5-b971-92e82d38d7e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d39317cebfb4781b9fa3fb198496e8a)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:01.290593 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdfbdc-c1d4-4fe5-b971-92e82d38d7e3 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:01.413587 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-56fdfbdc-c1d4-4fe5-b971-92e82d38d7e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d39317cebfb4781b9fa3fb198496e8a', 'request_id': 'req-56fdfbdc-c1d4-4fe5-b971-92e82d38d7e3'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:01.441544 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-56fdfbdc-c1d4-4fe5-b971-92e82d38d7e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d39317cebfb4781b9fa3fb198496e8a', 'request_id': 'req-56fdfbdc-c1d4-4fe5-b971-92e82d38d7e3'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:01.454887 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-56fdfbdc-c1d4-4fe5-b971-92e82d38d7e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d39317cebfb4781b9fa3fb198496e8a', 'request_id': 'req-56fdfbdc-c1d4-4fe5-b971-92e82d38d7e3'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:01.472438 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-56fdfbdc-c1d4-4fe5-b971-92e82d38d7e3 admin admin] The token cache is being invalidate because project 6d39317cebfb4781b9fa3fb198496e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:05:01.472893 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-56fdfbdc-c1d4-4fe5-b971-92e82d38d7e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:01.473882 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-56fdfbdc-c1d4-4fe5-b971-92e82d38d7e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:01.475953 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1247/2496] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:05:01 2021] DELETE /identity/v3/projects/6d39317cebfb4781b9fa3fb198496e8a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:05:01.480111 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e7edc-5188-4c1b-affd-f7c048025c83 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:01.493581 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e7edc-5188-4c1b-affd-f7c048025c83 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:01.610993 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b9cfc-5e73-4947-b21f-38c0fa70e169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:01.613109 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b9cfc-5e73-4947-b21f-38c0fa70e169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:01.613754 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b9cfc-5e73-4947-b21f-38c0fa70e169 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:01.613754 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b9cfc-5e73-4947-b21f-38c0fa70e169 admin admin] PATH_INFO: `/v3/users/01e8a15e15564198a436fd9b9d1fa1a8` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:01.616390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b9cfc-5e73-4947-b21f-38c0fa70e169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01e8a15e15564198a436fd9b9d1fa1a8)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:01.617914 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b9cfc-5e73-4947-b21f-38c0fa70e169 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:01.677308 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-1d6b9cfc-5e73-4947-b21f-38c0fa70e169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01e8a15e15564198a436fd9b9d1fa1a8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:01.703719 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-1d6b9cfc-5e73-4947-b21f-38c0fa70e169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01e8a15e15564198a436fd9b9d1fa1a8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:01.705490 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-1d6b9cfc-5e73-4947-b21f-38c0fa70e169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01e8a15e15564198a436fd9b9d1fa1a8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:01.722387 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-1d6b9cfc-5e73-4947-b21f-38c0fa70e169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01e8a15e15564198a436fd9b9d1fa1a8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:01.732249 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-1d6b9cfc-5e73-4947-b21f-38c0fa70e169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01e8a15e15564198a436fd9b9d1fa1a8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:01.748263 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1250/2497] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:05:01 2021] DELETE /identity/v3/users/01e8a15e15564198a436fd9b9d1fa1a8 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:05:02.207056 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdfbdc-c1d4-4fe5-b971-92e82d38d7e3 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:02.208555 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-56fdfbdc-c1d4-4fe5-b971-92e82d38d7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:02.252079 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdfbdc-c1d4-4fe5-b971-92e82d38d7e3 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:02.336035 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed572b-f441-4ced-b1e4-82cc25726929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:02.337248 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed572b-f441-4ced-b1e4-82cc25726929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:02.337812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed572b-f441-4ced-b1e4-82cc25726929 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:02.338093 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed572b-f441-4ced-b1e4-82cc25726929 admin admin] PATH_INFO: `/v3/projects/abba8dfb947548778aaf4c35b202fb99` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:02.339319 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed572b-f441-4ced-b1e4-82cc25726929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abba8dfb947548778aaf4c35b202fb99)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:02.341376 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed572b-f441-4ced-b1e4-82cc25726929 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:02.403903 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-beed572b-f441-4ced-b1e4-82cc25726929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abba8dfb947548778aaf4c35b202fb99', 'request_id': 'req-beed572b-f441-4ced-b1e4-82cc25726929'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:02.412929 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-beed572b-f441-4ced-b1e4-82cc25726929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abba8dfb947548778aaf4c35b202fb99', 'request_id': 'req-beed572b-f441-4ced-b1e4-82cc25726929'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:02.421173 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-beed572b-f441-4ced-b1e4-82cc25726929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abba8dfb947548778aaf4c35b202fb99', 'request_id': 'req-beed572b-f441-4ced-b1e4-82cc25726929'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:02.434130 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-beed572b-f441-4ced-b1e4-82cc25726929 admin admin] The token cache is being invalidate because project abba8dfb947548778aaf4c35b202fb99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:05:02.434550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-beed572b-f441-4ced-b1e4-82cc25726929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:02.435343 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-beed572b-f441-4ced-b1e4-82cc25726929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:02.438024 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1248/2498] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:05:02 2021] DELETE /identity/v3/projects/abba8dfb947548778aaf4c35b202fb99 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:05:02.443584 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75df4f-16a5-4a76-84f3-1ec90b142a04 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:02.444107 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75df4f-16a5-4a76-84f3-1ec90b142a04 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:02.444414 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75df4f-16a5-4a76-84f3-1ec90b142a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:02.472949 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-cc75df4f-16a5-4a76-84f3-1ec90b142a04 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:05:02.476845 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-cc75df4f-16a5-4a76-84f3-1ec90b142a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:02.544432 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1251/2499] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:05:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:05:02.552960 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffb0a6-4a1c-4727-9407-00ef892a0ff6 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:02.552960 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffb0a6-4a1c-4727-9407-00ef892a0ff6 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:02.554244 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffb0a6-4a1c-4727-9407-00ef892a0ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:02.571982 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-8cffb0a6-4a1c-4727-9407-00ef892a0ff6 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:05:02.573232 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8cffb0a6-4a1c-4727-9407-00ef892a0ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:02.584895 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1249/2500] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:05:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:05:02.586113 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75df4f-16a5-4a76-84f3-1ec90b142a04 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:02.597308 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75df4f-16a5-4a76-84f3-1ec90b142a04 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:02.603678 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa97377-1803-4c8a-a6de-69bc277a9679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:02.604432 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa97377-1803-4c8a-a6de-69bc277a9679 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:02.604790 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa97377-1803-4c8a-a6de-69bc277a9679 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:02.605231 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa97377-1803-4c8a-a6de-69bc277a9679 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:02.606176 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa97377-1803-4c8a-a6de-69bc277a9679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 03:05:02.606562 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa97377-1803-4c8a-a6de-69bc277a9679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:02.608252 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa97377-1803-4c8a-a6de-69bc277a9679 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:02.621868 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1252/2501] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 03:05:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 03:05:02.626319 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffb0a6-4a1c-4727-9407-00ef892a0ff6 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:02.643051 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffb0a6-4a1c-4727-9407-00ef892a0ff6 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:02.648012 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd755d90-5480-4007-b501-780db021ee56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:02.648676 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd755d90-5480-4007-b501-780db021ee56 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:02.649004 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd755d90-5480-4007-b501-780db021ee56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:02.649601 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd755d90-5480-4007-b501-780db021ee56 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:02.649974 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd755d90-5480-4007-b501-780db021ee56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:02.651897 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd755d90-5480-4007-b501-780db021ee56 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:02.693385 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa97377-1803-4c8a-a6de-69bc277a9679 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:02.693600 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1250/2502] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:05:02 2021] POST /identity/v3/projects => generated 365 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:05:02.715653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa97377-1803-4c8a-a6de-69bc277a9679 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:02.792752 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ca8e3-5c3d-43b2-928f-ab35c8e33b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:02.793480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ca8e3-5c3d-43b2-928f-ab35c8e33b11 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:02.795631 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ca8e3-5c3d-43b2-928f-ab35c8e33b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:02.795631 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ca8e3-5c3d-43b2-928f-ab35c8e33b11 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:02.795631 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ca8e3-5c3d-43b2-928f-ab35c8e33b11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:02.796751 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ca8e3-5c3d-43b2-928f-ab35c8e33b11 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:02.822808 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1253/2503] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:05:02 2021] POST /identity/v3/users => generated 283 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:05:02.824035 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd755d90-5480-4007-b501-780db021ee56 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:02.838873 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd755d90-5480-4007-b501-780db021ee56 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:02.843958 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5e791-6319-4516-b3ae-5ef6f8352232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:02.844918 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5e791-6319-4516-b3ae-5ef6f8352232 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:02.846861 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5e791-6319-4516-b3ae-5ef6f8352232 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:02.846861 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5e791-6319-4516-b3ae-5ef6f8352232 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:02.846861 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5e791-6319-4516-b3ae-5ef6f8352232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:02.848024 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5e791-6319-4516-b3ae-5ef6f8352232 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:02.862148 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1251/2504] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:05:02 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:05:02.863385 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ca8e3-5c3d-43b2-928f-ab35c8e33b11 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:02.876930 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ca8e3-5c3d-43b2-928f-ab35c8e33b11 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:02.884204 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeed9a5-d507-4098-8b57-724c1f7bbaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:02.884911 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeed9a5-d507-4098-8b57-724c1f7bbaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:02.885189 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeed9a5-d507-4098-8b57-724c1f7bbaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:02.885474 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeed9a5-d507-4098-8b57-724c1f7bbaf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:02.886243 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeed9a5-d507-4098-8b57-724c1f7bbaf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:02.887854 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeed9a5-d507-4098-8b57-724c1f7bbaf1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:02.907515 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1254/2505] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:05:02 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:05:02.908386 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5e791-6319-4516-b3ae-5ef6f8352232 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:02.920679 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5e791-6319-4516-b3ae-5ef6f8352232 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:02.925671 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7381bbe-c435-4fa6-8c44-a46b618b034f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:02.926761 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7381bbe-c435-4fa6-8c44-a46b618b034f admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:02.927049 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7381bbe-c435-4fa6-8c44-a46b618b034f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:02.927327 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7381bbe-c435-4fa6-8c44-a46b618b034f admin admin] PATH_INFO: `/v3/projects/a205438640ee4c3fa2963253c6949c37/users/07f86fd7d1f84a9cb4b3fc3a19a7fe4e/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:02.952528 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7381bbe-c435-4fa6-8c44-a46b618b034f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a205438640ee4c3fa2963253c6949c37, user_id=07f86fd7d1f84a9cb4b3fc3a19a7fe4e, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:02.959172 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7381bbe-c435-4fa6-8c44-a46b618b034f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:02.975290 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1252/2506] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:05:02 2021] PUT /identity/v3/projects/a205438640ee4c3fa2963253c6949c37/users/07f86fd7d1f84a9cb4b3fc3a19a7fe4e/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:05:02.985028 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ad46e-c114-4463-a995-b264fcb5033d None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:02.985319 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ad46e-c114-4463-a995-b264fcb5033d None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:02.985603 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ad46e-c114-4463-a995-b264fcb5033d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:03.017423 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-4f4ad46e-c114-4463-a995-b264fcb5033d None None] MFA Rules not processed for user `07f86fd7d1f84a9cb4b3fc3a19a7fe4e`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:05:03.018793 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4f4ad46e-c114-4463-a995-b264fcb5033d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:03.099061 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1255/2507] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:05:02 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:05:03.103369 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7381bbe-c435-4fa6-8c44-a46b618b034f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:03.173246 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7381bbe-c435-4fa6-8c44-a46b618b034f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:03.180637 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230211c-2c84-44b8-b84f-5364003e0a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:03.181337 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230211c-2c84-44b8-b84f-5364003e0a6e admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:03.181618 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230211c-2c84-44b8-b84f-5364003e0a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:03.181892 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230211c-2c84-44b8-b84f-5364003e0a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:03.182713 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230211c-2c84-44b8-b84f-5364003e0a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:03.184764 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230211c-2c84-44b8-b84f-5364003e0a6e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:03.217368 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1253/2508] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:05:03 2021] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:05:03.221783 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ad46e-c114-4463-a995-b264fcb5033d None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:03.233116 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ad46e-c114-4463-a995-b264fcb5033d None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:03.316768 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e2278-8beb-440d-9b73-3ce64446d75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:03.317734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e2278-8beb-440d-9b73-3ce64446d75b admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:03.318280 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e2278-8beb-440d-9b73-3ce64446d75b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:03.318738 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e2278-8beb-440d-9b73-3ce64446d75b admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:03.319447 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e2278-8beb-440d-9b73-3ce64446d75b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:03.321579 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e2278-8beb-440d-9b73-3ce64446d75b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:03.353209 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1256/2509] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:05:03 2021] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:05:03.353899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230211c-2c84-44b8-b84f-5364003e0a6e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:03.371634 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230211c-2c84-44b8-b84f-5364003e0a6e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:03.378926 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398fb4e-ca45-44b1-aa49-cd9d41fdc929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:03.379740 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398fb4e-ca45-44b1-aa49-cd9d41fdc929 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:03.380133 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398fb4e-ca45-44b1-aa49-cd9d41fdc929 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:03.380525 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398fb4e-ca45-44b1-aa49-cd9d41fdc929 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:03.381496 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398fb4e-ca45-44b1-aa49-cd9d41fdc929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:03.383216 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398fb4e-ca45-44b1-aa49-cd9d41fdc929 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:03.398495 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1254/2510] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:05:03 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 03:05:03.399748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e2278-8beb-440d-9b73-3ce64446d75b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:03.410564 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e2278-8beb-440d-9b73-3ce64446d75b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:03.416807 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52d94f-91a4-499b-b3b8-b4932a65c215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:03.417870 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52d94f-91a4-499b-b3b8-b4932a65c215 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:03.418290 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52d94f-91a4-499b-b3b8-b4932a65c215 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:03.419523 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52d94f-91a4-499b-b3b8-b4932a65c215 admin admin] PATH_INFO: `/v3/projects/978d8128fdee44c195080f6d003129e6/users/525a5c41bcc643028c883a0de0940db1/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:03.448272 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52d94f-91a4-499b-b3b8-b4932a65c215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=978d8128fdee44c195080f6d003129e6, user_id=525a5c41bcc643028c883a0de0940db1, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:03.451157 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52d94f-91a4-499b-b3b8-b4932a65c215 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:03.480372 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1257/2511] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:05:03 2021] PUT /identity/v3/projects/978d8128fdee44c195080f6d003129e6/users/525a5c41bcc643028c883a0de0940db1/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:05:03.483843 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398fb4e-ca45-44b1-aa49-cd9d41fdc929 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:03.498056 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398fb4e-ca45-44b1-aa49-cd9d41fdc929 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:03.587653 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5535332-4401-42e2-8dee-5fadf56c887f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:03.588417 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5535332-4401-42e2-8dee-5fadf56c887f admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:03.588795 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5535332-4401-42e2-8dee-5fadf56c887f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:03.589166 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5535332-4401-42e2-8dee-5fadf56c887f admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:03.590520 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5535332-4401-42e2-8dee-5fadf56c887f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:03.592304 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5535332-4401-42e2-8dee-5fadf56c887f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:03.610672 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52d94f-91a4-499b-b3b8-b4932a65c215 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:03.616308 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1255/2512] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:05:03 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:05:03.624356 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52d94f-91a4-499b-b3b8-b4932a65c215 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:03.630039 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d60fc-5d1a-4d73-a8b7-c2abe2daeed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:03.630944 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d60fc-5d1a-4d73-a8b7-c2abe2daeed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:03.631222 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d60fc-5d1a-4d73-a8b7-c2abe2daeed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:03.631642 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d60fc-5d1a-4d73-a8b7-c2abe2daeed0 admin admin] PATH_INFO: `/v3/projects/978d8128fdee44c195080f6d003129e6/users/525a5c41bcc643028c883a0de0940db1/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:03.633783 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d60fc-5d1a-4d73-a8b7-c2abe2daeed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=978d8128fdee44c195080f6d003129e6, user_id=525a5c41bcc643028c883a0de0940db1, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:03.636633 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d60fc-5d1a-4d73-a8b7-c2abe2daeed0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:03.649000 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1258/2513] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:05:03 2021] PUT /identity/v3/projects/978d8128fdee44c195080f6d003129e6/users/525a5c41bcc643028c883a0de0940db1/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:05:03.661000 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a912390-7d99-42d6-bf6f-45c859558b3a None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:03.661291 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a912390-7d99-42d6-bf6f-45c859558b3a None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:03.661568 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a912390-7d99-42d6-bf6f-45c859558b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:03.698957 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-4a912390-7d99-42d6-bf6f-45c859558b3a None None] MFA Rules not processed for user `525a5c41bcc643028c883a0de0940db1`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:05:03.702557 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-4a912390-7d99-42d6-bf6f-45c859558b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:03.790260 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1256/2514] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:05:03 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:05:03.802809 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d60fc-5d1a-4d73-a8b7-c2abe2daeed0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:03.804517 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-546d60fc-5d1a-4d73-a8b7-c2abe2daeed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:03.892375 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d60fc-5d1a-4d73-a8b7-c2abe2daeed0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:03.896414 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa1c87-b794-469b-8cc8-79cf0a5bd7bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:03.897102 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa1c87-b794-469b-8cc8-79cf0a5bd7bf service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:03.897380 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa1c87-b794-469b-8cc8-79cf0a5bd7bf service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:03.897653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa1c87-b794-469b-8cc8-79cf0a5bd7bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:03.908566 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa1c87-b794-469b-8cc8-79cf0a5bd7bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:03.910348 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa1c87-b794-469b-8cc8-79cf0a5bd7bf service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:03.921047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1259/2515] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:05:03 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:05:04.011793 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a912390-7d99-42d6-bf6f-45c859558b3a None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:04.023215 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a912390-7d99-42d6-bf6f-45c859558b3a None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:04.028913 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc543b-eb8b-405f-83d7-ccdade5772fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:04.029673 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc543b-eb8b-405f-83d7-ccdade5772fc service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:04.030031 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc543b-eb8b-405f-83d7-ccdade5772fc service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:04.030873 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc543b-eb8b-405f-83d7-ccdade5772fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:04.099164 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fc543b-eb8b-405f-83d7-ccdade5772fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:04.101035 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fc543b-eb8b-405f-83d7-ccdade5772fc service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:04.111664 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1257/2516] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:05:04 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:05:08.244952 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb29693-ad18-4817-854a-c2706ee6cdc8 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:08.245506 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb29693-ad18-4817-854a-c2706ee6cdc8 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:08.245506 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb29693-ad18-4817-854a-c2706ee6cdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:08.263418 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-3cb29693-ad18-4817-854a-c2706ee6cdc8 None None] MFA Rules not processed for user `19c7ffe94d204879a8fff474d67a5969`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:05:08.264594 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-3cb29693-ad18-4817-854a-c2706ee6cdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:08.317546 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1260/2517] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:05:08 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:05:08.563135 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc543b-eb8b-405f-83d7-ccdade5772fc service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:08.564555 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-57fc543b-eb8b-405f-83d7-ccdade5772fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:08.616601 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc543b-eb8b-405f-83d7-ccdade5772fc service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:08.620193 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7fb4e-89f7-45c7-879a-e7302e5d9f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:08.620817 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7fb4e-89f7-45c7-879a-e7302e5d9f83 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:08.621123 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7fb4e-89f7-45c7-879a-e7302e5d9f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:08.621397 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7fb4e-89f7-45c7-879a-e7302e5d9f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:08.623080 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-53e7fb4e-89f7-45c7-879a-e7302e5d9f83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:08.632666 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7fb4e-89f7-45c7-879a-e7302e5d9f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:08.634113 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7fb4e-89f7-45c7-879a-e7302e5d9f83 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:08.641691 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1258/2518] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:05:08 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:05:08.951974 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb29693-ad18-4817-854a-c2706ee6cdc8 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:08.953388 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-3cb29693-ad18-4817-854a-c2706ee6cdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:09.020801 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb29693-ad18-4817-854a-c2706ee6cdc8 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:09.025866 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b9eda-914a-443d-89d5-677b368fa921 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:09.026538 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b9eda-914a-443d-89d5-677b368fa921 service placement] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:09.026848 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b9eda-914a-443d-89d5-677b368fa921 service placement] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:09.027126 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b9eda-914a-443d-89d5-677b368fa921 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:09.028890 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-de7b9eda-914a-443d-89d5-677b368fa921 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:09.040750 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b9eda-914a-443d-89d5-677b368fa921 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:09.042372 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b9eda-914a-443d-89d5-677b368fa921 service placement] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:09.052550 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1261/2519] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:05:08 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:05:13.158211 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a14a9b-8362-46fc-8070-d2b27e1787ca None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:13.158697 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a14a9b-8362-46fc-8070-d2b27e1787ca None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:13.158805 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a14a9b-8362-46fc-8070-d2b27e1787ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:13.178537 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-c0a14a9b-8362-46fc-8070-d2b27e1787ca None None] MFA Rules not processed for user `a93401007dd64d88af5e41ff08679a28`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:05:13.179738 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c0a14a9b-8362-46fc-8070-d2b27e1787ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:13.233239 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1259/2520] 10.222.0.32 () {58 vars in 1010 bytes} [Wed Sep 15 03:05:13 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:05:13.248494 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b9eda-914a-443d-89d5-677b368fa921 service placement] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:13.251137 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-de7b9eda-914a-443d-89d5-677b368fa921 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:13.328936 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b9eda-914a-443d-89d5-677b368fa921 service placement] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:13.334071 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736b6f9-572b-454d-ae32-9f6d9c24e6c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea510f540b2d47dcb19c8715fd247786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:13.334734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736b6f9-572b-454d-ae32-9f6d9c24e6c1 service swift] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:13.335012 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736b6f9-572b-454d-ae32-9f6d9c24e6c1 service swift] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:13.335287 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736b6f9-572b-454d-ae32-9f6d9c24e6c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:13.343914 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736b6f9-572b-454d-ae32-9f6d9c24e6c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:13.345545 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736b6f9-572b-454d-ae32-9f6d9c24e6c1 service swift] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:13.353974 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1262/2521] 10.222.0.32 () {60 vars in 1385 bytes} [Wed Sep 15 03:05:13 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 03:05:16.583220 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a14a9b-8362-46fc-8070-d2b27e1787ca None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:16.648281 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a14a9b-8362-46fc-8070-d2b27e1787ca None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:16.652929 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd119df7-6436-4bf9-90a8-4649f680c7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:16.653801 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd119df7-6436-4bf9-90a8-4649f680c7a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:16.654084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd119df7-6436-4bf9-90a8-4649f680c7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:16.654359 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd119df7-6436-4bf9-90a8-4649f680c7a5 admin admin] PATH_INFO: `/v3/users/07f86fd7d1f84a9cb4b3fc3a19a7fe4e` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:16.655627 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd119df7-6436-4bf9-90a8-4649f680c7a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07f86fd7d1f84a9cb4b3fc3a19a7fe4e)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:16.657638 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd119df7-6436-4bf9-90a8-4649f680c7a5 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:16.703857 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-fd119df7-6436-4bf9-90a8-4649f680c7a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07f86fd7d1f84a9cb4b3fc3a19a7fe4e'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:16.704504 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-fd119df7-6436-4bf9-90a8-4649f680c7a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07f86fd7d1f84a9cb4b3fc3a19a7fe4e'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:16.713456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-fd119df7-6436-4bf9-90a8-4649f680c7a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07f86fd7d1f84a9cb4b3fc3a19a7fe4e'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:16.714245 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-fd119df7-6436-4bf9-90a8-4649f680c7a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07f86fd7d1f84a9cb4b3fc3a19a7fe4e'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:16.728384 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-fd119df7-6436-4bf9-90a8-4649f680c7a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07f86fd7d1f84a9cb4b3fc3a19a7fe4e'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:16.741221 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1260/2522] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:05:16 2021] DELETE /identity/v3/users/07f86fd7d1f84a9cb4b3fc3a19a7fe4e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:05:16.745994 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df38c5f-5699-4090-8d23-f93d1d9c41e0 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:16.746500 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df38c5f-5699-4090-8d23-f93d1d9c41e0 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:16.746598 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df38c5f-5699-4090-8d23-f93d1d9c41e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:16.765837 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-8df38c5f-5699-4090-8d23-f93d1d9c41e0 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:05:16.767270 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-8df38c5f-5699-4090-8d23-f93d1d9c41e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:16.857383 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1263/2523] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:05:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:05:16.868231 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd119df7-6436-4bf9-90a8-4649f680c7a5 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:16.869703 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-fd119df7-6436-4bf9-90a8-4649f680c7a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:16.924042 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd119df7-6436-4bf9-90a8-4649f680c7a5 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:16.927723 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd7393-f25c-44ca-912a-297c42211bbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:16.928364 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd7393-f25c-44ca-912a-297c42211bbc service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:16.928647 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd7393-f25c-44ca-912a-297c42211bbc service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:16.928947 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd7393-f25c-44ca-912a-297c42211bbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:16.938630 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd7393-f25c-44ca-912a-297c42211bbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:16.940045 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd7393-f25c-44ca-912a-297c42211bbc service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:16.949830 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1261/2524] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:05:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:05:17.261098 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df38c5f-5699-4090-8d23-f93d1d9c41e0 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:17.262543 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-8df38c5f-5699-4090-8d23-f93d1d9c41e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:17.274558 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df38c5f-5699-4090-8d23-f93d1d9c41e0 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:17.279247 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006aab8-1b9e-4dc5-9232-10da1c893f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:17.280245 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006aab8-1b9e-4dc5-9232-10da1c893f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:17.281199 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006aab8-1b9e-4dc5-9232-10da1c893f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:17.281538 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006aab8-1b9e-4dc5-9232-10da1c893f66 admin admin] PATH_INFO: `/v3/projects/a205438640ee4c3fa2963253c6949c37` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:17.282795 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006aab8-1b9e-4dc5-9232-10da1c893f66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a205438640ee4c3fa2963253c6949c37)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:17.284778 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006aab8-1b9e-4dc5-9232-10da1c893f66 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:17.345367 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-9006aab8-1b9e-4dc5-9232-10da1c893f66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a205438640ee4c3fa2963253c6949c37', 'request_id': 'req-9006aab8-1b9e-4dc5-9232-10da1c893f66'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:17.351668 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-9006aab8-1b9e-4dc5-9232-10da1c893f66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a205438640ee4c3fa2963253c6949c37', 'request_id': 'req-9006aab8-1b9e-4dc5-9232-10da1c893f66'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:17.358612 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-9006aab8-1b9e-4dc5-9232-10da1c893f66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a205438640ee4c3fa2963253c6949c37', 'request_id': 'req-9006aab8-1b9e-4dc5-9232-10da1c893f66'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:17.368406 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-9006aab8-1b9e-4dc5-9232-10da1c893f66 admin admin] The token cache is being invalidate because project a205438640ee4c3fa2963253c6949c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:05:17.368694 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-9006aab8-1b9e-4dc5-9232-10da1c893f66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:17.369346 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-9006aab8-1b9e-4dc5-9232-10da1c893f66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:17.370882 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1264/2525] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:05:17 2021] DELETE /identity/v3/projects/a205438640ee4c3fa2963253c6949c37 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:05:17.374929 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd7393-f25c-44ca-912a-297c42211bbc service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:17.385666 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd7393-f25c-44ca-912a-297c42211bbc service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:17.458311 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69313bc7-685e-49b7-81d4-0dcd7d67012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:17.459171 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69313bc7-685e-49b7-81d4-0dcd7d67012e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:17.459448 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69313bc7-685e-49b7-81d4-0dcd7d67012e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:17.459812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69313bc7-685e-49b7-81d4-0dcd7d67012e admin admin] PATH_INFO: `/v3/users/525a5c41bcc643028c883a0de0940db1` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:17.461019 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69313bc7-685e-49b7-81d4-0dcd7d67012e admin admin] RBAC: Authorizing `identity:delete_user(user_id=525a5c41bcc643028c883a0de0940db1)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:17.462939 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69313bc7-685e-49b7-81d4-0dcd7d67012e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:17.533762 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-69313bc7-685e-49b7-81d4-0dcd7d67012e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '525a5c41bcc643028c883a0de0940db1'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:17.534443 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-69313bc7-685e-49b7-81d4-0dcd7d67012e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '525a5c41bcc643028c883a0de0940db1'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:17.541517 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-69313bc7-685e-49b7-81d4-0dcd7d67012e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '525a5c41bcc643028c883a0de0940db1'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:17.542132 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-69313bc7-685e-49b7-81d4-0dcd7d67012e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '525a5c41bcc643028c883a0de0940db1'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:17.553325 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-69313bc7-685e-49b7-81d4-0dcd7d67012e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '525a5c41bcc643028c883a0de0940db1'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:17.565840 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1262/2526] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:05:17 2021] DELETE /identity/v3/users/525a5c41bcc643028c883a0de0940db1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:05:17.863104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006aab8-1b9e-4dc5-9232-10da1c893f66 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:17.863104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-9006aab8-1b9e-4dc5-9232-10da1c893f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:17.875496 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006aab8-1b9e-4dc5-9232-10da1c893f66 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:17.939825 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600a796-d65a-4a21-96bf-996ad5921061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:17.940832 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600a796-d65a-4a21-96bf-996ad5921061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:17.943620 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600a796-d65a-4a21-96bf-996ad5921061 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:17.943620 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600a796-d65a-4a21-96bf-996ad5921061 admin admin] PATH_INFO: `/v3/projects/978d8128fdee44c195080f6d003129e6` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:17.944483 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600a796-d65a-4a21-96bf-996ad5921061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=978d8128fdee44c195080f6d003129e6)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:17.946592 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600a796-d65a-4a21-96bf-996ad5921061 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:18.001044 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d600a796-d65a-4a21-96bf-996ad5921061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '978d8128fdee44c195080f6d003129e6', 'request_id': 'req-d600a796-d65a-4a21-96bf-996ad5921061'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:18.008391 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d600a796-d65a-4a21-96bf-996ad5921061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '978d8128fdee44c195080f6d003129e6', 'request_id': 'req-d600a796-d65a-4a21-96bf-996ad5921061'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:18.019646 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d600a796-d65a-4a21-96bf-996ad5921061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '978d8128fdee44c195080f6d003129e6', 'request_id': 'req-d600a796-d65a-4a21-96bf-996ad5921061'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:18.033120 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d600a796-d65a-4a21-96bf-996ad5921061 admin admin] The token cache is being invalidate because project 978d8128fdee44c195080f6d003129e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:05:18.033443 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d600a796-d65a-4a21-96bf-996ad5921061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:18.034100 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d600a796-d65a-4a21-96bf-996ad5921061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:18.035639 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1265/2527] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:05:17 2021] DELETE /identity/v3/projects/978d8128fdee44c195080f6d003129e6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:05:18.042632 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d7b11-3758-45f0-a005-7f10f5b9639a None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:18.043540 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d7b11-3758-45f0-a005-7f10f5b9639a None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:18.043822 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d7b11-3758-45f0-a005-7f10f5b9639a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:18.062952 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-691d7b11-3758-45f0-a005-7f10f5b9639a None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:05:18.065038 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-691d7b11-3758-45f0-a005-7f10f5b9639a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:18.129937 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1263/2528] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:05:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:05:18.137879 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e6266-47a6-46a1-9977-3730475295bf None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:18.138201 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e6266-47a6-46a1-9977-3730475295bf None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:18.138482 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e6266-47a6-46a1-9977-3730475295bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:18.156154 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-545e6266-47a6-46a1-9977-3730475295bf None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:05:18.157386 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-545e6266-47a6-46a1-9977-3730475295bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:18.165259 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1266/2529] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:05:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:05:18.169123 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d7b11-3758-45f0-a005-7f10f5b9639a None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:18.178979 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d7b11-3758-45f0-a005-7f10f5b9639a None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:18.183504 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe3f5f-556d-4ae9-b4c9-7847325f4a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:18.184146 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe3f5f-556d-4ae9-b4c9-7847325f4a03 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:18.184423 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe3f5f-556d-4ae9-b4c9-7847325f4a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:18.184699 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe3f5f-556d-4ae9-b4c9-7847325f4a03 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:18.185445 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe3f5f-556d-4ae9-b4c9-7847325f4a03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 03:05:18.185749 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe3f5f-556d-4ae9-b4c9-7847325f4a03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:18.188265 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe3f5f-556d-4ae9-b4c9-7847325f4a03 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:18.200124 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1264/2530] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 03:05:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 03:05:18.204428 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e6266-47a6-46a1-9977-3730475295bf None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:18.214846 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e6266-47a6-46a1-9977-3730475295bf None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:18.220344 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904632dc-1e4f-4fb5-aa7e-d0d0bde09746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:18.221092 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904632dc-1e4f-4fb5-aa7e-d0d0bde09746 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:18.221330 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904632dc-1e4f-4fb5-aa7e-d0d0bde09746 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:18.221633 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904632dc-1e4f-4fb5-aa7e-d0d0bde09746 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:18.222375 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904632dc-1e4f-4fb5-aa7e-d0d0bde09746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:18.224374 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904632dc-1e4f-4fb5-aa7e-d0d0bde09746 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:18.250457 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1267/2531] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:05:18 2021] POST /identity/v3/projects => generated 407 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:05:18.254609 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe3f5f-556d-4ae9-b4c9-7847325f4a03 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:18.264227 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe3f5f-556d-4ae9-b4c9-7847325f4a03 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:18.326182 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386842aa-2be3-45fa-9075-136e47baf3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:18.327192 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386842aa-2be3-45fa-9075-136e47baf3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:18.327585 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386842aa-2be3-45fa-9075-136e47baf3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:18.327863 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386842aa-2be3-45fa-9075-136e47baf3e9 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:18.328838 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386842aa-2be3-45fa-9075-136e47baf3e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:18.330804 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386842aa-2be3-45fa-9075-136e47baf3e9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:18.350135 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1265/2532] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:05:18 2021] POST /identity/v3/users => generated 304 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:05:18.354228 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904632dc-1e4f-4fb5-aa7e-d0d0bde09746 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:18.365047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904632dc-1e4f-4fb5-aa7e-d0d0bde09746 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:18.369730 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353d693-ba51-4622-9880-dae45a88c287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:18.370378 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353d693-ba51-4622-9880-dae45a88c287 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:18.370655 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353d693-ba51-4622-9880-dae45a88c287 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:18.370927 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353d693-ba51-4622-9880-dae45a88c287 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:18.371667 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353d693-ba51-4622-9880-dae45a88c287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:18.373340 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353d693-ba51-4622-9880-dae45a88c287 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:18.384177 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1268/2533] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:05:18 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 03:05:18.388945 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386842aa-2be3-45fa-9075-136e47baf3e9 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:18.399650 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386842aa-2be3-45fa-9075-136e47baf3e9 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:18.404400 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261a559-1897-4f06-8af8-66806dcca6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:18.405186 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261a559-1897-4f06-8af8-66806dcca6dd admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:18.409439 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261a559-1897-4f06-8af8-66806dcca6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:18.410407 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261a559-1897-4f06-8af8-66806dcca6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:18.411683 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261a559-1897-4f06-8af8-66806dcca6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:18.413904 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261a559-1897-4f06-8af8-66806dcca6dd admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:18.427772 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1266/2534] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:05:18 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 03:05:18.431948 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353d693-ba51-4622-9880-dae45a88c287 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:18.442667 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353d693-ba51-4622-9880-dae45a88c287 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:18.447290 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1214c-90b9-48b0-a2ae-a649c3a3ff77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:18.448161 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1214c-90b9-48b0-a2ae-a649c3a3ff77 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:18.448442 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1214c-90b9-48b0-a2ae-a649c3a3ff77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:18.448716 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1214c-90b9-48b0-a2ae-a649c3a3ff77 admin admin] PATH_INFO: `/v3/projects/637f324469cb4646acd212b0bb4eb973/users/3438ddc8e2bf459fb4701cbc0bd86c1d/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:18.462477 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1214c-90b9-48b0-a2ae-a649c3a3ff77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=637f324469cb4646acd212b0bb4eb973, user_id=3438ddc8e2bf459fb4701cbc0bd86c1d, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:18.465143 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1214c-90b9-48b0-a2ae-a649c3a3ff77 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:18.480522 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1269/2535] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:05:18 2021] PUT /identity/v3/projects/637f324469cb4646acd212b0bb4eb973/users/3438ddc8e2bf459fb4701cbc0bd86c1d/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:05:18.492612 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a0a3a-be83-4129-bdbd-6a90519ee94a None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:18.493242 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a0a3a-be83-4129-bdbd-6a90519ee94a None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:18.493550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a0a3a-be83-4129-bdbd-6a90519ee94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:18.522052 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-6a5a0a3a-be83-4129-bdbd-6a90519ee94a None None] MFA Rules not processed for user `3438ddc8e2bf459fb4701cbc0bd86c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:05:18.523394 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-6a5a0a3a-be83-4129-bdbd-6a90519ee94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:18.587409 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1267/2536] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:05:18 2021] POST /identity/v3/auth/tokens => generated 3427 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:05:18.591823 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1214c-90b9-48b0-a2ae-a649c3a3ff77 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:18.652163 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1214c-90b9-48b0-a2ae-a649c3a3ff77 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:18.657501 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db2be2-d3ab-4f78-a792-2dc48756dc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:18.658155 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db2be2-d3ab-4f78-a792-2dc48756dc59 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:18.658435 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db2be2-d3ab-4f78-a792-2dc48756dc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:18.658711 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db2be2-d3ab-4f78-a792-2dc48756dc59 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:18.659389 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db2be2-d3ab-4f78-a792-2dc48756dc59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:18.661320 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db2be2-d3ab-4f78-a792-2dc48756dc59 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:18.685629 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1270/2537] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:05:18 2021] POST /identity/v3/projects => generated 407 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:05:18.689974 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a0a3a-be83-4129-bdbd-6a90519ee94a None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:18.702397 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a0a3a-be83-4129-bdbd-6a90519ee94a None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:18.761244 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa7281-4475-4b3b-a850-607b7bba13f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:18.761942 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa7281-4475-4b3b-a850-607b7bba13f0 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:18.762227 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa7281-4475-4b3b-a850-607b7bba13f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:18.762497 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa7281-4475-4b3b-a850-607b7bba13f0 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:18.763183 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa7281-4475-4b3b-a850-607b7bba13f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:18.765136 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa7281-4475-4b3b-a850-607b7bba13f0 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:18.784672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1268/2538] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:05:18 2021] POST /identity/v3/users => generated 310 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:05:18.788773 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db2be2-d3ab-4f78-a792-2dc48756dc59 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:18.800169 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db2be2-d3ab-4f78-a792-2dc48756dc59 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:18.805112 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d880e-ca4f-4473-a7a3-2fd59ef1acbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:18.805797 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d880e-ca4f-4473-a7a3-2fd59ef1acbf admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:18.806083 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d880e-ca4f-4473-a7a3-2fd59ef1acbf admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:18.806360 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d880e-ca4f-4473-a7a3-2fd59ef1acbf admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:18.807094 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d880e-ca4f-4473-a7a3-2fd59ef1acbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:18.808713 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d880e-ca4f-4473-a7a3-2fd59ef1acbf admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:18.820464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1271/2539] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:05:18 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:05:18.824706 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa7281-4475-4b3b-a850-607b7bba13f0 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:18.835078 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa7281-4475-4b3b-a850-607b7bba13f0 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:18.839760 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202d5e3-3927-4ba7-8025-b8121ce1615d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:18.840623 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202d5e3-3927-4ba7-8025-b8121ce1615d admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:18.840926 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202d5e3-3927-4ba7-8025-b8121ce1615d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:18.841199 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202d5e3-3927-4ba7-8025-b8121ce1615d admin admin] PATH_INFO: `/v3/projects/8c611155a26c4b9ea488b07d8cd2b420/users/ea2ed4e5db1d49f09e70beae104b78cf/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:18.855826 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202d5e3-3927-4ba7-8025-b8121ce1615d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c611155a26c4b9ea488b07d8cd2b420, user_id=ea2ed4e5db1d49f09e70beae104b78cf, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:18.858622 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202d5e3-3927-4ba7-8025-b8121ce1615d admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:18.871428 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1269/2540] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:05:18 2021] PUT /identity/v3/projects/8c611155a26c4b9ea488b07d8cd2b420/users/ea2ed4e5db1d49f09e70beae104b78cf/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:05:18.875286 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d880e-ca4f-4473-a7a3-2fd59ef1acbf admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:18.885567 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d880e-ca4f-4473-a7a3-2fd59ef1acbf admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:18.942912 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951666d0-5fa7-4bac-b23b-915152dee8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:18.943578 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951666d0-5fa7-4bac-b23b-915152dee8cf admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:18.943860 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951666d0-5fa7-4bac-b23b-915152dee8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:18.944142 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951666d0-5fa7-4bac-b23b-915152dee8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:18.944861 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951666d0-5fa7-4bac-b23b-915152dee8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:18.946611 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951666d0-5fa7-4bac-b23b-915152dee8cf admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:18.956522 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1272/2541] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:05:18 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 03:05:18.960648 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202d5e3-3927-4ba7-8025-b8121ce1615d admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:18.971381 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202d5e3-3927-4ba7-8025-b8121ce1615d admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:18.976012 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f125d-9346-4006-9023-32f159d60508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:18.976900 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f125d-9346-4006-9023-32f159d60508 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:18.977185 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f125d-9346-4006-9023-32f159d60508 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:18.977462 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f125d-9346-4006-9023-32f159d60508 admin admin] PATH_INFO: `/v3/projects/8c611155a26c4b9ea488b07d8cd2b420/users/ea2ed4e5db1d49f09e70beae104b78cf/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:18.979398 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f125d-9346-4006-9023-32f159d60508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c611155a26c4b9ea488b07d8cd2b420, user_id=ea2ed4e5db1d49f09e70beae104b78cf, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:18.982047 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f125d-9346-4006-9023-32f159d60508 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:18.992841 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1270/2542] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:05:18 2021] PUT /identity/v3/projects/8c611155a26c4b9ea488b07d8cd2b420/users/ea2ed4e5db1d49f09e70beae104b78cf/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:05:19.002656 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852a8b0-d546-45c8-9b95-b37374597abc None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:19.002946 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852a8b0-d546-45c8-9b95-b37374597abc None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:19.003229 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852a8b0-d546-45c8-9b95-b37374597abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:19.037264 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-e852a8b0-d546-45c8-9b95-b37374597abc None None] MFA Rules not processed for user `ea2ed4e5db1d49f09e70beae104b78cf`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:05:19.038401 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-e852a8b0-d546-45c8-9b95-b37374597abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:19.116203 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1273/2543] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:05:19 2021] POST /identity/v3/auth/tokens => generated 3494 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:05:19.127080 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f125d-9346-4006-9023-32f159d60508 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:19.129642 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-574f125d-9346-4006-9023-32f159d60508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:19.212177 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f125d-9346-4006-9023-32f159d60508 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:19.218352 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba064b0-c05a-41d7-a203-f9b78ff6cdb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:19.219115 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba064b0-c05a-41d7-a203-f9b78ff6cdb7 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:19.219471 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba064b0-c05a-41d7-a203-f9b78ff6cdb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:19.219749 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba064b0-c05a-41d7-a203-f9b78ff6cdb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:19.229407 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba064b0-c05a-41d7-a203-f9b78ff6cdb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:19.230880 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba064b0-c05a-41d7-a203-f9b78ff6cdb7 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:19.240579 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1271/2544] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:05:19 2021] GET /identity/v3/auth/tokens => generated 3494 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:05:19.378254 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852a8b0-d546-45c8-9b95-b37374597abc None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:19.389015 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852a8b0-d546-45c8-9b95-b37374597abc None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:19.393586 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf45952-181d-4bbb-b8e2-7b03897a54d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:19.394326 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf45952-181d-4bbb-b8e2-7b03897a54d3 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:19.394645 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf45952-181d-4bbb-b8e2-7b03897a54d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:19.394975 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf45952-181d-4bbb-b8e2-7b03897a54d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:19.465581 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf45952-181d-4bbb-b8e2-7b03897a54d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:19.467280 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf45952-181d-4bbb-b8e2-7b03897a54d3 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:19.476615 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1274/2545] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:05:19 2021] GET /identity/v3/auth/tokens => generated 3427 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:05:32.707897 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba064b0-c05a-41d7-a203-f9b78ff6cdb7 service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:32.709320 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-3ba064b0-c05a-41d7-a203-f9b78ff6cdb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:32.794006 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba064b0-c05a-41d7-a203-f9b78ff6cdb7 service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:32.801072 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bf21c-6e55-4594-ab04-c45f4137a788 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:32.802078 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bf21c-6e55-4594-ab04-c45f4137a788 service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:32.802528 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bf21c-6e55-4594-ab04-c45f4137a788 service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:32.803108 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bf21c-6e55-4594-ab04-c45f4137a788 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:32.805441 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-368bf21c-6e55-4594-ab04-c45f4137a788 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:32.822857 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bf21c-6e55-4594-ab04-c45f4137a788 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:32.824664 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bf21c-6e55-4594-ab04-c45f4137a788 service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:32.837962 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1272/2546] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:05:32 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 03:05:34.923968 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf45952-181d-4bbb-b8e2-7b03897a54d3 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:34.982114 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf45952-181d-4bbb-b8e2-7b03897a54d3 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:34.987258 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857c5cf-316c-460a-b4a1-0a85b10a19ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:34.988115 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857c5cf-316c-460a-b4a1-0a85b10a19ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:34.988397 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857c5cf-316c-460a-b4a1-0a85b10a19ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:34.988670 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857c5cf-316c-460a-b4a1-0a85b10a19ec admin admin] PATH_INFO: `/v3/users/3438ddc8e2bf459fb4701cbc0bd86c1d` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:34.989865 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857c5cf-316c-460a-b4a1-0a85b10a19ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3438ddc8e2bf459fb4701cbc0bd86c1d)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:34.991777 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857c5cf-316c-460a-b4a1-0a85b10a19ec admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:35.034646 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8857c5cf-316c-460a-b4a1-0a85b10a19ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3438ddc8e2bf459fb4701cbc0bd86c1d'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:35.045438 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8857c5cf-316c-460a-b4a1-0a85b10a19ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3438ddc8e2bf459fb4701cbc0bd86c1d'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:35.046078 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8857c5cf-316c-460a-b4a1-0a85b10a19ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3438ddc8e2bf459fb4701cbc0bd86c1d'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:35.052711 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8857c5cf-316c-460a-b4a1-0a85b10a19ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3438ddc8e2bf459fb4701cbc0bd86c1d'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:35.059104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-8857c5cf-316c-460a-b4a1-0a85b10a19ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3438ddc8e2bf459fb4701cbc0bd86c1d'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:35.065017 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1275/2547] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:05:34 2021] DELETE /identity/v3/users/3438ddc8e2bf459fb4701cbc0bd86c1d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:05:35.069452 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a23b3-66c6-468d-9175-c64c82cf9ea6 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:35.069939 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a23b3-66c6-468d-9175-c64c82cf9ea6 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:35.070032 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a23b3-66c6-468d-9175-c64c82cf9ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:35.086645 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-e42a23b3-66c6-468d-9175-c64c82cf9ea6 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:05:35.088038 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e42a23b3-66c6-468d-9175-c64c82cf9ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:35.143114 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1273/2548] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:05:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:05:35.152734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857c5cf-316c-460a-b4a1-0a85b10a19ec admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:35.154147 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-8857c5cf-316c-460a-b4a1-0a85b10a19ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:35.207584 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857c5cf-316c-460a-b4a1-0a85b10a19ec admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:35.211194 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8dc1e-70db-4278-925d-6928e130426f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:35.211821 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8dc1e-70db-4278-925d-6928e130426f service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:35.212101 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8dc1e-70db-4278-925d-6928e130426f service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:35.212378 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8dc1e-70db-4278-925d-6928e130426f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:35.221562 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8dc1e-70db-4278-925d-6928e130426f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:35.222971 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8dc1e-70db-4278-925d-6928e130426f service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:35.231924 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1276/2549] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:05:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:05:35.576002 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a23b3-66c6-468d-9175-c64c82cf9ea6 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:35.577454 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e42a23b3-66c6-468d-9175-c64c82cf9ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:35.590316 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a23b3-66c6-468d-9175-c64c82cf9ea6 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:35.595807 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef5cb3-61b7-4087-8d3d-aceb8a276fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:35.596713 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef5cb3-61b7-4087-8d3d-aceb8a276fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:35.596976 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef5cb3-61b7-4087-8d3d-aceb8a276fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:35.597251 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef5cb3-61b7-4087-8d3d-aceb8a276fa4 admin admin] PATH_INFO: `/v3/projects/637f324469cb4646acd212b0bb4eb973` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:35.598954 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef5cb3-61b7-4087-8d3d-aceb8a276fa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=637f324469cb4646acd212b0bb4eb973)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:35.601031 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adef5cb3-61b7-4087-8d3d-aceb8a276fa4 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:35.650458 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-adef5cb3-61b7-4087-8d3d-aceb8a276fa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '637f324469cb4646acd212b0bb4eb973', 'request_id': 'req-adef5cb3-61b7-4087-8d3d-aceb8a276fa4'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:35.658521 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-adef5cb3-61b7-4087-8d3d-aceb8a276fa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '637f324469cb4646acd212b0bb4eb973', 'request_id': 'req-adef5cb3-61b7-4087-8d3d-aceb8a276fa4'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:35.663752 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-adef5cb3-61b7-4087-8d3d-aceb8a276fa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '637f324469cb4646acd212b0bb4eb973', 'request_id': 'req-adef5cb3-61b7-4087-8d3d-aceb8a276fa4'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:35.674382 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-adef5cb3-61b7-4087-8d3d-aceb8a276fa4 admin admin] The token cache is being invalidate because project 637f324469cb4646acd212b0bb4eb973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:05:35.674670 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-adef5cb3-61b7-4087-8d3d-aceb8a276fa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:35.675292 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-adef5cb3-61b7-4087-8d3d-aceb8a276fa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:35.676806 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1274/2550] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:05:35 2021] DELETE /identity/v3/projects/637f324469cb4646acd212b0bb4eb973 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:05:35.680683 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8dc1e-70db-4278-925d-6928e130426f service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:35.690647 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8dc1e-70db-4278-925d-6928e130426f service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:35.743954 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e27d5-d89d-4da5-862c-ae9710224291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:35.744804 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e27d5-d89d-4da5-862c-ae9710224291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:35.745109 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e27d5-d89d-4da5-862c-ae9710224291 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:35.745379 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e27d5-d89d-4da5-862c-ae9710224291 admin admin] PATH_INFO: `/v3/users/ea2ed4e5db1d49f09e70beae104b78cf` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:35.746549 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e27d5-d89d-4da5-862c-ae9710224291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2ed4e5db1d49f09e70beae104b78cf)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:35.748438 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e27d5-d89d-4da5-862c-ae9710224291 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:35.791498 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-488e27d5-d89d-4da5-862c-ae9710224291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2ed4e5db1d49f09e70beae104b78cf'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:35.802780 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-488e27d5-d89d-4da5-862c-ae9710224291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2ed4e5db1d49f09e70beae104b78cf'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:35.803433 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-488e27d5-d89d-4da5-862c-ae9710224291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2ed4e5db1d49f09e70beae104b78cf'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:35.810367 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-488e27d5-d89d-4da5-862c-ae9710224291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2ed4e5db1d49f09e70beae104b78cf'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:35.817852 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-488e27d5-d89d-4da5-862c-ae9710224291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2ed4e5db1d49f09e70beae104b78cf'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:35.823753 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1277/2551] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:05:35 2021] DELETE /identity/v3/users/ea2ed4e5db1d49f09e70beae104b78cf => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:05:36.091531 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef5cb3-61b7-4087-8d3d-aceb8a276fa4 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:36.093032 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-adef5cb3-61b7-4087-8d3d-aceb8a276fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:36.107942 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef5cb3-61b7-4087-8d3d-aceb8a276fa4 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:36.165147 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65118802-41ae-400b-9cc1-b63761a25f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:36.166085 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65118802-41ae-400b-9cc1-b63761a25f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:36.166374 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65118802-41ae-400b-9cc1-b63761a25f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:36.166654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65118802-41ae-400b-9cc1-b63761a25f1a admin admin] PATH_INFO: `/v3/projects/8c611155a26c4b9ea488b07d8cd2b420` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:36.167912 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65118802-41ae-400b-9cc1-b63761a25f1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c611155a26c4b9ea488b07d8cd2b420)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:36.169853 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65118802-41ae-400b-9cc1-b63761a25f1a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:36.215511 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-65118802-41ae-400b-9cc1-b63761a25f1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c611155a26c4b9ea488b07d8cd2b420', 'request_id': 'req-65118802-41ae-400b-9cc1-b63761a25f1a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:36.222375 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-65118802-41ae-400b-9cc1-b63761a25f1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c611155a26c4b9ea488b07d8cd2b420', 'request_id': 'req-65118802-41ae-400b-9cc1-b63761a25f1a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:36.227518 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-65118802-41ae-400b-9cc1-b63761a25f1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c611155a26c4b9ea488b07d8cd2b420', 'request_id': 'req-65118802-41ae-400b-9cc1-b63761a25f1a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:36.238391 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-65118802-41ae-400b-9cc1-b63761a25f1a admin admin] The token cache is being invalidate because project 8c611155a26c4b9ea488b07d8cd2b420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:05:36.238676 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-65118802-41ae-400b-9cc1-b63761a25f1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:36.239304 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-65118802-41ae-400b-9cc1-b63761a25f1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:36.241302 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1275/2552] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:05:36 2021] DELETE /identity/v3/projects/8c611155a26c4b9ea488b07d8cd2b420 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:05:36.248394 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c300c4-639c-46e4-a021-81f57d1f4811 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:36.248917 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c300c4-639c-46e4-a021-81f57d1f4811 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:36.249128 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c300c4-639c-46e4-a021-81f57d1f4811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:36.266595 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-21c300c4-639c-46e4-a021-81f57d1f4811 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:05:36.267789 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-21c300c4-639c-46e4-a021-81f57d1f4811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:36.329032 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1278/2553] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:05:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:05:36.338134 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c38fb-1c2f-490b-b99a-fbb7044aef59 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:36.338289 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c38fb-1c2f-490b-b99a-fbb7044aef59 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:36.338579 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c38fb-1c2f-490b-b99a-fbb7044aef59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:36.356893 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-784c38fb-1c2f-490b-b99a-fbb7044aef59 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:05:36.358104 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-784c38fb-1c2f-490b-b99a-fbb7044aef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:36.366618 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1276/2554] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:05:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:05:36.370822 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c300c4-639c-46e4-a021-81f57d1f4811 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:36.380783 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c300c4-639c-46e4-a021-81f57d1f4811 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:36.385436 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4017c32-757f-47a5-a254-69bee69f59cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:36.386198 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4017c32-757f-47a5-a254-69bee69f59cc admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:36.386571 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4017c32-757f-47a5-a254-69bee69f59cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:36.386975 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4017c32-757f-47a5-a254-69bee69f59cc admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:36.387848 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4017c32-757f-47a5-a254-69bee69f59cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 03:05:36.388249 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4017c32-757f-47a5-a254-69bee69f59cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:36.389973 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4017c32-757f-47a5-a254-69bee69f59cc admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:36.402431 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1279/2555] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 03:05:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 03:05:36.407111 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c38fb-1c2f-490b-b99a-fbb7044aef59 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:36.416024 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c38fb-1c2f-490b-b99a-fbb7044aef59 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:36.420992 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65005f10-64aa-47f2-a4fd-a28246748a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:36.421793 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65005f10-64aa-47f2-a4fd-a28246748a70 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:36.421960 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65005f10-64aa-47f2-a4fd-a28246748a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:36.422832 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65005f10-64aa-47f2-a4fd-a28246748a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:36.423612 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65005f10-64aa-47f2-a4fd-a28246748a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:36.425520 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65005f10-64aa-47f2-a4fd-a28246748a70 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:36.452351 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1277/2556] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:05:36 2021] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:05:36.456779 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4017c32-757f-47a5-a254-69bee69f59cc admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:36.471320 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4017c32-757f-47a5-a254-69bee69f59cc admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:36.528999 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72b57b-048f-42a5-aecf-34ba156b6cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:36.529885 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72b57b-048f-42a5-aecf-34ba156b6cde admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:36.529980 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72b57b-048f-42a5-aecf-34ba156b6cde admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:36.530220 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72b57b-048f-42a5-aecf-34ba156b6cde admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:36.531013 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72b57b-048f-42a5-aecf-34ba156b6cde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:36.533360 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72b57b-048f-42a5-aecf-34ba156b6cde admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:36.553863 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1280/2557] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:05:36 2021] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:05:36.557833 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65005f10-64aa-47f2-a4fd-a28246748a70 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:36.568213 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65005f10-64aa-47f2-a4fd-a28246748a70 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:36.573390 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03587aef-c7dd-46be-9281-08afbd47cc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:36.574116 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03587aef-c7dd-46be-9281-08afbd47cc64 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:36.574464 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03587aef-c7dd-46be-9281-08afbd47cc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:36.574805 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03587aef-c7dd-46be-9281-08afbd47cc64 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:36.575592 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03587aef-c7dd-46be-9281-08afbd47cc64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:36.577191 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03587aef-c7dd-46be-9281-08afbd47cc64 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:36.588358 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1278/2558] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:05:36 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 03:05:36.592170 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72b57b-048f-42a5-aecf-34ba156b6cde admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:36.602484 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72b57b-048f-42a5-aecf-34ba156b6cde admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:36.607375 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc571684-ee20-4b2f-a3d0-3589b432f8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:36.608111 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc571684-ee20-4b2f-a3d0-3589b432f8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:36.608409 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc571684-ee20-4b2f-a3d0-3589b432f8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:36.608682 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc571684-ee20-4b2f-a3d0-3589b432f8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:36.609476 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc571684-ee20-4b2f-a3d0-3589b432f8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:36.611645 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc571684-ee20-4b2f-a3d0-3589b432f8e7 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:36.621303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1281/2559] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:05:36 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:05:36.625201 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03587aef-c7dd-46be-9281-08afbd47cc64 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:36.634917 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03587aef-c7dd-46be-9281-08afbd47cc64 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:36.639526 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e08c57-4a62-4303-89e7-e2869266a768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:36.640387 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e08c57-4a62-4303-89e7-e2869266a768 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:36.640672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e08c57-4a62-4303-89e7-e2869266a768 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:36.640987 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e08c57-4a62-4303-89e7-e2869266a768 admin admin] PATH_INFO: `/v3/projects/b897f6e279664115bd7ab5c443598a50/users/4bfe539b3a124f40b7f0e46a2f9213d1/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:36.654663 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e08c57-4a62-4303-89e7-e2869266a768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b897f6e279664115bd7ab5c443598a50, user_id=4bfe539b3a124f40b7f0e46a2f9213d1, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:36.657815 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e08c57-4a62-4303-89e7-e2869266a768 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:36.669887 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1279/2560] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:05:36 2021] PUT /identity/v3/projects/b897f6e279664115bd7ab5c443598a50/users/4bfe539b3a124f40b7f0e46a2f9213d1/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:05:36.680502 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69712c-8c50-4227-af0a-856d04ffe01b None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:36.680788 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69712c-8c50-4227-af0a-856d04ffe01b None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:36.681091 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69712c-8c50-4227-af0a-856d04ffe01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:36.708132 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-ad69712c-8c50-4227-af0a-856d04ffe01b None None] MFA Rules not processed for user `4bfe539b3a124f40b7f0e46a2f9213d1`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:05:36.709497 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ad69712c-8c50-4227-af0a-856d04ffe01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:36.770958 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1282/2561] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:05:36 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:05:36.780571 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e08c57-4a62-4303-89e7-e2869266a768 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:36.782809 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-f4e08c57-4a62-4303-89e7-e2869266a768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:36.837222 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e08c57-4a62-4303-89e7-e2869266a768 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:36.840907 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bea2a0-cd3d-4da2-b298-682f950e25cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:36.841561 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bea2a0-cd3d-4da2-b298-682f950e25cb service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:36.841843 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bea2a0-cd3d-4da2-b298-682f950e25cb service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:36.842118 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bea2a0-cd3d-4da2-b298-682f950e25cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:36.850665 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bea2a0-cd3d-4da2-b298-682f950e25cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:36.852071 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bea2a0-cd3d-4da2-b298-682f950e25cb service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:36.860633 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1280/2562] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:05:36 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:05:38.341161 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69712c-8c50-4227-af0a-856d04ffe01b None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:38.342694 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ad69712c-8c50-4227-af0a-856d04ffe01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:38.420152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69712c-8c50-4227-af0a-856d04ffe01b None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:38.426528 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676a950-2dca-44e9-871d-b3b58d9f2cda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:38.427174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676a950-2dca-44e9-871d-b3b58d9f2cda service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:38.427459 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676a950-2dca-44e9-871d-b3b58d9f2cda service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:38.427744 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676a950-2dca-44e9-871d-b3b58d9f2cda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:38.429512 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b676a950-2dca-44e9-871d-b3b58d9f2cda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:38.442470 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676a950-2dca-44e9-871d-b3b58d9f2cda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:38.444047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676a950-2dca-44e9-871d-b3b58d9f2cda service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:38.454490 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1283/2563] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:05:38 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:05:39.823822 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bea2a0-cd3d-4da2-b298-682f950e25cb service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:39.883947 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bea2a0-cd3d-4da2-b298-682f950e25cb service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:39.888527 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068af12f-386e-4921-a3e1-75541c29ae24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:39.889423 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068af12f-386e-4921-a3e1-75541c29ae24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:39.889704 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068af12f-386e-4921-a3e1-75541c29ae24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:39.889980 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068af12f-386e-4921-a3e1-75541c29ae24 admin admin] PATH_INFO: `/v3/users/4bfe539b3a124f40b7f0e46a2f9213d1` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:39.891188 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068af12f-386e-4921-a3e1-75541c29ae24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bfe539b3a124f40b7f0e46a2f9213d1)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:39.893178 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068af12f-386e-4921-a3e1-75541c29ae24 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:39.938344 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-068af12f-386e-4921-a3e1-75541c29ae24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bfe539b3a124f40b7f0e46a2f9213d1'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:39.939192 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-068af12f-386e-4921-a3e1-75541c29ae24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bfe539b3a124f40b7f0e46a2f9213d1'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:39.946759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-068af12f-386e-4921-a3e1-75541c29ae24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bfe539b3a124f40b7f0e46a2f9213d1'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:39.947526 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-068af12f-386e-4921-a3e1-75541c29ae24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bfe539b3a124f40b7f0e46a2f9213d1'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:39.959477 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-068af12f-386e-4921-a3e1-75541c29ae24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bfe539b3a124f40b7f0e46a2f9213d1'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:39.971514 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1281/2564] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:05:39 2021] DELETE /identity/v3/users/4bfe539b3a124f40b7f0e46a2f9213d1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:05:39.975907 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632d3f2-d219-4457-b3fc-5f044349a24e None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:39.976409 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632d3f2-d219-4457-b3fc-5f044349a24e None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:39.976506 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632d3f2-d219-4457-b3fc-5f044349a24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:39.993635 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-2632d3f2-d219-4457-b3fc-5f044349a24e None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:05:39.994826 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-2632d3f2-d219-4457-b3fc-5f044349a24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:40.052459 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1284/2565] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:05:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:05:40.062330 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068af12f-386e-4921-a3e1-75541c29ae24 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:40.064332 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-068af12f-386e-4921-a3e1-75541c29ae24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:40.119135 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068af12f-386e-4921-a3e1-75541c29ae24 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:40.123006 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5b150-85e4-4991-b26f-af073c7d0b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:40.123650 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5b150-85e4-4991-b26f-af073c7d0b6f service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:40.123932 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5b150-85e4-4991-b26f-af073c7d0b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:40.124210 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5b150-85e4-4991-b26f-af073c7d0b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:40.133638 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e5b150-85e4-4991-b26f-af073c7d0b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:40.135049 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e5b150-85e4-4991-b26f-af073c7d0b6f service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:40.144327 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1282/2566] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:05:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:05:40.418988 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632d3f2-d219-4457-b3fc-5f044349a24e None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:40.420491 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-2632d3f2-d219-4457-b3fc-5f044349a24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:40.433714 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632d3f2-d219-4457-b3fc-5f044349a24e None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:40.438789 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb74e1-534e-4255-ac20-f401bae2e1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:40.439649 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb74e1-534e-4255-ac20-f401bae2e1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:40.439930 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb74e1-534e-4255-ac20-f401bae2e1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:40.440225 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb74e1-534e-4255-ac20-f401bae2e1b3 admin admin] PATH_INFO: `/v3/projects/b897f6e279664115bd7ab5c443598a50` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:40.441504 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb74e1-534e-4255-ac20-f401bae2e1b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b897f6e279664115bd7ab5c443598a50)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:40.443402 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb74e1-534e-4255-ac20-f401bae2e1b3 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:40.488666 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5fdb74e1-534e-4255-ac20-f401bae2e1b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b897f6e279664115bd7ab5c443598a50', 'request_id': 'req-5fdb74e1-534e-4255-ac20-f401bae2e1b3'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:40.494589 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5fdb74e1-534e-4255-ac20-f401bae2e1b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b897f6e279664115bd7ab5c443598a50', 'request_id': 'req-5fdb74e1-534e-4255-ac20-f401bae2e1b3'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:40.502201 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5fdb74e1-534e-4255-ac20-f401bae2e1b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b897f6e279664115bd7ab5c443598a50', 'request_id': 'req-5fdb74e1-534e-4255-ac20-f401bae2e1b3'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:40.512831 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5fdb74e1-534e-4255-ac20-f401bae2e1b3 admin admin] The token cache is being invalidate because project b897f6e279664115bd7ab5c443598a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:05:40.513145 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5fdb74e1-534e-4255-ac20-f401bae2e1b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:40.513774 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5fdb74e1-534e-4255-ac20-f401bae2e1b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:05:40.515303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1285/2567] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:05:40 2021] DELETE /identity/v3/projects/b897f6e279664115bd7ab5c443598a50 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:05:51.141455 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5b150-85e4-4991-b26f-af073c7d0b6f service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:51.142898 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-67e5b150-85e4-4991-b26f-af073c7d0b6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:51.153789 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5b150-85e4-4991-b26f-af073c7d0b6f service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:51.201284 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be528fc-85cd-4afa-9ed3-282a56092303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:51.201929 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be528fc-85cd-4afa-9ed3-282a56092303 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:51.202206 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be528fc-85cd-4afa-9ed3-282a56092303 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:51.202478 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be528fc-85cd-4afa-9ed3-282a56092303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:51.204253 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-0be528fc-85cd-4afa-9ed3-282a56092303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:51.263133 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be528fc-85cd-4afa-9ed3-282a56092303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:51.264546 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be528fc-85cd-4afa-9ed3-282a56092303 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:51.273654 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1283/2568] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:05:51 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:05:53.049371 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb74e1-534e-4255-ac20-f401bae2e1b3 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:05:53.050974 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-5fdb74e1-534e-4255-ac20-f401bae2e1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:53.130160 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb74e1-534e-4255-ac20-f401bae2e1b3 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:05:53.136324 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a9f0e-dc68-4923-88c8-97005a64ee5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:05:53.137251 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a9f0e-dc68-4923-88c8-97005a64ee5a service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:05:53.137686 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a9f0e-dc68-4923-88c8-97005a64ee5a service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:05:53.138283 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a9f0e-dc68-4923-88c8-97005a64ee5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:05:53.140394 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-997a9f0e-dc68-4923-88c8-97005a64ee5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:05:53.153151 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a9f0e-dc68-4923-88c8-97005a64ee5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:05:53.154734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a9f0e-dc68-4923-88c8-97005a64ee5a service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:05:53.166976 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1286/2569] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:05:53 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:06:05.847305 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be528fc-85cd-4afa-9ed3-282a56092303 service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:06:05.848717 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-0be528fc-85cd-4afa-9ed3-282a56092303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:06:05.869225 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be528fc-85cd-4afa-9ed3-282a56092303 service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:06:05.872911 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e997d6-2af1-4567-9f84-6555a7deced8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:06:05.873552 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e997d6-2af1-4567-9f84-6555a7deced8 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:06:05.873851 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e997d6-2af1-4567-9f84-6555a7deced8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:06:05.874131 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e997d6-2af1-4567-9f84-6555a7deced8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:06:05.875824 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-53e997d6-2af1-4567-9f84-6555a7deced8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:06:05.885118 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e997d6-2af1-4567-9f84-6555a7deced8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:06:05.886516 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e997d6-2af1-4567-9f84-6555a7deced8 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:06:05.894185 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1284/2570] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:06:05 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:06:08.977525 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a9f0e-dc68-4923-88c8-97005a64ee5a service nova] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:06:08.979419 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-997a9f0e-dc68-4923-88c8-97005a64ee5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:06:09.034277 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a9f0e-dc68-4923-88c8-97005a64ee5a service nova] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:06:09.037899 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91510dbb-6cb9-4699-8228-a48c4231f22b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:06:09.038535 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91510dbb-6cb9-4699-8228-a48c4231f22b service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:06:09.038812 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91510dbb-6cb9-4699-8228-a48c4231f22b service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:06:09.039083 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91510dbb-6cb9-4699-8228-a48c4231f22b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:06:09.040810 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-91510dbb-6cb9-4699-8228-a48c4231f22b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:06:09.103570 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91510dbb-6cb9-4699-8228-a48c4231f22b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:06:09.105000 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91510dbb-6cb9-4699-8228-a48c4231f22b service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:06:09.122185 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1287/2571] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:06:08 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:07:25.469981 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb5144-bd87-429e-a3ed-9b596afd5c9b None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:07:25.470536 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb5144-bd87-429e-a3ed-9b596afd5c9b None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:07:25.470694 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb5144-bd87-429e-a3ed-9b596afd5c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:07:25.488944 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-34bb5144-bd87-429e-a3ed-9b596afd5c9b None None] MFA Rules not processed for user `826e7ceb2e914a289a850340a0be1d05`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:07:25.490132 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-34bb5144-bd87-429e-a3ed-9b596afd5c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:07:25.541380 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1285/2572] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:07:25 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:08:19.990529 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820dfc4-a754-4744-a2f7-cbdd24be5648 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:08:19.991010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820dfc4-a754-4744-a2f7-cbdd24be5648 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:08:19.991108 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820dfc4-a754-4744-a2f7-cbdd24be5648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:08:20.007717 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-b820dfc4-a754-4744-a2f7-cbdd24be5648 None None] MFA Rules not processed for user `a93401007dd64d88af5e41ff08679a28`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:08:20.008918 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b820dfc4-a754-4744-a2f7-cbdd24be5648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:08:20.066968 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1288/2573] 10.222.0.32 () {58 vars in 968 bytes} [Wed Sep 15 03:08:19 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:08:20.106354 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb5144-bd87-429e-a3ed-9b596afd5c9b None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:08:20.108367 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-34bb5144-bd87-429e-a3ed-9b596afd5c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:08:20.173293 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb5144-bd87-429e-a3ed-9b596afd5c9b None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:08:20.178119 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15432f69-31f2-4257-8777-8a2ffcc0c5ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea510f540b2d47dcb19c8715fd247786', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:08:20.178759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15432f69-31f2-4257-8777-8a2ffcc0c5ef service swift] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:08:20.179043 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15432f69-31f2-4257-8777-8a2ffcc0c5ef service swift] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:08:20.179319 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15432f69-31f2-4257-8777-8a2ffcc0c5ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:08:20.187392 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15432f69-31f2-4257-8777-8a2ffcc0c5ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:08:20.188981 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15432f69-31f2-4257-8777-8a2ffcc0c5ef service swift] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:08:20.196743 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1286/2574] 10.222.0.32 () {60 vars in 1385 bytes} [Wed Sep 15 03:08:20 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 03:08:26.315748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820dfc4-a754-4744-a2f7-cbdd24be5648 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:08:26.317850 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b820dfc4-a754-4744-a2f7-cbdd24be5648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:08:26.383464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820dfc4-a754-4744-a2f7-cbdd24be5648 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:08:26.388029 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23cab5-97d7-4489-b0c6-83d1c813c056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:08:26.389618 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23cab5-97d7-4489-b0c6-83d1c813c056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:08:26.389898 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23cab5-97d7-4489-b0c6-83d1c813c056 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:08:26.390175 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23cab5-97d7-4489-b0c6-83d1c813c056 admin admin] PATH_INFO: `/v3/users/19c7ffe94d204879a8fff474d67a5969` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:08:26.391355 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23cab5-97d7-4489-b0c6-83d1c813c056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19c7ffe94d204879a8fff474d67a5969)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:08:26.393304 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23cab5-97d7-4489-b0c6-83d1c813c056 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:08:26.437452 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5e23cab5-97d7-4489-b0c6-83d1c813c056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19c7ffe94d204879a8fff474d67a5969'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:08:26.448388 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5e23cab5-97d7-4489-b0c6-83d1c813c056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19c7ffe94d204879a8fff474d67a5969'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:08:26.449072 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5e23cab5-97d7-4489-b0c6-83d1c813c056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19c7ffe94d204879a8fff474d67a5969'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:08:26.456513 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5e23cab5-97d7-4489-b0c6-83d1c813c056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19c7ffe94d204879a8fff474d67a5969'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:08:26.463004 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5e23cab5-97d7-4489-b0c6-83d1c813c056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19c7ffe94d204879a8fff474d67a5969'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:08:26.469675 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1289/2575] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:08:26 2021] DELETE /identity/v3/users/19c7ffe94d204879a8fff474d67a5969 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:08:26.865670 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15432f69-31f2-4257-8777-8a2ffcc0c5ef service swift] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:08:26.876637 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15432f69-31f2-4257-8777-8a2ffcc0c5ef service swift] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:08:26.930055 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495526eb-74a7-4c0f-830e-9b61d6810c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:08:26.930906 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495526eb-74a7-4c0f-830e-9b61d6810c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:08:26.931185 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495526eb-74a7-4c0f-830e-9b61d6810c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:08:26.931457 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495526eb-74a7-4c0f-830e-9b61d6810c49 admin admin] PATH_INFO: `/v3/projects/b7eaf10fa4104dc188da24b13f77fad4` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:08:26.932635 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495526eb-74a7-4c0f-830e-9b61d6810c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7eaf10fa4104dc188da24b13f77fad4)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:08:26.934802 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495526eb-74a7-4c0f-830e-9b61d6810c49 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:08:26.978276 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-495526eb-74a7-4c0f-830e-9b61d6810c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7eaf10fa4104dc188da24b13f77fad4', 'request_id': 'req-495526eb-74a7-4c0f-830e-9b61d6810c49'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:08:26.984528 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-495526eb-74a7-4c0f-830e-9b61d6810c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7eaf10fa4104dc188da24b13f77fad4', 'request_id': 'req-495526eb-74a7-4c0f-830e-9b61d6810c49'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:08:26.989897 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-495526eb-74a7-4c0f-830e-9b61d6810c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7eaf10fa4104dc188da24b13f77fad4', 'request_id': 'req-495526eb-74a7-4c0f-830e-9b61d6810c49'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:08:27.000208 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-495526eb-74a7-4c0f-830e-9b61d6810c49 admin admin] The token cache is being invalidate because project b7eaf10fa4104dc188da24b13f77fad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:08:27.000439 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-495526eb-74a7-4c0f-830e-9b61d6810c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:08:27.001083 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-495526eb-74a7-4c0f-830e-9b61d6810c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:08:27.002589 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1287/2576] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:08:26 2021] DELETE /identity/v3/projects/b7eaf10fa4104dc188da24b13f77fad4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:08:27.006674 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23cab5-97d7-4489-b0c6-83d1c813c056 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:08:27.008104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-5e23cab5-97d7-4489-b0c6-83d1c813c056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:08:27.021540 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23cab5-97d7-4489-b0c6-83d1c813c056 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:08:27.074831 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec3cd1-6fd6-4d9b-a45c-fbf16a06421a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:08:27.075690 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec3cd1-6fd6-4d9b-a45c-fbf16a06421a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:08:27.075967 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec3cd1-6fd6-4d9b-a45c-fbf16a06421a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:08:27.076773 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec3cd1-6fd6-4d9b-a45c-fbf16a06421a admin admin] PATH_INFO: `/v3/users/c715e777740d4349bb9b3309992dbb0d` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:08:27.078303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec3cd1-6fd6-4d9b-a45c-fbf16a06421a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c715e777740d4349bb9b3309992dbb0d)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:08:27.080391 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec3cd1-6fd6-4d9b-a45c-fbf16a06421a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:08:27.124461 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-feec3cd1-6fd6-4d9b-a45c-fbf16a06421a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c715e777740d4349bb9b3309992dbb0d'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:08:27.135525 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-feec3cd1-6fd6-4d9b-a45c-fbf16a06421a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c715e777740d4349bb9b3309992dbb0d'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:08:27.136167 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-feec3cd1-6fd6-4d9b-a45c-fbf16a06421a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c715e777740d4349bb9b3309992dbb0d'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:08:27.143304 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-feec3cd1-6fd6-4d9b-a45c-fbf16a06421a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c715e777740d4349bb9b3309992dbb0d'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:08:27.149845 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-feec3cd1-6fd6-4d9b-a45c-fbf16a06421a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c715e777740d4349bb9b3309992dbb0d'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:08:27.156160 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1290/2577] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:08:27 2021] DELETE /identity/v3/users/c715e777740d4349bb9b3309992dbb0d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:08:27.320571 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495526eb-74a7-4c0f-830e-9b61d6810c49 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:08:27.321701 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-495526eb-74a7-4c0f-830e-9b61d6810c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:08:27.336629 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495526eb-74a7-4c0f-830e-9b61d6810c49 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:08:27.390995 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea557a62-6d4c-477a-873b-eecbcbbfde77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:08:27.391844 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea557a62-6d4c-477a-873b-eecbcbbfde77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:08:27.392124 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea557a62-6d4c-477a-873b-eecbcbbfde77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:08:27.392398 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea557a62-6d4c-477a-873b-eecbcbbfde77 admin admin] PATH_INFO: `/v3/projects/57971ba5d6be42a1bebaa1799b517bd1` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:08:27.393580 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea557a62-6d4c-477a-873b-eecbcbbfde77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57971ba5d6be42a1bebaa1799b517bd1)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:08:27.395467 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea557a62-6d4c-477a-873b-eecbcbbfde77 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:08:27.439462 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ea557a62-6d4c-477a-873b-eecbcbbfde77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57971ba5d6be42a1bebaa1799b517bd1', 'request_id': 'req-ea557a62-6d4c-477a-873b-eecbcbbfde77'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:08:27.445672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ea557a62-6d4c-477a-873b-eecbcbbfde77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57971ba5d6be42a1bebaa1799b517bd1', 'request_id': 'req-ea557a62-6d4c-477a-873b-eecbcbbfde77'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:08:27.450929 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ea557a62-6d4c-477a-873b-eecbcbbfde77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57971ba5d6be42a1bebaa1799b517bd1', 'request_id': 'req-ea557a62-6d4c-477a-873b-eecbcbbfde77'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:08:27.461841 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ea557a62-6d4c-477a-873b-eecbcbbfde77 admin admin] The token cache is being invalidate because project 57971ba5d6be42a1bebaa1799b517bd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:08:27.462140 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ea557a62-6d4c-477a-873b-eecbcbbfde77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:08:27.462749 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ea557a62-6d4c-477a-873b-eecbcbbfde77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:08:27.464243 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1288/2578] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:08:27 2021] DELETE /identity/v3/projects/57971ba5d6be42a1bebaa1799b517bd1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:09:09.126770 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec3cd1-6fd6-4d9b-a45c-fbf16a06421a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:09.128185 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-feec3cd1-6fd6-4d9b-a45c-fbf16a06421a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:09.195373 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec3cd1-6fd6-4d9b-a45c-fbf16a06421a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:09.253812 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc5ffb-8903-48d1-a04d-ec150d13f4f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:09.254456 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc5ffb-8903-48d1-a04d-ec150d13f4f5 service placement] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:09.254738 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc5ffb-8903-48d1-a04d-ec150d13f4f5 service placement] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:09.255010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc5ffb-8903-48d1-a04d-ec150d13f4f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:09.256766 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-6cdc5ffb-8903-48d1-a04d-ec150d13f4f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:09.267753 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc5ffb-8903-48d1-a04d-ec150d13f4f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:09.269345 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc5ffb-8903-48d1-a04d-ec150d13f4f5 service placement] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:09.279576 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1291/2579] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:09:09 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:09:10.609365 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea557a62-6d4c-477a-873b-eecbcbbfde77 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:10.610837 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-ea557a62-6d4c-477a-873b-eecbcbbfde77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:10.664314 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea557a62-6d4c-477a-873b-eecbcbbfde77 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:10.668235 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92afa3-44fc-43fc-97b5-9b1ce2510254 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:10.668900 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92afa3-44fc-43fc-97b5-9b1ce2510254 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:10.669181 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92afa3-44fc-43fc-97b5-9b1ce2510254 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:10.669952 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92afa3-44fc-43fc-97b5-9b1ce2510254 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:10.671692 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-0f92afa3-44fc-43fc-97b5-9b1ce2510254 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:10.748339 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92afa3-44fc-43fc-97b5-9b1ce2510254 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:10.749926 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92afa3-44fc-43fc-97b5-9b1ce2510254 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:10.767742 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1289/2580] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:09:10 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:09:14.248388 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc5ffb-8903-48d1-a04d-ec150d13f4f5 service placement] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:14.249965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-6cdc5ffb-8903-48d1-a04d-ec150d13f4f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:14.303698 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc5ffb-8903-48d1-a04d-ec150d13f4f5 service placement] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:14.307578 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994ac7c-9c67-446b-a103-ed8ad1e783ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:14.308224 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994ac7c-9c67-446b-a103-ed8ad1e783ba service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:14.308501 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994ac7c-9c67-446b-a103-ed8ad1e783ba service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:14.308768 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994ac7c-9c67-446b-a103-ed8ad1e783ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:14.310605 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4994ac7c-9c67-446b-a103-ed8ad1e783ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:14.378014 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994ac7c-9c67-446b-a103-ed8ad1e783ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:14.379476 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994ac7c-9c67-446b-a103-ed8ad1e783ba service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:14.401314 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1292/2581] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:09:14 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:09:21.647559 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92afa3-44fc-43fc-97b5-9b1ce2510254 service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:21.657024 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92afa3-44fc-43fc-97b5-9b1ce2510254 service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:21.660566 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a88fed-d43d-43a1-b78b-5ab9a913e0e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:21.661233 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a88fed-d43d-43a1-b78b-5ab9a913e0e9 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:21.661512 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a88fed-d43d-43a1-b78b-5ab9a913e0e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:21.661781 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a88fed-d43d-43a1-b78b-5ab9a913e0e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:21.663489 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-50a88fed-d43d-43a1-b78b-5ab9a913e0e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:21.722684 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a88fed-d43d-43a1-b78b-5ab9a913e0e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:21.724023 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a88fed-d43d-43a1-b78b-5ab9a913e0e9 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:21.733822 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1290/2582] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:09:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:09:22.199685 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994ac7c-9c67-446b-a103-ed8ad1e783ba service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:22.201225 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4994ac7c-9c67-446b-a103-ed8ad1e783ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:22.215707 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994ac7c-9c67-446b-a103-ed8ad1e783ba service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:22.220769 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b2d78-739a-4952-955a-ff8dba4f4469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:22.221660 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b2d78-739a-4952-955a-ff8dba4f4469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:22.221938 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b2d78-739a-4952-955a-ff8dba4f4469 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:22.222209 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b2d78-739a-4952-955a-ff8dba4f4469 admin admin] PATH_INFO: `/v3/users/6d88e560bc7f48019d584bd7c88d73ab` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:22.223376 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b2d78-739a-4952-955a-ff8dba4f4469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d88e560bc7f48019d584bd7c88d73ab)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:22.225759 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b2d78-739a-4952-955a-ff8dba4f4469 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:22.269397 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0b8b2d78-739a-4952-955a-ff8dba4f4469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d88e560bc7f48019d584bd7c88d73ab'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:22.280787 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0b8b2d78-739a-4952-955a-ff8dba4f4469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d88e560bc7f48019d584bd7c88d73ab'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:22.281473 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0b8b2d78-739a-4952-955a-ff8dba4f4469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d88e560bc7f48019d584bd7c88d73ab'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:22.288653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0b8b2d78-739a-4952-955a-ff8dba4f4469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d88e560bc7f48019d584bd7c88d73ab'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:22.295265 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0b8b2d78-739a-4952-955a-ff8dba4f4469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d88e560bc7f48019d584bd7c88d73ab'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:22.300925 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1293/2583] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:09:22 2021] DELETE /identity/v3/users/6d88e560bc7f48019d584bd7c88d73ab => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:09:22.469138 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a88fed-d43d-43a1-b78b-5ab9a913e0e9 service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:22.481016 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a88fed-d43d-43a1-b78b-5ab9a913e0e9 service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:22.540679 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce7365-9dfb-437c-9341-202c2c82cda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:22.541493 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce7365-9dfb-437c-9341-202c2c82cda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:22.541777 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce7365-9dfb-437c-9341-202c2c82cda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:22.542053 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce7365-9dfb-437c-9341-202c2c82cda5 admin admin] PATH_INFO: `/v3/projects/adaac922bb1d4dac87ae1a96045dcce2` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:22.543230 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce7365-9dfb-437c-9341-202c2c82cda5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adaac922bb1d4dac87ae1a96045dcce2)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:22.545144 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce7365-9dfb-437c-9341-202c2c82cda5 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:22.589257 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-2cce7365-9dfb-437c-9341-202c2c82cda5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adaac922bb1d4dac87ae1a96045dcce2', 'request_id': 'req-2cce7365-9dfb-437c-9341-202c2c82cda5'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:22.597261 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-2cce7365-9dfb-437c-9341-202c2c82cda5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adaac922bb1d4dac87ae1a96045dcce2', 'request_id': 'req-2cce7365-9dfb-437c-9341-202c2c82cda5'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:22.602572 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-2cce7365-9dfb-437c-9341-202c2c82cda5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adaac922bb1d4dac87ae1a96045dcce2', 'request_id': 'req-2cce7365-9dfb-437c-9341-202c2c82cda5'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:22.613218 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-2cce7365-9dfb-437c-9341-202c2c82cda5 admin admin] The token cache is being invalidate because project adaac922bb1d4dac87ae1a96045dcce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:09:22.613504 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-2cce7365-9dfb-437c-9341-202c2c82cda5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:22.614127 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-2cce7365-9dfb-437c-9341-202c2c82cda5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:22.615644 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1291/2584] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:09:22 2021] DELETE /identity/v3/projects/adaac922bb1d4dac87ae1a96045dcce2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:09:22.622391 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb40452-582e-42e0-8301-cd129bbdd1fb None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:22.622679 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb40452-582e-42e0-8301-cd129bbdd1fb None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:22.622958 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb40452-582e-42e0-8301-cd129bbdd1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:22.640535 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-7bb40452-582e-42e0-8301-cd129bbdd1fb None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:09:22.641783 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-7bb40452-582e-42e0-8301-cd129bbdd1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:22.697118 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1294/2585] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:09:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:09:22.705237 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9cee6-124d-436f-b96a-f998123ec021 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:22.705705 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9cee6-124d-436f-b96a-f998123ec021 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:22.705796 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9cee6-124d-436f-b96a-f998123ec021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:22.723688 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-d3f9cee6-124d-436f-b96a-f998123ec021 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:09:22.724855 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-d3f9cee6-124d-436f-b96a-f998123ec021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:22.732758 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1292/2586] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:09:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:09:22.736667 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb40452-582e-42e0-8301-cd129bbdd1fb None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:22.745877 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb40452-582e-42e0-8301-cd129bbdd1fb None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:22.750948 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b942c77-5cb6-4826-8573-b7863456c8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:22.751590 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b942c77-5cb6-4826-8573-b7863456c8cc admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:22.751871 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b942c77-5cb6-4826-8573-b7863456c8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:22.752145 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b942c77-5cb6-4826-8573-b7863456c8cc admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:22.752857 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b942c77-5cb6-4826-8573-b7863456c8cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 03:09:22.753191 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b942c77-5cb6-4826-8573-b7863456c8cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:22.754769 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b942c77-5cb6-4826-8573-b7863456c8cc admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:22.765722 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1295/2587] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 03:09:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 03:09:22.769592 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9cee6-124d-436f-b96a-f998123ec021 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:22.779137 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9cee6-124d-436f-b96a-f998123ec021 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:22.783735 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69185357-ec7c-4b95-984e-744e570e46f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:22.784373 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69185357-ec7c-4b95-984e-744e570e46f5 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:22.784653 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69185357-ec7c-4b95-984e-744e570e46f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:22.784963 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69185357-ec7c-4b95-984e-744e570e46f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:22.785652 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69185357-ec7c-4b95-984e-744e570e46f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:22.787511 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69185357-ec7c-4b95-984e-744e570e46f5 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:22.812355 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1293/2588] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:09:22 2021] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:09:22.816245 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b942c77-5cb6-4826-8573-b7863456c8cc admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:22.825781 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b942c77-5cb6-4826-8573-b7863456c8cc admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:22.877991 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fc6e3-4e51-49f8-b44d-3d4975a60c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:22.878647 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fc6e3-4e51-49f8-b44d-3d4975a60c65 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:22.878933 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fc6e3-4e51-49f8-b44d-3d4975a60c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:22.879294 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fc6e3-4e51-49f8-b44d-3d4975a60c65 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:22.879973 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fc6e3-4e51-49f8-b44d-3d4975a60c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:22.881904 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fc6e3-4e51-49f8-b44d-3d4975a60c65 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:22.900786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1296/2589] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:09:22 2021] POST /identity/v3/users => generated 288 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:09:22.905002 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69185357-ec7c-4b95-984e-744e570e46f5 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:22.915087 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69185357-ec7c-4b95-984e-744e570e46f5 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:22.920420 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1d3bf-e33a-471a-b29d-c0cd84449bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:22.921262 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1d3bf-e33a-471a-b29d-c0cd84449bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:22.921546 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1d3bf-e33a-471a-b29d-c0cd84449bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:22.921818 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1d3bf-e33a-471a-b29d-c0cd84449bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:22.922539 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1d3bf-e33a-471a-b29d-c0cd84449bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:22.924113 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1d3bf-e33a-471a-b29d-c0cd84449bd8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:22.934907 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1294/2590] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:09:22 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:09:22.938813 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fc6e3-4e51-49f8-b44d-3d4975a60c65 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:22.948688 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fc6e3-4e51-49f8-b44d-3d4975a60c65 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:22.953618 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe985df2-4144-4c13-ba94-c2fef674b642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:22.954301 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe985df2-4144-4c13-ba94-c2fef674b642 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:22.954592 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe985df2-4144-4c13-ba94-c2fef674b642 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:22.954855 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe985df2-4144-4c13-ba94-c2fef674b642 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:22.955588 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe985df2-4144-4c13-ba94-c2fef674b642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:22.957209 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe985df2-4144-4c13-ba94-c2fef674b642 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:22.967618 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1297/2591] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:09:22 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:09:22.971556 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1d3bf-e33a-471a-b29d-c0cd84449bd8 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:22.981551 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1d3bf-e33a-471a-b29d-c0cd84449bd8 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:22.987219 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207de10-f38d-4b98-8bf5-7ab7d59c5e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:22.988134 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207de10-f38d-4b98-8bf5-7ab7d59c5e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:22.988425 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207de10-f38d-4b98-8bf5-7ab7d59c5e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:22.988705 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207de10-f38d-4b98-8bf5-7ab7d59c5e4b admin admin] PATH_INFO: `/v3/projects/66a03f5336d945afaf9d45d30139651e/users/2827e9d129634276801ab25f5a3149b9/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:23.004455 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207de10-f38d-4b98-8bf5-7ab7d59c5e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a03f5336d945afaf9d45d30139651e, user_id=2827e9d129634276801ab25f5a3149b9, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:23.007174 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207de10-f38d-4b98-8bf5-7ab7d59c5e4b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:23.020645 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1295/2592] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:09:22 2021] PUT /identity/v3/projects/66a03f5336d945afaf9d45d30139651e/users/2827e9d129634276801ab25f5a3149b9/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:09:23.031095 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c67ca-1eec-43f6-9947-f461b33ec025 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:23.031388 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c67ca-1eec-43f6-9947-f461b33ec025 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:23.031672 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c67ca-1eec-43f6-9947-f461b33ec025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:23.058095 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-954c67ca-1eec-43f6-9947-f461b33ec025 None None] MFA Rules not processed for user `2827e9d129634276801ab25f5a3149b9`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:09:23.059317 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-954c67ca-1eec-43f6-9947-f461b33ec025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:23.124556 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1298/2593] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:09:23 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:09:23.135658 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207de10-f38d-4b98-8bf5-7ab7d59c5e4b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:23.137537 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7207de10-f38d-4b98-8bf5-7ab7d59c5e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:23.213240 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207de10-f38d-4b98-8bf5-7ab7d59c5e4b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:23.219691 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072421ef-1e90-4162-849e-1feaf442032b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:23.220347 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072421ef-1e90-4162-849e-1feaf442032b service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:23.220632 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072421ef-1e90-4162-849e-1feaf442032b service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:23.221013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072421ef-1e90-4162-849e-1feaf442032b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:23.228714 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072421ef-1e90-4162-849e-1feaf442032b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:23.230356 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072421ef-1e90-4162-849e-1feaf442032b service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:23.239463 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1296/2594] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:09:23 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:09:23.415312 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c67ca-1eec-43f6-9947-f461b33ec025 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:23.479246 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c67ca-1eec-43f6-9947-f461b33ec025 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:23.483779 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab337f-6912-4de3-bf2d-3d8dcc1d15d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:23.484644 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab337f-6912-4de3-bf2d-3d8dcc1d15d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:23.484944 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab337f-6912-4de3-bf2d-3d8dcc1d15d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:23.485224 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab337f-6912-4de3-bf2d-3d8dcc1d15d1 admin admin] PATH_INFO: `/v3/users/2827e9d129634276801ab25f5a3149b9` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:23.486404 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab337f-6912-4de3-bf2d-3d8dcc1d15d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2827e9d129634276801ab25f5a3149b9)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:23.488447 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab337f-6912-4de3-bf2d-3d8dcc1d15d1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:23.532933 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-cfab337f-6912-4de3-bf2d-3d8dcc1d15d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2827e9d129634276801ab25f5a3149b9'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:23.545901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-cfab337f-6912-4de3-bf2d-3d8dcc1d15d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2827e9d129634276801ab25f5a3149b9'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:23.546627 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-cfab337f-6912-4de3-bf2d-3d8dcc1d15d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2827e9d129634276801ab25f5a3149b9'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:23.555507 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-cfab337f-6912-4de3-bf2d-3d8dcc1d15d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2827e9d129634276801ab25f5a3149b9'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:23.564583 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-cfab337f-6912-4de3-bf2d-3d8dcc1d15d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2827e9d129634276801ab25f5a3149b9'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:23.570525 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1299/2595] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:09:23 2021] DELETE /identity/v3/users/2827e9d129634276801ab25f5a3149b9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:09:23.575062 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1876d60-2ba3-47b8-be3d-b302a242b619 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:23.575404 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1876d60-2ba3-47b8-be3d-b302a242b619 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:23.575681 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1876d60-2ba3-47b8-be3d-b302a242b619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:23.593427 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-b1876d60-2ba3-47b8-be3d-b302a242b619 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:09:23.594626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b1876d60-2ba3-47b8-be3d-b302a242b619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:23.652246 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1297/2596] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:09:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:09:23.662539 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab337f-6912-4de3-bf2d-3d8dcc1d15d1 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:23.663953 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-cfab337f-6912-4de3-bf2d-3d8dcc1d15d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:23.718495 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab337f-6912-4de3-bf2d-3d8dcc1d15d1 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:23.722149 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092206d-6a09-4539-888b-bb58bbd9bdcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:23.722790 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092206d-6a09-4539-888b-bb58bbd9bdcb service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:23.723067 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092206d-6a09-4539-888b-bb58bbd9bdcb service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:23.723347 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092206d-6a09-4539-888b-bb58bbd9bdcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:23.732278 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092206d-6a09-4539-888b-bb58bbd9bdcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:23.733744 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092206d-6a09-4539-888b-bb58bbd9bdcb service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:23.743347 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1300/2597] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:09:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:09:24.089232 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1876d60-2ba3-47b8-be3d-b302a242b619 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:24.090833 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b1876d60-2ba3-47b8-be3d-b302a242b619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:24.103208 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1876d60-2ba3-47b8-be3d-b302a242b619 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:24.108952 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe1559-fbb0-45b8-9ba5-96fe75c269cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:24.109768 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe1559-fbb0-45b8-9ba5-96fe75c269cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:24.110048 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe1559-fbb0-45b8-9ba5-96fe75c269cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:24.110478 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe1559-fbb0-45b8-9ba5-96fe75c269cb admin admin] PATH_INFO: `/v3/projects/66a03f5336d945afaf9d45d30139651e` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:24.112032 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe1559-fbb0-45b8-9ba5-96fe75c269cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=66a03f5336d945afaf9d45d30139651e)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:24.113970 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe1559-fbb0-45b8-9ba5-96fe75c269cb admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:24.159958 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ddfe1559-fbb0-45b8-9ba5-96fe75c269cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66a03f5336d945afaf9d45d30139651e', 'request_id': 'req-ddfe1559-fbb0-45b8-9ba5-96fe75c269cb'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:24.166527 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ddfe1559-fbb0-45b8-9ba5-96fe75c269cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66a03f5336d945afaf9d45d30139651e', 'request_id': 'req-ddfe1559-fbb0-45b8-9ba5-96fe75c269cb'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:24.172276 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ddfe1559-fbb0-45b8-9ba5-96fe75c269cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66a03f5336d945afaf9d45d30139651e', 'request_id': 'req-ddfe1559-fbb0-45b8-9ba5-96fe75c269cb'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:24.183829 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ddfe1559-fbb0-45b8-9ba5-96fe75c269cb admin admin] The token cache is being invalidate because project 66a03f5336d945afaf9d45d30139651e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:09:24.184119 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ddfe1559-fbb0-45b8-9ba5-96fe75c269cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:24.184818 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ddfe1559-fbb0-45b8-9ba5-96fe75c269cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:24.186494 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1298/2598] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:09:24 2021] DELETE /identity/v3/projects/66a03f5336d945afaf9d45d30139651e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:09:24.192555 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11634e26-5263-44d2-9e76-012627a499dd None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:24.192838 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11634e26-5263-44d2-9e76-012627a499dd None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:24.193140 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11634e26-5263-44d2-9e76-012627a499dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:24.212335 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-11634e26-5263-44d2-9e76-012627a499dd None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:09:24.213664 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-11634e26-5263-44d2-9e76-012627a499dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:24.278962 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1301/2599] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:09:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:09:24.286387 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c6ced-12e1-4146-8509-168da1383178 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:24.286972 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c6ced-12e1-4146-8509-168da1383178 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:24.287585 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c6ced-12e1-4146-8509-168da1383178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:24.313122 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-660c6ced-12e1-4146-8509-168da1383178 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:09:24.314509 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-660c6ced-12e1-4146-8509-168da1383178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:24.324252 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1299/2600] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:09:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:09:24.329147 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11634e26-5263-44d2-9e76-012627a499dd None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:24.340428 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11634e26-5263-44d2-9e76-012627a499dd None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:24.346191 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da473c-ae31-46e4-bb97-818e7d37c6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:24.346908 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da473c-ae31-46e4-bb97-818e7d37c6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:24.347194 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da473c-ae31-46e4-bb97-818e7d37c6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:24.347470 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da473c-ae31-46e4-bb97-818e7d37c6e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:24.348190 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da473c-ae31-46e4-bb97-818e7d37c6e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 03:09:24.348498 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da473c-ae31-46e4-bb97-818e7d37c6e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:24.350139 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da473c-ae31-46e4-bb97-818e7d37c6e0 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:24.364234 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1302/2601] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 03:09:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 03:09:24.368482 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c6ced-12e1-4146-8509-168da1383178 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:24.378970 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c6ced-12e1-4146-8509-168da1383178 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:24.384650 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173051ed-00bf-4e18-a3dc-c37dd65e2507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:24.385600 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173051ed-00bf-4e18-a3dc-c37dd65e2507 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:24.385883 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173051ed-00bf-4e18-a3dc-c37dd65e2507 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:24.386186 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173051ed-00bf-4e18-a3dc-c37dd65e2507 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:24.386846 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173051ed-00bf-4e18-a3dc-c37dd65e2507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:24.388837 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173051ed-00bf-4e18-a3dc-c37dd65e2507 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:24.416280 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1300/2602] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:09:24 2021] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:09:24.421428 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da473c-ae31-46e4-bb97-818e7d37c6e0 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:24.432077 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da473c-ae31-46e4-bb97-818e7d37c6e0 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:24.487607 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc14e9c-5693-4e6a-9ccc-07731e91c803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:24.488278 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc14e9c-5693-4e6a-9ccc-07731e91c803 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:24.488588 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc14e9c-5693-4e6a-9ccc-07731e91c803 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:24.488857 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc14e9c-5693-4e6a-9ccc-07731e91c803 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:24.489574 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc14e9c-5693-4e6a-9ccc-07731e91c803 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:24.491534 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc14e9c-5693-4e6a-9ccc-07731e91c803 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:24.512922 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1303/2603] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:09:24 2021] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:09:24.515023 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173051ed-00bf-4e18-a3dc-c37dd65e2507 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:24.526084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173051ed-00bf-4e18-a3dc-c37dd65e2507 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:24.531706 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777b5c7-ff0b-448d-8b73-2a29bd79b118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:24.532367 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777b5c7-ff0b-448d-8b73-2a29bd79b118 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:24.532647 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777b5c7-ff0b-448d-8b73-2a29bd79b118 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:24.532955 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777b5c7-ff0b-448d-8b73-2a29bd79b118 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:24.533673 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777b5c7-ff0b-448d-8b73-2a29bd79b118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:24.535249 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777b5c7-ff0b-448d-8b73-2a29bd79b118 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:24.546014 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1301/2604] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:09:24 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:09:24.550024 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc14e9c-5693-4e6a-9ccc-07731e91c803 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:24.560764 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc14e9c-5693-4e6a-9ccc-07731e91c803 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:24.565461 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ada67-12d3-4c09-babd-68d960f7c768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:24.566119 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ada67-12d3-4c09-babd-68d960f7c768 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:24.566401 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ada67-12d3-4c09-babd-68d960f7c768 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:24.566681 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ada67-12d3-4c09-babd-68d960f7c768 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:24.567401 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ada67-12d3-4c09-babd-68d960f7c768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:24.569007 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ada67-12d3-4c09-babd-68d960f7c768 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:24.580920 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1304/2605] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:09:24 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 03:09:24.583354 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777b5c7-ff0b-448d-8b73-2a29bd79b118 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:24.593186 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777b5c7-ff0b-448d-8b73-2a29bd79b118 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:24.597869 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38d9a0-a50b-472d-acce-8a46e2e2056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:24.598824 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38d9a0-a50b-472d-acce-8a46e2e2056c admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:24.599174 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38d9a0-a50b-472d-acce-8a46e2e2056c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:24.599519 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38d9a0-a50b-472d-acce-8a46e2e2056c admin admin] PATH_INFO: `/v3/projects/f2b2cc97adcc4d298660b42ac653297e/users/3223b106e04d452d8028067ac8d6437a/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:24.614420 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38d9a0-a50b-472d-acce-8a46e2e2056c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b2cc97adcc4d298660b42ac653297e, user_id=3223b106e04d452d8028067ac8d6437a, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:24.617021 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38d9a0-a50b-472d-acce-8a46e2e2056c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:24.631332 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1302/2606] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:09:24 2021] PUT /identity/v3/projects/f2b2cc97adcc4d298660b42ac653297e/users/3223b106e04d452d8028067ac8d6437a/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:09:24.642506 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ab01b-3863-4c55-af06-1451e9ca7058 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:24.642796 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ab01b-3863-4c55-af06-1451e9ca7058 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:24.643075 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ab01b-3863-4c55-af06-1451e9ca7058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:24.670781 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-353ab01b-3863-4c55-af06-1451e9ca7058 None None] MFA Rules not processed for user `3223b106e04d452d8028067ac8d6437a`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:09:24.671986 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-353ab01b-3863-4c55-af06-1451e9ca7058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:24.734618 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1305/2607] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:09:24 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:09:24.739026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38d9a0-a50b-472d-acce-8a46e2e2056c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:24.801631 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38d9a0-a50b-472d-acce-8a46e2e2056c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:24.806339 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d0be0-d24e-4c43-b146-4637c79a953f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:24.807257 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d0be0-d24e-4c43-b146-4637c79a953f admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:24.807540 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d0be0-d24e-4c43-b146-4637c79a953f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:24.807810 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d0be0-d24e-4c43-b146-4637c79a953f admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:24.808532 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d0be0-d24e-4c43-b146-4637c79a953f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:24.811054 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d0be0-d24e-4c43-b146-4637c79a953f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:24.836090 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1303/2608] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:09:24 2021] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:09:24.839718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ab01b-3863-4c55-af06-1451e9ca7058 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:24.850460 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ab01b-3863-4c55-af06-1451e9ca7058 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:24.905373 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4da02-804c-4a41-9d4c-43fd2a6118f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:24.905971 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4da02-804c-4a41-9d4c-43fd2a6118f8 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:24.906283 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4da02-804c-4a41-9d4c-43fd2a6118f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:24.906590 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4da02-804c-4a41-9d4c-43fd2a6118f8 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:24.907286 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4da02-804c-4a41-9d4c-43fd2a6118f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:24.909303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4da02-804c-4a41-9d4c-43fd2a6118f8 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:24.932769 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1306/2609] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:09:24 2021] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:09:24.934313 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d0be0-d24e-4c43-b146-4637c79a953f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:24.945939 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d0be0-d24e-4c43-b146-4637c79a953f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:24.950850 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6accd0-b137-42b1-9706-93eecc205561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:24.951534 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6accd0-b137-42b1-9706-93eecc205561 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:24.951816 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6accd0-b137-42b1-9706-93eecc205561 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:24.952093 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6accd0-b137-42b1-9706-93eecc205561 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:24.952818 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6accd0-b137-42b1-9706-93eecc205561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:24.954509 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6accd0-b137-42b1-9706-93eecc205561 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:24.965376 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1304/2610] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:09:24 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:09:24.970156 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4da02-804c-4a41-9d4c-43fd2a6118f8 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:24.979913 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4da02-804c-4a41-9d4c-43fd2a6118f8 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:24.985227 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e3a14-2dac-4dbd-9294-84e7fac509b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:24.986096 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e3a14-2dac-4dbd-9294-84e7fac509b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:24.986379 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e3a14-2dac-4dbd-9294-84e7fac509b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:24.986655 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e3a14-2dac-4dbd-9294-84e7fac509b3 admin admin] PATH_INFO: `/v3/projects/ce1c207cd5f844de9107978a2dda9643/users/a932240eda5040c3ae1560462485adeb/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:25.000607 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e3a14-2dac-4dbd-9294-84e7fac509b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1c207cd5f844de9107978a2dda9643, user_id=a932240eda5040c3ae1560462485adeb, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:25.003283 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e3a14-2dac-4dbd-9294-84e7fac509b3 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:25.015314 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1307/2611] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:09:24 2021] PUT /identity/v3/projects/ce1c207cd5f844de9107978a2dda9643/users/a932240eda5040c3ae1560462485adeb/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:09:25.019094 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6accd0-b137-42b1-9706-93eecc205561 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:25.029555 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6accd0-b137-42b1-9706-93eecc205561 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:25.082565 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716a21e-2cf7-4caf-bc2e-c82ddb6c95d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:25.083225 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716a21e-2cf7-4caf-bc2e-c82ddb6c95d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:25.083515 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716a21e-2cf7-4caf-bc2e-c82ddb6c95d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:25.083792 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716a21e-2cf7-4caf-bc2e-c82ddb6c95d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:25.084511 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716a21e-2cf7-4caf-bc2e-c82ddb6c95d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:25.086121 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716a21e-2cf7-4caf-bc2e-c82ddb6c95d3 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:25.095859 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1305/2612] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:09:25 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:09:25.099846 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e3a14-2dac-4dbd-9294-84e7fac509b3 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:25.109881 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e3a14-2dac-4dbd-9294-84e7fac509b3 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:25.114480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537305c8-4be1-4aab-9777-355c7d7b784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:25.115339 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537305c8-4be1-4aab-9777-355c7d7b784c admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:25.115620 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537305c8-4be1-4aab-9777-355c7d7b784c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:25.115893 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537305c8-4be1-4aab-9777-355c7d7b784c admin admin] PATH_INFO: `/v3/projects/ce1c207cd5f844de9107978a2dda9643/users/a932240eda5040c3ae1560462485adeb/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:25.117865 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537305c8-4be1-4aab-9777-355c7d7b784c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1c207cd5f844de9107978a2dda9643, user_id=a932240eda5040c3ae1560462485adeb, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:25.120472 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537305c8-4be1-4aab-9777-355c7d7b784c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:25.130693 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1308/2613] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:09:25 2021] PUT /identity/v3/projects/ce1c207cd5f844de9107978a2dda9643/users/a932240eda5040c3ae1560462485adeb/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:09:25.140802 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2070d34-3676-4b14-a516-1472e420fdec None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:25.141149 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2070d34-3676-4b14-a516-1472e420fdec None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:25.141435 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2070d34-3676-4b14-a516-1472e420fdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:25.166573 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-b2070d34-3676-4b14-a516-1472e420fdec None None] MFA Rules not processed for user `a932240eda5040c3ae1560462485adeb`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:09:25.167704 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b2070d34-3676-4b14-a516-1472e420fdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:25.232158 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1306/2614] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:09:25 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:09:25.241769 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537305c8-4be1-4aab-9777-355c7d7b784c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:25.243711 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-537305c8-4be1-4aab-9777-355c7d7b784c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:25.297796 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537305c8-4be1-4aab-9777-355c7d7b784c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:25.301566 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889483d5-064d-4d38-b536-b86fe0eb809a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:25.302232 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889483d5-064d-4d38-b536-b86fe0eb809a service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:25.302541 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889483d5-064d-4d38-b536-b86fe0eb809a service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:25.302817 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889483d5-064d-4d38-b536-b86fe0eb809a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:25.312351 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889483d5-064d-4d38-b536-b86fe0eb809a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:25.313812 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889483d5-064d-4d38-b536-b86fe0eb809a service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:25.323608 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1309/2615] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:09:25 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:09:25.420424 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2070d34-3676-4b14-a516-1472e420fdec None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:25.430293 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2070d34-3676-4b14-a516-1472e420fdec None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:25.434332 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69337bbf-bb6f-419b-b679-17d5e33068db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:25.435144 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69337bbf-bb6f-419b-b679-17d5e33068db service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:25.435492 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69337bbf-bb6f-419b-b679-17d5e33068db service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:25.435843 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69337bbf-bb6f-419b-b679-17d5e33068db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:25.491249 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69337bbf-bb6f-419b-b679-17d5e33068db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:25.492671 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69337bbf-bb6f-419b-b679-17d5e33068db service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:25.501750 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1307/2616] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:09:25 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:09:28.057130 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889483d5-064d-4d38-b536-b86fe0eb809a service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:28.115273 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889483d5-064d-4d38-b536-b86fe0eb809a service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:28.119758 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558315b9-80c2-40ae-a525-dc4fccf6cf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:28.120604 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558315b9-80c2-40ae-a525-dc4fccf6cf99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:28.120903 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558315b9-80c2-40ae-a525-dc4fccf6cf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:28.121175 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558315b9-80c2-40ae-a525-dc4fccf6cf99 admin admin] PATH_INFO: `/v3/users/3223b106e04d452d8028067ac8d6437a` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:28.122823 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558315b9-80c2-40ae-a525-dc4fccf6cf99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3223b106e04d452d8028067ac8d6437a)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:28.124749 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558315b9-80c2-40ae-a525-dc4fccf6cf99 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:28.167234 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-558315b9-80c2-40ae-a525-dc4fccf6cf99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3223b106e04d452d8028067ac8d6437a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:28.178661 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-558315b9-80c2-40ae-a525-dc4fccf6cf99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3223b106e04d452d8028067ac8d6437a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:28.179314 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-558315b9-80c2-40ae-a525-dc4fccf6cf99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3223b106e04d452d8028067ac8d6437a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:28.186613 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-558315b9-80c2-40ae-a525-dc4fccf6cf99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3223b106e04d452d8028067ac8d6437a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:28.193124 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-558315b9-80c2-40ae-a525-dc4fccf6cf99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3223b106e04d452d8028067ac8d6437a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:28.198857 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1310/2617] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:09:28 2021] DELETE /identity/v3/users/3223b106e04d452d8028067ac8d6437a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:09:28.203917 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba56512-590e-442a-ada3-4ca33c096175 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:28.204396 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba56512-590e-442a-ada3-4ca33c096175 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:28.204496 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba56512-590e-442a-ada3-4ca33c096175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:28.222169 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-9ba56512-590e-442a-ada3-4ca33c096175 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:09:28.223288 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-9ba56512-590e-442a-ada3-4ca33c096175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:28.281432 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1308/2618] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:09:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:09:28.291239 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558315b9-80c2-40ae-a525-dc4fccf6cf99 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:28.292700 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-558315b9-80c2-40ae-a525-dc4fccf6cf99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:28.349504 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558315b9-80c2-40ae-a525-dc4fccf6cf99 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:28.353176 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab3c9b-f589-403a-a1b2-e1625f42c5b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:28.353816 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab3c9b-f589-403a-a1b2-e1625f42c5b8 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:28.354097 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab3c9b-f589-403a-a1b2-e1625f42c5b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:28.354371 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab3c9b-f589-403a-a1b2-e1625f42c5b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:28.364060 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab3c9b-f589-403a-a1b2-e1625f42c5b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:28.365514 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab3c9b-f589-403a-a1b2-e1625f42c5b8 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:28.376303 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1311/2619] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:09:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:09:28.665449 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba56512-590e-442a-ada3-4ca33c096175 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:28.667607 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-9ba56512-590e-442a-ada3-4ca33c096175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:28.680171 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba56512-590e-442a-ada3-4ca33c096175 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:28.685736 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342142a-5dbc-4fda-b861-a9673e5dc914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:28.686637 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342142a-5dbc-4fda-b861-a9673e5dc914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:28.686941 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342142a-5dbc-4fda-b861-a9673e5dc914 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:28.687361 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342142a-5dbc-4fda-b861-a9673e5dc914 admin admin] PATH_INFO: `/v3/projects/f2b2cc97adcc4d298660b42ac653297e` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:28.688679 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342142a-5dbc-4fda-b861-a9673e5dc914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2b2cc97adcc4d298660b42ac653297e)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:28.690565 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342142a-5dbc-4fda-b861-a9673e5dc914 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:28.738209 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5342142a-5dbc-4fda-b861-a9673e5dc914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2b2cc97adcc4d298660b42ac653297e', 'request_id': 'req-5342142a-5dbc-4fda-b861-a9673e5dc914'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:28.745129 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5342142a-5dbc-4fda-b861-a9673e5dc914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2b2cc97adcc4d298660b42ac653297e', 'request_id': 'req-5342142a-5dbc-4fda-b861-a9673e5dc914'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:28.750955 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5342142a-5dbc-4fda-b861-a9673e5dc914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2b2cc97adcc4d298660b42ac653297e', 'request_id': 'req-5342142a-5dbc-4fda-b861-a9673e5dc914'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:28.761572 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5342142a-5dbc-4fda-b861-a9673e5dc914 admin admin] The token cache is being invalidate because project f2b2cc97adcc4d298660b42ac653297e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:09:28.761862 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5342142a-5dbc-4fda-b861-a9673e5dc914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:28.762484 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-5342142a-5dbc-4fda-b861-a9673e5dc914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:28.764083 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1309/2620] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:09:28 2021] DELETE /identity/v3/projects/f2b2cc97adcc4d298660b42ac653297e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:09:28.768292 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab3c9b-f589-403a-a1b2-e1625f42c5b8 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:28.778997 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab3c9b-f589-403a-a1b2-e1625f42c5b8 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:28.833511 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170af0e5-f3b2-406d-a9fc-40aa6e24248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:28.834368 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170af0e5-f3b2-406d-a9fc-40aa6e24248c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:28.834645 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170af0e5-f3b2-406d-a9fc-40aa6e24248c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:28.834917 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170af0e5-f3b2-406d-a9fc-40aa6e24248c admin admin] PATH_INFO: `/v3/users/a932240eda5040c3ae1560462485adeb` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:28.836079 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170af0e5-f3b2-406d-a9fc-40aa6e24248c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a932240eda5040c3ae1560462485adeb)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:28.838026 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170af0e5-f3b2-406d-a9fc-40aa6e24248c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:28.880366 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-170af0e5-f3b2-406d-a9fc-40aa6e24248c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a932240eda5040c3ae1560462485adeb'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:28.891342 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-170af0e5-f3b2-406d-a9fc-40aa6e24248c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a932240eda5040c3ae1560462485adeb'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:28.891990 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-170af0e5-f3b2-406d-a9fc-40aa6e24248c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a932240eda5040c3ae1560462485adeb'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:28.898718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-170af0e5-f3b2-406d-a9fc-40aa6e24248c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a932240eda5040c3ae1560462485adeb'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:28.905940 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-170af0e5-f3b2-406d-a9fc-40aa6e24248c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a932240eda5040c3ae1560462485adeb'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:28.911590 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1312/2621] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:09:28 2021] DELETE /identity/v3/users/a932240eda5040c3ae1560462485adeb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:09:29.181798 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342142a-5dbc-4fda-b861-a9673e5dc914 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:29.183254 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-5342142a-5dbc-4fda-b861-a9673e5dc914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:29.196204 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342142a-5dbc-4fda-b861-a9673e5dc914 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:29.251707 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19c0ff-4c5f-429a-ac47-723d50baf16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:29.252550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19c0ff-4c5f-429a-ac47-723d50baf16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:29.252833 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19c0ff-4c5f-429a-ac47-723d50baf16e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:29.253144 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19c0ff-4c5f-429a-ac47-723d50baf16e admin admin] PATH_INFO: `/v3/projects/ce1c207cd5f844de9107978a2dda9643` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:29.254352 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19c0ff-4c5f-429a-ac47-723d50baf16e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1c207cd5f844de9107978a2dda9643)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:29.256245 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19c0ff-4c5f-429a-ac47-723d50baf16e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:29.299337 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-2c19c0ff-4c5f-429a-ac47-723d50baf16e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1c207cd5f844de9107978a2dda9643', 'request_id': 'req-2c19c0ff-4c5f-429a-ac47-723d50baf16e'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:29.305621 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-2c19c0ff-4c5f-429a-ac47-723d50baf16e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1c207cd5f844de9107978a2dda9643', 'request_id': 'req-2c19c0ff-4c5f-429a-ac47-723d50baf16e'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:29.311963 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-2c19c0ff-4c5f-429a-ac47-723d50baf16e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1c207cd5f844de9107978a2dda9643', 'request_id': 'req-2c19c0ff-4c5f-429a-ac47-723d50baf16e'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:29.322169 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-2c19c0ff-4c5f-429a-ac47-723d50baf16e admin admin] The token cache is being invalidate because project ce1c207cd5f844de9107978a2dda9643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:09:29.322455 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-2c19c0ff-4c5f-429a-ac47-723d50baf16e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:29.323065 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-2c19c0ff-4c5f-429a-ac47-723d50baf16e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:29.324539 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1310/2622] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:09:29 2021] DELETE /identity/v3/projects/ce1c207cd5f844de9107978a2dda9643 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:09:29.330537 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e5836-0c4b-4056-bad9-a3b823b81031 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:29.331026 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e5836-0c4b-4056-bad9-a3b823b81031 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:29.331123 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e5836-0c4b-4056-bad9-a3b823b81031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:29.351833 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-e18e5836-0c4b-4056-bad9-a3b823b81031 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:09:29.353068 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-e18e5836-0c4b-4056-bad9-a3b823b81031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:29.408941 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1313/2623] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:09:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:09:29.417115 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8cacf-f085-4bc7-8c22-7eb32d40536f None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:29.417407 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8cacf-f085-4bc7-8c22-7eb32d40536f None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:29.417689 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8cacf-f085-4bc7-8c22-7eb32d40536f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:29.436660 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-1df8cacf-f085-4bc7-8c22-7eb32d40536f None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:09:29.437893 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-1df8cacf-f085-4bc7-8c22-7eb32d40536f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:29.445810 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1311/2624] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:09:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:09:29.449857 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e5836-0c4b-4056-bad9-a3b823b81031 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:29.461482 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e5836-0c4b-4056-bad9-a3b823b81031 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:29.464174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc517f-bda3-4542-afc0-7d4ddb059081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:29.464866 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc517f-bda3-4542-afc0-7d4ddb059081 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:29.465181 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc517f-bda3-4542-afc0-7d4ddb059081 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:29.465456 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc517f-bda3-4542-afc0-7d4ddb059081 admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:29.467150 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc517f-bda3-4542-afc0-7d4ddb059081 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 03:09:29.467438 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc517f-bda3-4542-afc0-7d4ddb059081 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:29.469077 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc517f-bda3-4542-afc0-7d4ddb059081 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:29.480845 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1314/2625] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 03:09:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 03:09:29.485876 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8cacf-f085-4bc7-8c22-7eb32d40536f None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:29.495261 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8cacf-f085-4bc7-8c22-7eb32d40536f None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:29.500277 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d5c2b-3e53-4808-9236-43977f3f613a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:29.500564 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d5c2b-3e53-4808-9236-43977f3f613a admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:29.500820 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d5c2b-3e53-4808-9236-43977f3f613a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:29.501132 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d5c2b-3e53-4808-9236-43977f3f613a admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:29.501816 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d5c2b-3e53-4808-9236-43977f3f613a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:29.507924 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d5c2b-3e53-4808-9236-43977f3f613a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:29.533853 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc517f-bda3-4542-afc0-7d4ddb059081 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:29.534744 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1312/2626] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:09:29 2021] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:09:29.535714 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-a4cc517f-bda3-4542-afc0-7d4ddb059081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:29.538575 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d5c2b-3e53-4808-9236-43977f3f613a admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:29.593318 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc517f-bda3-4542-afc0-7d4ddb059081 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:29.596910 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d5c2b-3e53-4808-9236-43977f3f613a admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:29.601513 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f7c7e-8fd5-4018-8773-22d3b13ee794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:29.602306 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f7c7e-8fd5-4018-8773-22d3b13ee794 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:29.602610 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f7c7e-8fd5-4018-8773-22d3b13ee794 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:29.602906 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f7c7e-8fd5-4018-8773-22d3b13ee794 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:29.603592 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f7c7e-8fd5-4018-8773-22d3b13ee794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:29.605577 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f7c7e-8fd5-4018-8773-22d3b13ee794 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:29.625327 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1313/2627] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:09:29 2021] POST /identity/v3/users => generated 286 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:09:29.629381 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f7c7e-8fd5-4018-8773-22d3b13ee794 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:29.638537 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f7c7e-8fd5-4018-8773-22d3b13ee794 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:29.641588 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cf313-8174-43d4-b272-5c53b2df6410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:29.642236 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cf313-8174-43d4-b272-5c53b2df6410 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:29.642571 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cf313-8174-43d4-b272-5c53b2df6410 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:29.642854 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6cf313-8174-43d4-b272-5c53b2df6410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:29.643117 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c2291-5110-4eb8-a0bf-8bf3fd52b2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:29.643752 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c2291-5110-4eb8-a0bf-8bf3fd52b2cd admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:29.644034 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c2291-5110-4eb8-a0bf-8bf3fd52b2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:29.644313 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c2291-5110-4eb8-a0bf-8bf3fd52b2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:29.644909 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-0b6cf313-8174-43d4-b272-5c53b2df6410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:29.645035 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c2291-5110-4eb8-a0bf-8bf3fd52b2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:29.646635 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c2291-5110-4eb8-a0bf-8bf3fd52b2cd admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:29.656992 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1314/2628] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:09:29 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:09:29.657475 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6cf313-8174-43d4-b272-5c53b2df6410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:29.659008 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6cf313-8174-43d4-b272-5c53b2df6410 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:29.660649 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c2291-5110-4eb8-a0bf-8bf3fd52b2cd admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:29.669010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1315/2629] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:09:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 03:09:29.669785 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c2291-5110-4eb8-a0bf-8bf3fd52b2cd admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:29.674945 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e453f6-d9af-4a20-b15f-e62ea5879d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:29.675597 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e453f6-d9af-4a20-b15f-e62ea5879d6c admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:29.675884 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e453f6-d9af-4a20-b15f-e62ea5879d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:29.676163 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e453f6-d9af-4a20-b15f-e62ea5879d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:29.676970 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e453f6-d9af-4a20-b15f-e62ea5879d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:29.678546 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e453f6-d9af-4a20-b15f-e62ea5879d6c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:29.689446 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1315/2630] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:09:29 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 03:09:29.693250 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cf313-8174-43d4-b272-5c53b2df6410 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:29.702557 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6cf313-8174-43d4-b272-5c53b2df6410 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:29.707400 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e05d8-378b-4609-8987-ee19d8e9c93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:29.708338 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e05d8-378b-4609-8987-ee19d8e9c93b admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:29.708685 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e05d8-378b-4609-8987-ee19d8e9c93b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:29.709055 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e05d8-378b-4609-8987-ee19d8e9c93b admin admin] PATH_INFO: `/v3/projects/a1ecd939bfae4f37a8b7345f4da77e19/users/db355c3901dc4fcf990f84d72168aef8/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:29.723926 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e05d8-378b-4609-8987-ee19d8e9c93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ecd939bfae4f37a8b7345f4da77e19, user_id=db355c3901dc4fcf990f84d72168aef8, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:29.726676 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e05d8-378b-4609-8987-ee19d8e9c93b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:29.740170 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1316/2631] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:09:29 2021] PUT /identity/v3/projects/a1ecd939bfae4f37a8b7345f4da77e19/users/db355c3901dc4fcf990f84d72168aef8/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:09:29.751409 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc11aeb-6b14-44b1-b718-d8a5af2189de None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:29.751698 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc11aeb-6b14-44b1-b718-d8a5af2189de None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:29.751974 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc11aeb-6b14-44b1-b718-d8a5af2189de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:29.776956 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-fdc11aeb-6b14-44b1-b718-d8a5af2189de None None] MFA Rules not processed for user `db355c3901dc4fcf990f84d72168aef8`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:09:29.778688 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-fdc11aeb-6b14-44b1-b718-d8a5af2189de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:29.850659 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1316/2632] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:09:29 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:09:29.863588 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e05d8-378b-4609-8987-ee19d8e9c93b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:29.866072 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-3d2e05d8-378b-4609-8987-ee19d8e9c93b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:29.937104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e05d8-378b-4609-8987-ee19d8e9c93b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:29.940926 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318ba39-bc13-43e8-9b42-2568592a3fc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:29.941587 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318ba39-bc13-43e8-9b42-2568592a3fc6 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:29.941868 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318ba39-bc13-43e8-9b42-2568592a3fc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:29.942143 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318ba39-bc13-43e8-9b42-2568592a3fc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:29.951743 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318ba39-bc13-43e8-9b42-2568592a3fc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:29.952715 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318ba39-bc13-43e8-9b42-2568592a3fc6 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:29.965815 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1317/2633] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:09:29 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:09:29.986480 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc11aeb-6b14-44b1-b718-d8a5af2189de None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:30.051320 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc11aeb-6b14-44b1-b718-d8a5af2189de None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:30.056686 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51128309-b860-4f29-8c76-8036a8c6bc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:30.057635 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51128309-b860-4f29-8c76-8036a8c6bc89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:30.057919 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51128309-b860-4f29-8c76-8036a8c6bc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:30.058196 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51128309-b860-4f29-8c76-8036a8c6bc89 admin admin] PATH_INFO: `/v3/users/db355c3901dc4fcf990f84d72168aef8` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:30.059529 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51128309-b860-4f29-8c76-8036a8c6bc89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db355c3901dc4fcf990f84d72168aef8)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:30.061998 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51128309-b860-4f29-8c76-8036a8c6bc89 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:30.113301 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-51128309-b860-4f29-8c76-8036a8c6bc89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db355c3901dc4fcf990f84d72168aef8'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:30.114258 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-51128309-b860-4f29-8c76-8036a8c6bc89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db355c3901dc4fcf990f84d72168aef8'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:30.123258 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-51128309-b860-4f29-8c76-8036a8c6bc89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db355c3901dc4fcf990f84d72168aef8'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:30.124202 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-51128309-b860-4f29-8c76-8036a8c6bc89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db355c3901dc4fcf990f84d72168aef8'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:30.139708 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-51128309-b860-4f29-8c76-8036a8c6bc89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db355c3901dc4fcf990f84d72168aef8'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:30.152835 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1317/2634] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:09:29 2021] DELETE /identity/v3/users/db355c3901dc4fcf990f84d72168aef8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:09:30.157670 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cb514-1a97-43b3-a4dc-ad22f7ef9222 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:30.158091 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cb514-1a97-43b3-a4dc-ad22f7ef9222 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:30.158454 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cb514-1a97-43b3-a4dc-ad22f7ef9222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:30.177599 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-3f8cb514-1a97-43b3-a4dc-ad22f7ef9222 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:09:30.178986 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-3f8cb514-1a97-43b3-a4dc-ad22f7ef9222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:30.246512 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1318/2635] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:09:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:09:30.256508 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51128309-b860-4f29-8c76-8036a8c6bc89 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:30.258072 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-51128309-b860-4f29-8c76-8036a8c6bc89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:30.313286 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51128309-b860-4f29-8c76-8036a8c6bc89 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:30.316925 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73606b3a-35b2-4a3e-8d81-41cd2c430180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:30.317570 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73606b3a-35b2-4a3e-8d81-41cd2c430180 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:30.317851 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73606b3a-35b2-4a3e-8d81-41cd2c430180 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:30.318121 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73606b3a-35b2-4a3e-8d81-41cd2c430180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:30.327404 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73606b3a-35b2-4a3e-8d81-41cd2c430180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:30.328855 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73606b3a-35b2-4a3e-8d81-41cd2c430180 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:30.338200 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1318/2636] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:09:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:09:30.738569 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cb514-1a97-43b3-a4dc-ad22f7ef9222 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:30.740065 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-3f8cb514-1a97-43b3-a4dc-ad22f7ef9222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:30.751821 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cb514-1a97-43b3-a4dc-ad22f7ef9222 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:30.756411 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb76195-a342-4691-a471-e7be229b048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:30.757298 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb76195-a342-4691-a471-e7be229b048b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:30.757580 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb76195-a342-4691-a471-e7be229b048b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:30.757854 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb76195-a342-4691-a471-e7be229b048b admin admin] PATH_INFO: `/v3/projects/a1ecd939bfae4f37a8b7345f4da77e19` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:30.759268 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb76195-a342-4691-a471-e7be229b048b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1ecd939bfae4f37a8b7345f4da77e19)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:30.761024 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb76195-a342-4691-a471-e7be229b048b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:30.808683 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-bfb76195-a342-4691-a471-e7be229b048b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1ecd939bfae4f37a8b7345f4da77e19', 'request_id': 'req-bfb76195-a342-4691-a471-e7be229b048b'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:30.815353 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-bfb76195-a342-4691-a471-e7be229b048b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1ecd939bfae4f37a8b7345f4da77e19', 'request_id': 'req-bfb76195-a342-4691-a471-e7be229b048b'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:30.822566 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-bfb76195-a342-4691-a471-e7be229b048b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1ecd939bfae4f37a8b7345f4da77e19', 'request_id': 'req-bfb76195-a342-4691-a471-e7be229b048b'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:30.834755 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-bfb76195-a342-4691-a471-e7be229b048b admin admin] The token cache is being invalidate because project a1ecd939bfae4f37a8b7345f4da77e19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:09:30.835048 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-bfb76195-a342-4691-a471-e7be229b048b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:30.835695 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-bfb76195-a342-4691-a471-e7be229b048b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:30.837277 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1319/2637] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:09:30 2021] DELETE /identity/v3/projects/a1ecd939bfae4f37a8b7345f4da77e19 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:09:30.842869 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7f77d-1a4b-41a2-a165-0da46d9f60a8 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:30.843162 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7f77d-1a4b-41a2-a165-0da46d9f60a8 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:30.843442 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7f77d-1a4b-41a2-a165-0da46d9f60a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:30.863906 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-f3a7f77d-1a4b-41a2-a165-0da46d9f60a8 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:09:30.865131 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-f3a7f77d-1a4b-41a2-a165-0da46d9f60a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:30.923487 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1319/2638] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:09:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:09:30.932479 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc4711-c330-4f43-ae56-81811abd40ff None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:30.932479 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc4711-c330-4f43-ae56-81811abd40ff None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:30.932479 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc4711-c330-4f43-ae56-81811abd40ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:30.953441 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-48cc4711-c330-4f43-ae56-81811abd40ff None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:09:30.955423 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-48cc4711-c330-4f43-ae56-81811abd40ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:30.965168 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1320/2639] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:09:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:09:30.969705 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7f77d-1a4b-41a2-a165-0da46d9f60a8 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:30.982150 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7f77d-1a4b-41a2-a165-0da46d9f60a8 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:30.987250 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de5361-5ee6-4810-ad5a-00c849874d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:30.987922 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de5361-5ee6-4810-ad5a-00c849874d59 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:30.988236 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de5361-5ee6-4810-ad5a-00c849874d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:30.988516 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de5361-5ee6-4810-ad5a-00c849874d59 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:30.989286 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de5361-5ee6-4810-ad5a-00c849874d59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 03:09:30.989598 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de5361-5ee6-4810-ad5a-00c849874d59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:30.991205 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de5361-5ee6-4810-ad5a-00c849874d59 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:31.004243 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1320/2640] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 03:09:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 03:09:31.008427 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc4711-c330-4f43-ae56-81811abd40ff None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:31.019620 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc4711-c330-4f43-ae56-81811abd40ff None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:31.025009 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d944c-a165-47d8-85fb-50e70887bf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:31.025769 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d944c-a165-47d8-85fb-50e70887bf9e admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:31.026122 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d944c-a165-47d8-85fb-50e70887bf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:31.026467 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d944c-a165-47d8-85fb-50e70887bf9e admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:31.027248 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d944c-a165-47d8-85fb-50e70887bf9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:31.029830 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d944c-a165-47d8-85fb-50e70887bf9e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:31.058853 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1321/2641] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:09:31 2021] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:09:31.063111 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de5361-5ee6-4810-ad5a-00c849874d59 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:31.073262 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de5361-5ee6-4810-ad5a-00c849874d59 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:31.129846 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa0d42-3bdb-49c2-a84a-64b5bef7fc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:31.130516 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa0d42-3bdb-49c2-a84a-64b5bef7fc61 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:31.130801 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa0d42-3bdb-49c2-a84a-64b5bef7fc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:31.131083 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa0d42-3bdb-49c2-a84a-64b5bef7fc61 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:31.131763 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa0d42-3bdb-49c2-a84a-64b5bef7fc61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:31.133698 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa0d42-3bdb-49c2-a84a-64b5bef7fc61 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:31.152939 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1321/2642] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:09:31 2021] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:09:31.157254 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d944c-a165-47d8-85fb-50e70887bf9e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:31.167328 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d944c-a165-47d8-85fb-50e70887bf9e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:31.172787 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f1a11-36e4-4041-874d-cb6708dcfe02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:31.173484 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f1a11-36e4-4041-874d-cb6708dcfe02 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:31.173770 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f1a11-36e4-4041-874d-cb6708dcfe02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:31.174047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f1a11-36e4-4041-874d-cb6708dcfe02 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:31.174770 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f1a11-36e4-4041-874d-cb6708dcfe02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:31.176355 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f1a11-36e4-4041-874d-cb6708dcfe02 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:31.187354 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1322/2643] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:09:31 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 03:09:31.191075 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa0d42-3bdb-49c2-a84a-64b5bef7fc61 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:31.200674 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa0d42-3bdb-49c2-a84a-64b5bef7fc61 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:31.205365 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3ba1b-1f63-4431-a9e3-014a1277ffaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:31.206071 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3ba1b-1f63-4431-a9e3-014a1277ffaa admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:31.206357 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3ba1b-1f63-4431-a9e3-014a1277ffaa admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:31.206630 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3ba1b-1f63-4431-a9e3-014a1277ffaa admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:31.207345 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3ba1b-1f63-4431-a9e3-014a1277ffaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:31.208929 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3ba1b-1f63-4431-a9e3-014a1277ffaa admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:31.219009 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1322/2644] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:09:31 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:09:31.222997 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f1a11-36e4-4041-874d-cb6708dcfe02 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:31.233582 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f1a11-36e4-4041-874d-cb6708dcfe02 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:31.238157 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22b5a3-82bb-4aac-ba8f-e783f6fb121f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:31.239038 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22b5a3-82bb-4aac-ba8f-e783f6fb121f admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:31.239363 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22b5a3-82bb-4aac-ba8f-e783f6fb121f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:31.239788 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22b5a3-82bb-4aac-ba8f-e783f6fb121f admin admin] PATH_INFO: `/v3/projects/24cdfc9cd3ca47e1b2652fd7962dc8dc/users/041a0916fe624cbbb9b9145487f0893a/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:31.253956 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22b5a3-82bb-4aac-ba8f-e783f6fb121f admin admin] RBAC: Authorizing `identity:create_grant(project_id=24cdfc9cd3ca47e1b2652fd7962dc8dc, user_id=041a0916fe624cbbb9b9145487f0893a, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:31.256694 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22b5a3-82bb-4aac-ba8f-e783f6fb121f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:31.269849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1323/2645] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:09:31 2021] PUT /identity/v3/projects/24cdfc9cd3ca47e1b2652fd7962dc8dc/users/041a0916fe624cbbb9b9145487f0893a/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:09:31.281229 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b40f12-5011-40e0-9e33-d8cfa4b12a42 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:31.281739 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b40f12-5011-40e0-9e33-d8cfa4b12a42 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:31.281849 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b40f12-5011-40e0-9e33-d8cfa4b12a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:31.308317 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-c2b40f12-5011-40e0-9e33-d8cfa4b12a42 None None] MFA Rules not processed for user `041a0916fe624cbbb9b9145487f0893a`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:09:31.309586 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c2b40f12-5011-40e0-9e33-d8cfa4b12a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:31.371623 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1323/2646] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:09:31 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:09:31.383214 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22b5a3-82bb-4aac-ba8f-e783f6fb121f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:31.385354 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-5f22b5a3-82bb-4aac-ba8f-e783f6fb121f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:31.446300 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22b5a3-82bb-4aac-ba8f-e783f6fb121f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:31.451022 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd409c-bb40-468a-932c-0954503dbd40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71d661d14d94fa597aee037599de7a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:31.451671 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd409c-bb40-468a-932c-0954503dbd40 service glance] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:31.452071 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd409c-bb40-468a-932c-0954503dbd40 service glance] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:31.452352 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd409c-bb40-468a-932c-0954503dbd40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:31.461057 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd409c-bb40-468a-932c-0954503dbd40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:31.462635 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd409c-bb40-468a-932c-0954503dbd40 service glance] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:31.474545 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1324/2647] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:09:31 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:09:33.023846 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b40f12-5011-40e0-9e33-d8cfa4b12a42 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:33.025571 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c2b40f12-5011-40e0-9e33-d8cfa4b12a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:33.094502 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b40f12-5011-40e0-9e33-d8cfa4b12a42 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:33.099350 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa300e-87b7-4093-b7cf-5551ccf087ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:33.100202 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa300e-87b7-4093-b7cf-5551ccf087ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:33.100480 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa300e-87b7-4093-b7cf-5551ccf087ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:33.100752 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa300e-87b7-4093-b7cf-5551ccf087ef admin admin] PATH_INFO: `/v3/users/826e7ceb2e914a289a850340a0be1d05` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:33.101959 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa300e-87b7-4093-b7cf-5551ccf087ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=826e7ceb2e914a289a850340a0be1d05)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:33.103853 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa300e-87b7-4093-b7cf-5551ccf087ef admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:33.150306 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8eaa300e-87b7-4093-b7cf-5551ccf087ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '826e7ceb2e914a289a850340a0be1d05'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:33.150982 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8eaa300e-87b7-4093-b7cf-5551ccf087ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '826e7ceb2e914a289a850340a0be1d05'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:33.158528 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8eaa300e-87b7-4093-b7cf-5551ccf087ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '826e7ceb2e914a289a850340a0be1d05'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:33.159226 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8eaa300e-87b7-4093-b7cf-5551ccf087ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '826e7ceb2e914a289a850340a0be1d05'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:33.170794 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-8eaa300e-87b7-4093-b7cf-5551ccf087ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '826e7ceb2e914a289a850340a0be1d05'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:33.183475 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1324/2648] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:09:33 2021] DELETE /identity/v3/users/826e7ceb2e914a289a850340a0be1d05 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:09:33.355024 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd409c-bb40-468a-932c-0954503dbd40 service glance] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:33.367701 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd409c-bb40-468a-932c-0954503dbd40 service glance] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:33.423061 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71769352-7e58-40ba-878e-391d16794258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:33.423944 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71769352-7e58-40ba-878e-391d16794258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:33.424272 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71769352-7e58-40ba-878e-391d16794258 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:33.424498 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71769352-7e58-40ba-878e-391d16794258 admin admin] PATH_INFO: `/v3/projects/2d44af7c3f99444b98d4422982551f2a` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:33.425760 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71769352-7e58-40ba-878e-391d16794258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d44af7c3f99444b98d4422982551f2a)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:33.427616 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71769352-7e58-40ba-878e-391d16794258 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:33.472514 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-71769352-7e58-40ba-878e-391d16794258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d44af7c3f99444b98d4422982551f2a', 'request_id': 'req-71769352-7e58-40ba-878e-391d16794258'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:33.478530 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-71769352-7e58-40ba-878e-391d16794258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d44af7c3f99444b98d4422982551f2a', 'request_id': 'req-71769352-7e58-40ba-878e-391d16794258'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:33.486099 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-71769352-7e58-40ba-878e-391d16794258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d44af7c3f99444b98d4422982551f2a', 'request_id': 'req-71769352-7e58-40ba-878e-391d16794258'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:33.498103 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-71769352-7e58-40ba-878e-391d16794258 admin admin] The token cache is being invalidate because project 2d44af7c3f99444b98d4422982551f2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:09:33.498371 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-71769352-7e58-40ba-878e-391d16794258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:33.499309 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-71769352-7e58-40ba-878e-391d16794258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:09:33.500651 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1325/2649] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:09:33 2021] DELETE /identity/v3/projects/2d44af7c3f99444b98d4422982551f2a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:09:33.507422 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6b78c-e312-44eb-a78a-d93ac66c63d1 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:33.507710 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6b78c-e312-44eb-a78a-d93ac66c63d1 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:33.507986 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6b78c-e312-44eb-a78a-d93ac66c63d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:33.527411 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-10d6b78c-e312-44eb-a78a-d93ac66c63d1 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:09:33.528655 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-10d6b78c-e312-44eb-a78a-d93ac66c63d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:33.586626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1325/2650] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:09:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:09:33.594425 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa082c-6788-4204-a79c-759ffd1230f8 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:33.594825 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa082c-6788-4204-a79c-759ffd1230f8 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:33.595104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa082c-6788-4204-a79c-759ffd1230f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:33.614683 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-80fa082c-6788-4204-a79c-759ffd1230f8 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:09:33.615793 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-80fa082c-6788-4204-a79c-759ffd1230f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:33.624152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1326/2651] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:09:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:09:33.628512 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6b78c-e312-44eb-a78a-d93ac66c63d1 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:33.638090 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6b78c-e312-44eb-a78a-d93ac66c63d1 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:33.642683 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f952f-77ec-4d4b-9d51-0b6273eb20f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:33.643550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f952f-77ec-4d4b-9d51-0b6273eb20f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:33.643884 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f952f-77ec-4d4b-9d51-0b6273eb20f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:33.644202 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f952f-77ec-4d4b-9d51-0b6273eb20f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:33.645165 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f952f-77ec-4d4b-9d51-0b6273eb20f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 03:09:33.645540 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f952f-77ec-4d4b-9d51-0b6273eb20f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:33.647131 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f952f-77ec-4d4b-9d51-0b6273eb20f2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:33.660533 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1326/2652] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 03:09:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 03:09:33.663507 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa082c-6788-4204-a79c-759ffd1230f8 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:33.673230 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa082c-6788-4204-a79c-759ffd1230f8 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:33.677922 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70b83c-7a84-4574-9dfc-785e855af4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:33.678569 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70b83c-7a84-4574-9dfc-785e855af4c9 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:33.678849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70b83c-7a84-4574-9dfc-785e855af4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:33.679122 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70b83c-7a84-4574-9dfc-785e855af4c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:33.679822 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70b83c-7a84-4574-9dfc-785e855af4c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:33.682038 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70b83c-7a84-4574-9dfc-785e855af4c9 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:33.708152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1327/2653] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:09:33 2021] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:09:33.712395 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f952f-77ec-4d4b-9d51-0b6273eb20f2 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:33.722724 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f952f-77ec-4d4b-9d51-0b6273eb20f2 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:33.778639 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953366fd-a012-4de5-bb46-e37d325a301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:33.779306 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953366fd-a012-4de5-bb46-e37d325a301e admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:33.779592 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953366fd-a012-4de5-bb46-e37d325a301e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:33.779868 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953366fd-a012-4de5-bb46-e37d325a301e admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:33.780544 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953366fd-a012-4de5-bb46-e37d325a301e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:33.782478 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953366fd-a012-4de5-bb46-e37d325a301e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:33.804021 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1327/2654] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:09:33 2021] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:09:33.808404 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70b83c-7a84-4574-9dfc-785e855af4c9 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:33.819088 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70b83c-7a84-4574-9dfc-785e855af4c9 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:33.823943 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37feb1-8f31-475b-9947-e41042e75118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:33.824605 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37feb1-8f31-475b-9947-e41042e75118 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:33.824908 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37feb1-8f31-475b-9947-e41042e75118 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:33.825217 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37feb1-8f31-475b-9947-e41042e75118 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:33.825949 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37feb1-8f31-475b-9947-e41042e75118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:33.827603 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37feb1-8f31-475b-9947-e41042e75118 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:33.838282 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1328/2655] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:09:33 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:09:33.842623 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953366fd-a012-4de5-bb46-e37d325a301e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:33.852609 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953366fd-a012-4de5-bb46-e37d325a301e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:33.858273 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8a52f-d77d-4d49-bfab-9ff9fa2eca76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:33.859078 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8a52f-d77d-4d49-bfab-9ff9fa2eca76 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:33.859410 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8a52f-d77d-4d49-bfab-9ff9fa2eca76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:33.859689 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8a52f-d77d-4d49-bfab-9ff9fa2eca76 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:33.860435 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8a52f-d77d-4d49-bfab-9ff9fa2eca76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:33.862088 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8a52f-d77d-4d49-bfab-9ff9fa2eca76 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:33.872836 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1328/2656] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:09:33 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:09:33.876954 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37feb1-8f31-475b-9947-e41042e75118 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:33.886876 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37feb1-8f31-475b-9947-e41042e75118 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:33.891626 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec4469-8cdf-4c4b-9cf3-976d1ccae6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:33.892504 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec4469-8cdf-4c4b-9cf3-976d1ccae6dd admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:33.892789 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec4469-8cdf-4c4b-9cf3-976d1ccae6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:33.893097 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec4469-8cdf-4c4b-9cf3-976d1ccae6dd admin admin] PATH_INFO: `/v3/projects/1b39a901d49c4f02a27e4bfd6eb6cf8c/users/15d428eaf39f4d469395e004692b050e/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:33.907295 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec4469-8cdf-4c4b-9cf3-976d1ccae6dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b39a901d49c4f02a27e4bfd6eb6cf8c, user_id=15d428eaf39f4d469395e004692b050e, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:33.910041 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec4469-8cdf-4c4b-9cf3-976d1ccae6dd admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:33.923477 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1329/2657] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:09:33 2021] PUT /identity/v3/projects/1b39a901d49c4f02a27e4bfd6eb6cf8c/users/15d428eaf39f4d469395e004692b050e/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:09:33.933759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ef855-6615-4ed5-9016-47f5087f15b3 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:33.934053 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ef855-6615-4ed5-9016-47f5087f15b3 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:33.934957 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ef855-6615-4ed5-9016-47f5087f15b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:33.961550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-8a8ef855-6615-4ed5-9016-47f5087f15b3 None None] MFA Rules not processed for user `15d428eaf39f4d469395e004692b050e`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:09:33.962752 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8a8ef855-6615-4ed5-9016-47f5087f15b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:34.028976 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1329/2658] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:09:33 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:09:34.039868 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec4469-8cdf-4c4b-9cf3-976d1ccae6dd admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:34.041746 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-e7ec4469-8cdf-4c4b-9cf3-976d1ccae6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:34.114357 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec4469-8cdf-4c4b-9cf3-976d1ccae6dd admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:34.119972 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12887c95-6a3a-4257-9a4b-5c6623da3bbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:34.120610 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12887c95-6a3a-4257-9a4b-5c6623da3bbe service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:34.120907 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12887c95-6a3a-4257-9a4b-5c6623da3bbe service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:34.121195 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12887c95-6a3a-4257-9a4b-5c6623da3bbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:34.129464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12887c95-6a3a-4257-9a4b-5c6623da3bbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:34.130979 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12887c95-6a3a-4257-9a4b-5c6623da3bbe service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:34.139753 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1330/2659] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:09:34 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:09:34.160143 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ef855-6615-4ed5-9016-47f5087f15b3 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:09:34.161536 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8a8ef855-6615-4ed5-9016-47f5087f15b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:34.216569 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ef855-6615-4ed5-9016-47f5087f15b3 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:09:34.220347 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d866875-6370-4ccf-871d-30524d0c6e98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:09:34.221020 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d866875-6370-4ccf-871d-30524d0c6e98 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:09:34.221301 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d866875-6370-4ccf-871d-30524d0c6e98 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:09:34.221572 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d866875-6370-4ccf-871d-30524d0c6e98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:09:34.223373 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8d866875-6370-4ccf-871d-30524d0c6e98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:09:34.237297 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d866875-6370-4ccf-871d-30524d0c6e98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:09:34.238727 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d866875-6370-4ccf-871d-30524d0c6e98 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:09:34.249290 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1330/2660] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:09:34 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:10:12.188420 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12887c95-6a3a-4257-9a4b-5c6623da3bbe service nova] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:12.189937 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-12887c95-6a3a-4257-9a4b-5c6623da3bbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:12.251956 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12887c95-6a3a-4257-9a4b-5c6623da3bbe service nova] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:12.256375 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cbf6b-2db5-420d-bc19-1ee9c9e8ae47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:12.257255 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cbf6b-2db5-420d-bc19-1ee9c9e8ae47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:12.257533 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cbf6b-2db5-420d-bc19-1ee9c9e8ae47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:12.257805 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cbf6b-2db5-420d-bc19-1ee9c9e8ae47 admin admin] PATH_INFO: `/v3/users/041a0916fe624cbbb9b9145487f0893a` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:12.258967 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cbf6b-2db5-420d-bc19-1ee9c9e8ae47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=041a0916fe624cbbb9b9145487f0893a)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:12.260898 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cbf6b-2db5-420d-bc19-1ee9c9e8ae47 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:12.303297 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-882cbf6b-2db5-420d-bc19-1ee9c9e8ae47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '041a0916fe624cbbb9b9145487f0893a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:12.314568 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-882cbf6b-2db5-420d-bc19-1ee9c9e8ae47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '041a0916fe624cbbb9b9145487f0893a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:12.315235 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-882cbf6b-2db5-420d-bc19-1ee9c9e8ae47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '041a0916fe624cbbb9b9145487f0893a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:12.322010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-882cbf6b-2db5-420d-bc19-1ee9c9e8ae47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '041a0916fe624cbbb9b9145487f0893a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:12.328676 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-882cbf6b-2db5-420d-bc19-1ee9c9e8ae47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '041a0916fe624cbbb9b9145487f0893a'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:12.334434 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1331/2661] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:10:12 2021] DELETE /identity/v3/users/041a0916fe624cbbb9b9145487f0893a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:10:12.339063 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a016e63-009e-4a77-b6e3-52484826d472 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:12.339544 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a016e63-009e-4a77-b6e3-52484826d472 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:12.339648 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a016e63-009e-4a77-b6e3-52484826d472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:12.356796 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-7a016e63-009e-4a77-b6e3-52484826d472 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:10:12.357999 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7a016e63-009e-4a77-b6e3-52484826d472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:12.414549 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1331/2662] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:10:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:10:12.425666 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cbf6b-2db5-420d-bc19-1ee9c9e8ae47 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:12.427041 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-882cbf6b-2db5-420d-bc19-1ee9c9e8ae47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:12.480552 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cbf6b-2db5-420d-bc19-1ee9c9e8ae47 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:12.484826 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb852c6d-7a3e-439c-a25a-55fe59cc5cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:12.485486 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb852c6d-7a3e-439c-a25a-55fe59cc5cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:12.485765 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb852c6d-7a3e-439c-a25a-55fe59cc5cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:12.486034 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb852c6d-7a3e-439c-a25a-55fe59cc5cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:12.494748 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb852c6d-7a3e-439c-a25a-55fe59cc5cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:12.496170 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb852c6d-7a3e-439c-a25a-55fe59cc5cc5 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:12.505634 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1332/2663] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:10:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:10:12.765511 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a016e63-009e-4a77-b6e3-52484826d472 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:12.766941 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7a016e63-009e-4a77-b6e3-52484826d472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:12.779050 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a016e63-009e-4a77-b6e3-52484826d472 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:12.784410 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df072f-1b38-433f-ad87-76670ee254a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:12.785064 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df072f-1b38-433f-ad87-76670ee254a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:12.785350 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df072f-1b38-433f-ad87-76670ee254a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:12.785626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df072f-1b38-433f-ad87-76670ee254a0 admin admin] PATH_INFO: `/v3/projects/24cdfc9cd3ca47e1b2652fd7962dc8dc` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:12.786892 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df072f-1b38-433f-ad87-76670ee254a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24cdfc9cd3ca47e1b2652fd7962dc8dc)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:12.788694 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df072f-1b38-433f-ad87-76670ee254a0 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:12.838708 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-40df072f-1b38-433f-ad87-76670ee254a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24cdfc9cd3ca47e1b2652fd7962dc8dc', 'request_id': 'req-40df072f-1b38-433f-ad87-76670ee254a0'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:12.846994 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-40df072f-1b38-433f-ad87-76670ee254a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24cdfc9cd3ca47e1b2652fd7962dc8dc', 'request_id': 'req-40df072f-1b38-433f-ad87-76670ee254a0'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:12.854113 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-40df072f-1b38-433f-ad87-76670ee254a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24cdfc9cd3ca47e1b2652fd7962dc8dc', 'request_id': 'req-40df072f-1b38-433f-ad87-76670ee254a0'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:12.864909 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-40df072f-1b38-433f-ad87-76670ee254a0 admin admin] The token cache is being invalidate because project 24cdfc9cd3ca47e1b2652fd7962dc8dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:10:12.865204 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-40df072f-1b38-433f-ad87-76670ee254a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:12.865837 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-40df072f-1b38-433f-ad87-76670ee254a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:12.867362 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1332/2664] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:10:12 2021] DELETE /identity/v3/projects/24cdfc9cd3ca47e1b2652fd7962dc8dc => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:10:12.872989 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de07773-f5d5-43a8-8de5-cecbbb487862 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:12.873286 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de07773-f5d5-43a8-8de5-cecbbb487862 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:12.873563 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de07773-f5d5-43a8-8de5-cecbbb487862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:12.891477 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-2de07773-f5d5-43a8-8de5-cecbbb487862 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:10:12.892665 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-2de07773-f5d5-43a8-8de5-cecbbb487862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:12.948312 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1333/2665] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:10:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:10:12.956535 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3ea5e-b8a8-4d87-9e2d-4821a8aad738 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:12.956823 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3ea5e-b8a8-4d87-9e2d-4821a8aad738 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:12.957163 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce3ea5e-b8a8-4d87-9e2d-4821a8aad738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:12.974677 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-1ce3ea5e-b8a8-4d87-9e2d-4821a8aad738 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:10:12.975846 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-1ce3ea5e-b8a8-4d87-9e2d-4821a8aad738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:12.983523 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1333/2666] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:10:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:10:12.987398 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de07773-f5d5-43a8-8de5-cecbbb487862 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:12.996677 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de07773-f5d5-43a8-8de5-cecbbb487862 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:13.001928 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb85c5-ff46-418e-9b75-879e7e1c4a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:13.002610 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb85c5-ff46-418e-9b75-879e7e1c4a0b admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:13.002896 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb85c5-ff46-418e-9b75-879e7e1c4a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:13.003174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb85c5-ff46-418e-9b75-879e7e1c4a0b admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:13.003921 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb85c5-ff46-418e-9b75-879e7e1c4a0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 03:10:13.004231 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb85c5-ff46-418e-9b75-879e7e1c4a0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:13.005858 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb85c5-ff46-418e-9b75-879e7e1c4a0b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:13.017795 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1334/2667] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 03:10:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 03:10:13.021675 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3ea5e-b8a8-4d87-9e2d-4821a8aad738 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:13.030615 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce3ea5e-b8a8-4d87-9e2d-4821a8aad738 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:13.035319 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082131cc-89fc-4027-a247-59873629df92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:13.035987 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082131cc-89fc-4027-a247-59873629df92 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:13.036273 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082131cc-89fc-4027-a247-59873629df92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:13.036548 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082131cc-89fc-4027-a247-59873629df92 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:13.037270 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082131cc-89fc-4027-a247-59873629df92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:13.039143 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082131cc-89fc-4027-a247-59873629df92 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:13.063947 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1334/2668] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:10:13 2021] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:10:13.067900 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb85c5-ff46-418e-9b75-879e7e1c4a0b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:13.078220 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb85c5-ff46-418e-9b75-879e7e1c4a0b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:13.129983 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccd5e7-6de7-433e-b827-4cfcedcd0518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:13.130633 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccd5e7-6de7-433e-b827-4cfcedcd0518 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:13.130913 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccd5e7-6de7-433e-b827-4cfcedcd0518 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:13.131186 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccd5e7-6de7-433e-b827-4cfcedcd0518 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:13.131855 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccd5e7-6de7-433e-b827-4cfcedcd0518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:13.133784 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccd5e7-6de7-433e-b827-4cfcedcd0518 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:13.154500 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1335/2669] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:10:13 2021] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:10:13.159037 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082131cc-89fc-4027-a247-59873629df92 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:13.169293 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082131cc-89fc-4027-a247-59873629df92 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:13.174825 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bac693-eae5-43d0-8fc2-7456df7866ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:13.175478 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bac693-eae5-43d0-8fc2-7456df7866ff admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:13.175759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bac693-eae5-43d0-8fc2-7456df7866ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:13.176036 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bac693-eae5-43d0-8fc2-7456df7866ff admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:13.176751 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bac693-eae5-43d0-8fc2-7456df7866ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:13.178344 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bac693-eae5-43d0-8fc2-7456df7866ff admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:13.188726 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1335/2670] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:10:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:10:13.192584 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccd5e7-6de7-433e-b827-4cfcedcd0518 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:13.202311 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccd5e7-6de7-433e-b827-4cfcedcd0518 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:13.206896 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca45ed-7d7b-42b1-8ac9-0d028274452f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:13.207549 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca45ed-7d7b-42b1-8ac9-0d028274452f admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:13.207831 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca45ed-7d7b-42b1-8ac9-0d028274452f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:13.208106 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca45ed-7d7b-42b1-8ac9-0d028274452f admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:13.208827 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca45ed-7d7b-42b1-8ac9-0d028274452f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:13.210463 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca45ed-7d7b-42b1-8ac9-0d028274452f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:13.220422 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1336/2671] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:10:13 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:10:13.224228 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bac693-eae5-43d0-8fc2-7456df7866ff admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:13.234476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bac693-eae5-43d0-8fc2-7456df7866ff admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:13.239164 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f970d-6502-4047-a32a-58bf7c12edcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:13.240044 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f970d-6502-4047-a32a-58bf7c12edcc admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:13.240322 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f970d-6502-4047-a32a-58bf7c12edcc admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:13.240596 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f970d-6502-4047-a32a-58bf7c12edcc admin admin] PATH_INFO: `/v3/projects/f0385694322047d292eae6ada4c60161/users/95a86997f25c4efdbe5559a07a507342/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:13.254363 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f970d-6502-4047-a32a-58bf7c12edcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0385694322047d292eae6ada4c60161, user_id=95a86997f25c4efdbe5559a07a507342, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:13.256987 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f970d-6502-4047-a32a-58bf7c12edcc admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:13.270105 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1336/2672] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:10:13 2021] PUT /identity/v3/projects/f0385694322047d292eae6ada4c60161/users/95a86997f25c4efdbe5559a07a507342/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:10:13.280760 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3c992-cfdb-4283-bd37-9540d92edf1e None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:13.281076 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3c992-cfdb-4283-bd37-9540d92edf1e None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:13.281353 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3c992-cfdb-4283-bd37-9540d92edf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:13.306426 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-d4b3c992-cfdb-4283-bd37-9540d92edf1e None None] MFA Rules not processed for user `95a86997f25c4efdbe5559a07a507342`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:10:13.307600 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d4b3c992-cfdb-4283-bd37-9540d92edf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:13.366805 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1337/2673] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:10:13 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:10:13.371282 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f970d-6502-4047-a32a-58bf7c12edcc admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:13.431268 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f970d-6502-4047-a32a-58bf7c12edcc admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:13.435972 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec7a7d-b7e5-4ca3-ac83-38a5acc0b0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:13.436646 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec7a7d-b7e5-4ca3-ac83-38a5acc0b0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:13.436956 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec7a7d-b7e5-4ca3-ac83-38a5acc0b0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:13.437233 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec7a7d-b7e5-4ca3-ac83-38a5acc0b0f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:13.437920 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec7a7d-b7e5-4ca3-ac83-38a5acc0b0f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:13.439793 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec7a7d-b7e5-4ca3-ac83-38a5acc0b0f2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:13.463331 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1337/2674] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:10:13 2021] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:10:13.467522 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3c992-cfdb-4283-bd37-9540d92edf1e None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:13.478993 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3c992-cfdb-4283-bd37-9540d92edf1e None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:13.531895 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40548a69-1704-486c-a2ac-f1f798ad657c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:13.532495 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40548a69-1704-486c-a2ac-f1f798ad657c admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:13.532759 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40548a69-1704-486c-a2ac-f1f798ad657c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:13.533068 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40548a69-1704-486c-a2ac-f1f798ad657c admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:13.533756 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40548a69-1704-486c-a2ac-f1f798ad657c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:13.535671 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40548a69-1704-486c-a2ac-f1f798ad657c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:13.554665 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1338/2675] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:10:13 2021] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:10:13.558993 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec7a7d-b7e5-4ca3-ac83-38a5acc0b0f2 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:13.569129 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec7a7d-b7e5-4ca3-ac83-38a5acc0b0f2 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:13.574599 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154c010-a161-4040-8823-278119729ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:13.575388 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154c010-a161-4040-8823-278119729ffe admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:13.575677 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154c010-a161-4040-8823-278119729ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:13.575979 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154c010-a161-4040-8823-278119729ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:13.576762 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154c010-a161-4040-8823-278119729ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:13.579108 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154c010-a161-4040-8823-278119729ffe admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:13.590140 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1338/2676] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:10:13 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:10:13.594708 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40548a69-1704-486c-a2ac-f1f798ad657c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:13.604402 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40548a69-1704-486c-a2ac-f1f798ad657c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:13.609064 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91478a9-62ab-462f-b185-15146401b676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:13.609719 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91478a9-62ab-462f-b185-15146401b676 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:13.610005 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91478a9-62ab-462f-b185-15146401b676 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:13.610284 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91478a9-62ab-462f-b185-15146401b676 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:13.611008 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91478a9-62ab-462f-b185-15146401b676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:13.612595 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91478a9-62ab-462f-b185-15146401b676 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:13.622142 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1339/2677] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:10:13 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:10:13.626465 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154c010-a161-4040-8823-278119729ffe admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:13.635892 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154c010-a161-4040-8823-278119729ffe admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:13.641140 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763bf40-cfa8-4b6d-a850-698a363b7655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:13.641989 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763bf40-cfa8-4b6d-a850-698a363b7655 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:13.642270 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763bf40-cfa8-4b6d-a850-698a363b7655 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:13.642540 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763bf40-cfa8-4b6d-a850-698a363b7655 admin admin] PATH_INFO: `/v3/projects/6d2574c978e04d338d058344f6fc8c4e/users/d18c227ccc2743b4a62dde0d342dbf6c/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:13.656114 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763bf40-cfa8-4b6d-a850-698a363b7655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d2574c978e04d338d058344f6fc8c4e, user_id=d18c227ccc2743b4a62dde0d342dbf6c, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:13.658788 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763bf40-cfa8-4b6d-a850-698a363b7655 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:13.671204 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1339/2678] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:10:13 2021] PUT /identity/v3/projects/6d2574c978e04d338d058344f6fc8c4e/users/d18c227ccc2743b4a62dde0d342dbf6c/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:10:13.682208 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685b49e-bee4-481d-ab53-560d79c0c7da None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:13.682505 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685b49e-bee4-481d-ab53-560d79c0c7da None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:13.682806 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685b49e-bee4-481d-ab53-560d79c0c7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:13.710465 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-3685b49e-bee4-481d-ab53-560d79c0c7da None None] MFA Rules not processed for user `d18c227ccc2743b4a62dde0d342dbf6c`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:10:13.711654 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-3685b49e-bee4-481d-ab53-560d79c0c7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:13.771501 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1340/2679] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:10:13 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:10:13.775798 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763bf40-cfa8-4b6d-a850-698a363b7655 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:13.834500 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763bf40-cfa8-4b6d-a850-698a363b7655 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:13.839053 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056f56d-eb85-48f0-b2f1-7a2b1405bb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:13.839701 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056f56d-eb85-48f0-b2f1-7a2b1405bb6c admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:13.839980 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056f56d-eb85-48f0-b2f1-7a2b1405bb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:13.840250 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056f56d-eb85-48f0-b2f1-7a2b1405bb6c admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:13.840951 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056f56d-eb85-48f0-b2f1-7a2b1405bb6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:13.842855 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056f56d-eb85-48f0-b2f1-7a2b1405bb6c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:13.867089 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1340/2680] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:10:13 2021] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:10:13.871085 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685b49e-bee4-481d-ab53-560d79c0c7da None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:13.882533 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685b49e-bee4-481d-ab53-560d79c0c7da None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:13.938090 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247be1e-eb6a-422e-96b4-9089c5c9cab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:13.938752 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247be1e-eb6a-422e-96b4-9089c5c9cab4 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:13.939033 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247be1e-eb6a-422e-96b4-9089c5c9cab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:13.939305 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247be1e-eb6a-422e-96b4-9089c5c9cab4 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:13.939985 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247be1e-eb6a-422e-96b4-9089c5c9cab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:13.942854 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247be1e-eb6a-422e-96b4-9089c5c9cab4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:13.962181 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1341/2681] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:10:13 2021] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:10:13.966186 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056f56d-eb85-48f0-b2f1-7a2b1405bb6c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:13.976478 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056f56d-eb85-48f0-b2f1-7a2b1405bb6c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:13.981194 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76d636-8995-4358-b397-2941e1953774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:13.981844 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76d636-8995-4358-b397-2941e1953774 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:13.982127 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76d636-8995-4358-b397-2941e1953774 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:13.982425 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76d636-8995-4358-b397-2941e1953774 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:13.983142 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76d636-8995-4358-b397-2941e1953774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:13.984717 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76d636-8995-4358-b397-2941e1953774 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:13.994898 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1341/2682] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:10:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 03:10:13.999562 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247be1e-eb6a-422e-96b4-9089c5c9cab4 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:14.009366 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247be1e-eb6a-422e-96b4-9089c5c9cab4 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:14.013971 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0e89c-5313-461a-8556-80bd14564716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:14.015438 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0e89c-5313-461a-8556-80bd14564716 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:14.015715 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0e89c-5313-461a-8556-80bd14564716 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:14.015987 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0e89c-5313-461a-8556-80bd14564716 admin admin] PATH_INFO: `/v3/projects/a26749a548f1465ea2f32674e553b20c/users/7a8aa219c1ca46e68cd357ff76e00024/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:14.029799 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0e89c-5313-461a-8556-80bd14564716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26749a548f1465ea2f32674e553b20c, user_id=7a8aa219c1ca46e68cd357ff76e00024, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:14.032442 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0e89c-5313-461a-8556-80bd14564716 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:14.044579 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1342/2683] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:10:13 2021] PUT /identity/v3/projects/a26749a548f1465ea2f32674e553b20c/users/7a8aa219c1ca46e68cd357ff76e00024/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:10:14.048931 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76d636-8995-4358-b397-2941e1953774 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:14.058700 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76d636-8995-4358-b397-2941e1953774 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:14.112071 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809263a-a4b0-43aa-b52b-c7148bc1f934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:14.112722 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809263a-a4b0-43aa-b52b-c7148bc1f934 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:14.113032 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809263a-a4b0-43aa-b52b-c7148bc1f934 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:14.113308 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809263a-a4b0-43aa-b52b-c7148bc1f934 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:14.114016 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809263a-a4b0-43aa-b52b-c7148bc1f934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:14.115588 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809263a-a4b0-43aa-b52b-c7148bc1f934 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:14.125406 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1342/2684] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:10:14 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:10:14.129520 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0e89c-5313-461a-8556-80bd14564716 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:14.139506 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0e89c-5313-461a-8556-80bd14564716 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:14.144138 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dce839-4aa3-4f79-b9b8-5e187437c6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:14.145046 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dce839-4aa3-4f79-b9b8-5e187437c6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:14.145326 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dce839-4aa3-4f79-b9b8-5e187437c6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:14.145603 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dce839-4aa3-4f79-b9b8-5e187437c6d7 admin admin] PATH_INFO: `/v3/projects/a26749a548f1465ea2f32674e553b20c/users/7a8aa219c1ca46e68cd357ff76e00024/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:14.147573 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dce839-4aa3-4f79-b9b8-5e187437c6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26749a548f1465ea2f32674e553b20c, user_id=7a8aa219c1ca46e68cd357ff76e00024, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:14.150235 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dce839-4aa3-4f79-b9b8-5e187437c6d7 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:14.160174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1343/2685] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:10:14 2021] PUT /identity/v3/projects/a26749a548f1465ea2f32674e553b20c/users/7a8aa219c1ca46e68cd357ff76e00024/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:10:14.169776 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a97d73-327e-4290-9b5e-8fc22aba46ac None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:14.170068 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a97d73-327e-4290-9b5e-8fc22aba46ac None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:14.170338 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a97d73-327e-4290-9b5e-8fc22aba46ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:14.196626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-27a97d73-327e-4290-9b5e-8fc22aba46ac None None] MFA Rules not processed for user `7a8aa219c1ca46e68cd357ff76e00024`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:10:14.197840 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-27a97d73-327e-4290-9b5e-8fc22aba46ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:14.261519 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1343/2686] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:10:14 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:10:14.271758 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dce839-4aa3-4f79-b9b8-5e187437c6d7 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:14.273465 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-91dce839-4aa3-4f79-b9b8-5e187437c6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:14.327413 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dce839-4aa3-4f79-b9b8-5e187437c6d7 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:14.331194 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2de01-19a1-410a-b2ad-c1fa1bc0ff3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:14.331831 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2de01-19a1-410a-b2ad-c1fa1bc0ff3e service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:14.332114 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2de01-19a1-410a-b2ad-c1fa1bc0ff3e service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:14.332390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2de01-19a1-410a-b2ad-c1fa1bc0ff3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:14.384841 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2de01-19a1-410a-b2ad-c1fa1bc0ff3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:14.386249 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2de01-19a1-410a-b2ad-c1fa1bc0ff3e service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:14.395398 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1344/2687] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:10:14 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:10:15.851979 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a97d73-327e-4290-9b5e-8fc22aba46ac None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:15.861291 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a97d73-327e-4290-9b5e-8fc22aba46ac None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:15.864826 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929a656-079e-4fd0-a9f3-e5f598cfe041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:15.865485 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929a656-079e-4fd0-a9f3-e5f598cfe041 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:15.865766 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929a656-079e-4fd0-a9f3-e5f598cfe041 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:15.866040 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929a656-079e-4fd0-a9f3-e5f598cfe041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:15.919350 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929a656-079e-4fd0-a9f3-e5f598cfe041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:15.920835 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929a656-079e-4fd0-a9f3-e5f598cfe041 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:15.929520 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1344/2688] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:10:15 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:10:16.416402 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2de01-19a1-410a-b2ad-c1fa1bc0ff3e service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:16.424713 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2de01-19a1-410a-b2ad-c1fa1bc0ff3e service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:16.428350 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f189d-b33b-4159-a2a9-f4c8550c7355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:16.429029 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f189d-b33b-4159-a2a9-f4c8550c7355 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:16.429313 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f189d-b33b-4159-a2a9-f4c8550c7355 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:16.429587 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f189d-b33b-4159-a2a9-f4c8550c7355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:16.438499 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f189d-b33b-4159-a2a9-f4c8550c7355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:16.439909 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f189d-b33b-4159-a2a9-f4c8550c7355 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:16.449058 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1345/2689] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:10:16 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:10:20.247423 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929a656-079e-4fd0-a9f3-e5f598cfe041 service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:20.307625 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929a656-079e-4fd0-a9f3-e5f598cfe041 service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:20.312350 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7b0b8-e553-4fae-9dfd-4b296a6047e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:20.313233 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7b0b8-e553-4fae-9dfd-4b296a6047e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:20.313513 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7b0b8-e553-4fae-9dfd-4b296a6047e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:20.313784 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7b0b8-e553-4fae-9dfd-4b296a6047e1 admin admin] PATH_INFO: `/v3/users/95a86997f25c4efdbe5559a07a507342` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:20.314943 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7b0b8-e553-4fae-9dfd-4b296a6047e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a86997f25c4efdbe5559a07a507342)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:20.316952 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7b0b8-e553-4fae-9dfd-4b296a6047e1 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:20.359881 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-fea7b0b8-e553-4fae-9dfd-4b296a6047e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a86997f25c4efdbe5559a07a507342'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:20.360587 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-fea7b0b8-e553-4fae-9dfd-4b296a6047e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a86997f25c4efdbe5559a07a507342'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:20.367312 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-fea7b0b8-e553-4fae-9dfd-4b296a6047e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a86997f25c4efdbe5559a07a507342'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:20.367899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-fea7b0b8-e553-4fae-9dfd-4b296a6047e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a86997f25c4efdbe5559a07a507342'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:20.379686 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-fea7b0b8-e553-4fae-9dfd-4b296a6047e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a86997f25c4efdbe5559a07a507342'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:20.391696 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1345/2690] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:10:20 2021] DELETE /identity/v3/users/95a86997f25c4efdbe5559a07a507342 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:10:20.396169 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803499a-ff44-44ae-a73b-298987b66592 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:20.396635 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803499a-ff44-44ae-a73b-298987b66592 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:20.396729 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803499a-ff44-44ae-a73b-298987b66592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:20.413050 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-2803499a-ff44-44ae-a73b-298987b66592 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:10:20.414251 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-2803499a-ff44-44ae-a73b-298987b66592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:20.470104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1346/2691] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:10:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:10:20.479946 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7b0b8-e553-4fae-9dfd-4b296a6047e1 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:20.481382 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-fea7b0b8-e553-4fae-9dfd-4b296a6047e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:20.536043 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7b0b8-e553-4fae-9dfd-4b296a6047e1 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:20.539661 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53221fb5-46e9-4726-84c8-a95713ba50d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:20.540301 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53221fb5-46e9-4726-84c8-a95713ba50d5 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:20.540584 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53221fb5-46e9-4726-84c8-a95713ba50d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:20.540860 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53221fb5-46e9-4726-84c8-a95713ba50d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:20.549644 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53221fb5-46e9-4726-84c8-a95713ba50d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:20.551055 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53221fb5-46e9-4726-84c8-a95713ba50d5 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:20.560461 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1346/2692] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:10:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:10:20.834264 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803499a-ff44-44ae-a73b-298987b66592 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:20.835676 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-2803499a-ff44-44ae-a73b-298987b66592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:20.848049 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803499a-ff44-44ae-a73b-298987b66592 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:20.853175 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71250f0-cf70-4692-b63f-33d9bcdaca9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:20.854046 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71250f0-cf70-4692-b63f-33d9bcdaca9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:20.854329 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71250f0-cf70-4692-b63f-33d9bcdaca9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:20.854603 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71250f0-cf70-4692-b63f-33d9bcdaca9c admin admin] PATH_INFO: `/v3/projects/f0385694322047d292eae6ada4c60161` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:20.855795 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71250f0-cf70-4692-b63f-33d9bcdaca9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0385694322047d292eae6ada4c60161)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:20.857754 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71250f0-cf70-4692-b63f-33d9bcdaca9c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:20.902702 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e71250f0-cf70-4692-b63f-33d9bcdaca9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0385694322047d292eae6ada4c60161', 'request_id': 'req-e71250f0-cf70-4692-b63f-33d9bcdaca9c'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:20.909219 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e71250f0-cf70-4692-b63f-33d9bcdaca9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0385694322047d292eae6ada4c60161', 'request_id': 'req-e71250f0-cf70-4692-b63f-33d9bcdaca9c'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:20.916202 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e71250f0-cf70-4692-b63f-33d9bcdaca9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0385694322047d292eae6ada4c60161', 'request_id': 'req-e71250f0-cf70-4692-b63f-33d9bcdaca9c'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:20.926177 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e71250f0-cf70-4692-b63f-33d9bcdaca9c admin admin] The token cache is being invalidate because project f0385694322047d292eae6ada4c60161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:10:20.926465 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e71250f0-cf70-4692-b63f-33d9bcdaca9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:20.927106 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-e71250f0-cf70-4692-b63f-33d9bcdaca9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:20.928610 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1347/2693] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:10:20 2021] DELETE /identity/v3/projects/f0385694322047d292eae6ada4c60161 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:10:20.932799 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53221fb5-46e9-4726-84c8-a95713ba50d5 service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:20.942069 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53221fb5-46e9-4726-84c8-a95713ba50d5 service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:20.994455 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa704b7b-e658-4552-8262-77bb188a8cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:20.995314 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa704b7b-e658-4552-8262-77bb188a8cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:20.995593 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa704b7b-e658-4552-8262-77bb188a8cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:20.995864 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa704b7b-e658-4552-8262-77bb188a8cc9 admin admin] PATH_INFO: `/v3/users/d18c227ccc2743b4a62dde0d342dbf6c` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:20.997050 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa704b7b-e658-4552-8262-77bb188a8cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d18c227ccc2743b4a62dde0d342dbf6c)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:20.998938 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa704b7b-e658-4552-8262-77bb188a8cc9 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:21.042823 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-aa704b7b-e658-4552-8262-77bb188a8cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd18c227ccc2743b4a62dde0d342dbf6c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:21.043450 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-aa704b7b-e658-4552-8262-77bb188a8cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd18c227ccc2743b4a62dde0d342dbf6c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:21.050462 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-aa704b7b-e658-4552-8262-77bb188a8cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd18c227ccc2743b4a62dde0d342dbf6c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:21.051072 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-aa704b7b-e658-4552-8262-77bb188a8cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd18c227ccc2743b4a62dde0d342dbf6c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:21.062480 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-aa704b7b-e658-4552-8262-77bb188a8cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd18c227ccc2743b4a62dde0d342dbf6c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:21.073833 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1347/2694] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:10:20 2021] DELETE /identity/v3/users/d18c227ccc2743b4a62dde0d342dbf6c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:10:21.342533 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71250f0-cf70-4692-b63f-33d9bcdaca9c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:21.343946 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-e71250f0-cf70-4692-b63f-33d9bcdaca9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:21.357480 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71250f0-cf70-4692-b63f-33d9bcdaca9c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:21.412835 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b3449-a55e-4346-86d5-2458310c6f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:21.413718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b3449-a55e-4346-86d5-2458310c6f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:21.413999 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b3449-a55e-4346-86d5-2458310c6f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:21.414290 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b3449-a55e-4346-86d5-2458310c6f59 admin admin] PATH_INFO: `/v3/projects/6d2574c978e04d338d058344f6fc8c4e` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:21.415434 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b3449-a55e-4346-86d5-2458310c6f59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d2574c978e04d338d058344f6fc8c4e)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:21.417504 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b3449-a55e-4346-86d5-2458310c6f59 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:21.460754 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-6c1b3449-a55e-4346-86d5-2458310c6f59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d2574c978e04d338d058344f6fc8c4e', 'request_id': 'req-6c1b3449-a55e-4346-86d5-2458310c6f59'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:21.466614 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-6c1b3449-a55e-4346-86d5-2458310c6f59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d2574c978e04d338d058344f6fc8c4e', 'request_id': 'req-6c1b3449-a55e-4346-86d5-2458310c6f59'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:21.474378 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-6c1b3449-a55e-4346-86d5-2458310c6f59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d2574c978e04d338d058344f6fc8c4e', 'request_id': 'req-6c1b3449-a55e-4346-86d5-2458310c6f59'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:21.485159 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-6c1b3449-a55e-4346-86d5-2458310c6f59 admin admin] The token cache is being invalidate because project 6d2574c978e04d338d058344f6fc8c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:10:21.485448 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-6c1b3449-a55e-4346-86d5-2458310c6f59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:21.486068 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-6c1b3449-a55e-4346-86d5-2458310c6f59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:21.487571 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1348/2695] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:10:21 2021] DELETE /identity/v3/projects/6d2574c978e04d338d058344f6fc8c4e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:10:21.491549 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa704b7b-e658-4552-8262-77bb188a8cc9 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:21.493017 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-aa704b7b-e658-4552-8262-77bb188a8cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:21.505934 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa704b7b-e658-4552-8262-77bb188a8cc9 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:21.558618 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae172740-18a8-4dd8-996c-aa539de2d3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:21.559475 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae172740-18a8-4dd8-996c-aa539de2d3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:21.559756 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae172740-18a8-4dd8-996c-aa539de2d3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:21.560031 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae172740-18a8-4dd8-996c-aa539de2d3dd admin admin] PATH_INFO: `/v3/users/7a8aa219c1ca46e68cd357ff76e00024` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:21.561233 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae172740-18a8-4dd8-996c-aa539de2d3dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a8aa219c1ca46e68cd357ff76e00024)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:21.563727 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae172740-18a8-4dd8-996c-aa539de2d3dd admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:21.611467 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ae172740-18a8-4dd8-996c-aa539de2d3dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a8aa219c1ca46e68cd357ff76e00024'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:21.612132 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ae172740-18a8-4dd8-996c-aa539de2d3dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a8aa219c1ca46e68cd357ff76e00024'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:21.618784 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ae172740-18a8-4dd8-996c-aa539de2d3dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a8aa219c1ca46e68cd357ff76e00024'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:21.619397 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ae172740-18a8-4dd8-996c-aa539de2d3dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a8aa219c1ca46e68cd357ff76e00024'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:21.631148 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ae172740-18a8-4dd8-996c-aa539de2d3dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a8aa219c1ca46e68cd357ff76e00024'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:21.642616 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1348/2696] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:10:21 2021] DELETE /identity/v3/users/7a8aa219c1ca46e68cd357ff76e00024 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:10:21.913266 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b3449-a55e-4346-86d5-2458310c6f59 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:21.914702 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-6c1b3449-a55e-4346-86d5-2458310c6f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:21.929374 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b3449-a55e-4346-86d5-2458310c6f59 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:21.983927 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a80cef-6540-4a02-8856-590c425b0c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:21.985428 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a80cef-6540-4a02-8856-590c425b0c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:21.985710 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a80cef-6540-4a02-8856-590c425b0c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:21.985986 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a80cef-6540-4a02-8856-590c425b0c51 admin admin] PATH_INFO: `/v3/projects/a26749a548f1465ea2f32674e553b20c` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:21.987202 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a80cef-6540-4a02-8856-590c425b0c51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a26749a548f1465ea2f32674e553b20c)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:21.989161 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a80cef-6540-4a02-8856-590c425b0c51 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:22.032649 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-39a80cef-6540-4a02-8856-590c425b0c51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a26749a548f1465ea2f32674e553b20c', 'request_id': 'req-39a80cef-6540-4a02-8856-590c425b0c51'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:22.038457 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-39a80cef-6540-4a02-8856-590c425b0c51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a26749a548f1465ea2f32674e553b20c', 'request_id': 'req-39a80cef-6540-4a02-8856-590c425b0c51'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:22.045149 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-39a80cef-6540-4a02-8856-590c425b0c51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a26749a548f1465ea2f32674e553b20c', 'request_id': 'req-39a80cef-6540-4a02-8856-590c425b0c51'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:22.055590 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-39a80cef-6540-4a02-8856-590c425b0c51 admin admin] The token cache is being invalidate because project a26749a548f1465ea2f32674e553b20c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:10:22.055873 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-39a80cef-6540-4a02-8856-590c425b0c51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:22.056484 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-39a80cef-6540-4a02-8856-590c425b0c51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:10:22.057987 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1349/2697] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:10:21 2021] DELETE /identity/v3/projects/a26749a548f1465ea2f32674e553b20c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:10:22.063650 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178c0dd-e90c-4ca1-abe8-397b7fff8b18 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:22.063942 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178c0dd-e90c-4ca1-abe8-397b7fff8b18 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:22.064223 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178c0dd-e90c-4ca1-abe8-397b7fff8b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:22.081986 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-c178c0dd-e90c-4ca1-abe8-397b7fff8b18 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:10:22.083176 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c178c0dd-e90c-4ca1-abe8-397b7fff8b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:22.139739 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1349/2698] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:10:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:10:22.148534 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aece172-8cae-4d53-87f3-775e25fcfbf3 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:22.148828 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aece172-8cae-4d53-87f3-775e25fcfbf3 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:22.149152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aece172-8cae-4d53-87f3-775e25fcfbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:22.168818 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-2aece172-8cae-4d53-87f3-775e25fcfbf3 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:10:22.170007 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-2aece172-8cae-4d53-87f3-775e25fcfbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:22.178531 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1350/2699] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:10:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:10:22.182709 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178c0dd-e90c-4ca1-abe8-397b7fff8b18 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:22.192316 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178c0dd-e90c-4ca1-abe8-397b7fff8b18 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:22.197036 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b8993-2e84-45ef-b67a-e42395272a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:22.197696 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b8993-2e84-45ef-b67a-e42395272a6d admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:22.198011 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b8993-2e84-45ef-b67a-e42395272a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:22.198252 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b8993-2e84-45ef-b67a-e42395272a6d admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:22.198978 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b8993-2e84-45ef-b67a-e42395272a6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 03:10:22.199275 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b8993-2e84-45ef-b67a-e42395272a6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:22.201010 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b8993-2e84-45ef-b67a-e42395272a6d admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:22.212717 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1350/2700] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 03:10:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 03:10:22.216927 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aece172-8cae-4d53-87f3-775e25fcfbf3 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:22.226437 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aece172-8cae-4d53-87f3-775e25fcfbf3 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:22.231131 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170af96e-b2b8-4e30-a7d2-3b57d9190e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:22.231780 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170af96e-b2b8-4e30-a7d2-3b57d9190e2e admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:22.232063 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170af96e-b2b8-4e30-a7d2-3b57d9190e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:22.232341 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170af96e-b2b8-4e30-a7d2-3b57d9190e2e admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:22.233066 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170af96e-b2b8-4e30-a7d2-3b57d9190e2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:22.235774 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170af96e-b2b8-4e30-a7d2-3b57d9190e2e admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:22.260152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1351/2701] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:10:22 2021] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:10:22.264100 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b8993-2e84-45ef-b67a-e42395272a6d admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:22.274111 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b8993-2e84-45ef-b67a-e42395272a6d admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:22.327417 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a9fcf-994f-477f-92f5-78c92a9bf171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:22.328072 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a9fcf-994f-477f-92f5-78c92a9bf171 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:22.328357 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a9fcf-994f-477f-92f5-78c92a9bf171 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:22.328636 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a9fcf-994f-477f-92f5-78c92a9bf171 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:22.329356 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a9fcf-994f-477f-92f5-78c92a9bf171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:22.331256 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a9fcf-994f-477f-92f5-78c92a9bf171 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:22.349875 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1351/2702] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:10:22 2021] POST /identity/v3/users => generated 290 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:10:22.353880 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170af96e-b2b8-4e30-a7d2-3b57d9190e2e admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:22.364613 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170af96e-b2b8-4e30-a7d2-3b57d9190e2e admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:22.369425 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59a574-1fdd-461e-a625-d85a39425fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:22.370080 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59a574-1fdd-461e-a625-d85a39425fdb admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:22.370366 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59a574-1fdd-461e-a625-d85a39425fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:22.370642 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59a574-1fdd-461e-a625-d85a39425fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:22.371363 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59a574-1fdd-461e-a625-d85a39425fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:22.372965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59a574-1fdd-461e-a625-d85a39425fdb admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:22.384142 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1352/2703] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:10:22 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:10:22.388092 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a9fcf-994f-477f-92f5-78c92a9bf171 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:22.398194 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a9fcf-994f-477f-92f5-78c92a9bf171 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:22.402892 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9141022-f60e-43d9-b671-7ace960cd6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:22.403699 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9141022-f60e-43d9-b671-7ace960cd6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:22.403985 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9141022-f60e-43d9-b671-7ace960cd6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:22.404266 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9141022-f60e-43d9-b671-7ace960cd6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:22.405018 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9141022-f60e-43d9-b671-7ace960cd6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:22.406598 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9141022-f60e-43d9-b671-7ace960cd6f8 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:22.416628 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1352/2704] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:10:22 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:10:22.421262 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59a574-1fdd-461e-a625-d85a39425fdb admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:22.431707 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59a574-1fdd-461e-a625-d85a39425fdb admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:22.436275 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80677ced-af31-4b38-8331-f35f096e477b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:22.437171 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80677ced-af31-4b38-8331-f35f096e477b admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:22.437446 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80677ced-af31-4b38-8331-f35f096e477b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:22.438258 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80677ced-af31-4b38-8331-f35f096e477b admin admin] PATH_INFO: `/v3/projects/ea36f03b1dfa40e6b756e880083d62c5/users/5d7b99228e1740c4bfdbecc51137864d/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:22.452391 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80677ced-af31-4b38-8331-f35f096e477b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea36f03b1dfa40e6b756e880083d62c5, user_id=5d7b99228e1740c4bfdbecc51137864d, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:22.455160 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80677ced-af31-4b38-8331-f35f096e477b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:22.467595 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1353/2705] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:10:22 2021] PUT /identity/v3/projects/ea36f03b1dfa40e6b756e880083d62c5/users/5d7b99228e1740c4bfdbecc51137864d/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:10:22.472926 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2baa2b-ddfc-4a2a-a716-83e681b82b34 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:22.473279 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2baa2b-ddfc-4a2a-a716-83e681b82b34 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:22.473644 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2baa2b-ddfc-4a2a-a716-83e681b82b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:22.491642 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-ac2baa2b-ddfc-4a2a-a716-83e681b82b34 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:10:22.492839 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-ac2baa2b-ddfc-4a2a-a716-83e681b82b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:22.548149 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1353/2706] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:10:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:10:22.558066 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80677ced-af31-4b38-8331-f35f096e477b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:22.559821 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-80677ced-af31-4b38-8331-f35f096e477b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:22.614982 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80677ced-af31-4b38-8331-f35f096e477b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:22.618699 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddab8d8-c4b7-4c27-82b9-346ed4951a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:22.619337 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddab8d8-c4b7-4c27-82b9-346ed4951a20 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:22.619622 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddab8d8-c4b7-4c27-82b9-346ed4951a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:22.619901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddab8d8-c4b7-4c27-82b9-346ed4951a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:22.628695 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddab8d8-c4b7-4c27-82b9-346ed4951a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:22.630149 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddab8d8-c4b7-4c27-82b9-346ed4951a20 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:22.639437 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1354/2707] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:10:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:10:26.420033 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f27e3-940b-4d90-927b-c3b8b6ac7f72 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:26.420522 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f27e3-940b-4d90-927b-c3b8b6ac7f72 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:26.420627 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f27e3-940b-4d90-927b-c3b8b6ac7f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:26.447929 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-8b4f27e3-940b-4d90-927b-c3b8b6ac7f72 None None] MFA Rules not processed for user `5d7b99228e1740c4bfdbecc51137864d`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:10:26.449240 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8b4f27e3-940b-4d90-927b-c3b8b6ac7f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:26.516217 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1354/2708] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:10:26 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:10:26.522914 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddab8d8-c4b7-4c27-82b9-346ed4951a20 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:26.533290 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddab8d8-c4b7-4c27-82b9-346ed4951a20 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:26.537902 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1a891-8031-48da-8cda-5e4fced763e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:26.538547 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1a891-8031-48da-8cda-5e4fced763e1 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:26.538854 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1a891-8031-48da-8cda-5e4fced763e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:26.539127 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1a891-8031-48da-8cda-5e4fced763e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:26.539841 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1a891-8031-48da-8cda-5e4fced763e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:26.541798 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1a891-8031-48da-8cda-5e4fced763e1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:26.567703 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1355/2709] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:10:26 2021] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:10:26.571769 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f27e3-940b-4d90-927b-c3b8b6ac7f72 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:26.583241 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f27e3-940b-4d90-927b-c3b8b6ac7f72 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:26.638296 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b42e0-068c-4456-914c-1c135bc0286b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:26.639552 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b42e0-068c-4456-914c-1c135bc0286b admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:26.639552 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b42e0-068c-4456-914c-1c135bc0286b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:26.639977 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b42e0-068c-4456-914c-1c135bc0286b admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:26.640459 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b42e0-068c-4456-914c-1c135bc0286b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:26.642405 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b42e0-068c-4456-914c-1c135bc0286b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:26.663969 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1355/2710] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:10:26 2021] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:10:26.667826 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1a891-8031-48da-8cda-5e4fced763e1 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:26.693129 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1a891-8031-48da-8cda-5e4fced763e1 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:26.697934 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de0add-7469-4594-9ec1-3396418d54f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:26.698925 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de0add-7469-4594-9ec1-3396418d54f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:26.699405 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de0add-7469-4594-9ec1-3396418d54f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:26.699819 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de0add-7469-4594-9ec1-3396418d54f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:26.700798 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de0add-7469-4594-9ec1-3396418d54f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:26.703275 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de0add-7469-4594-9ec1-3396418d54f1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:26.716587 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1356/2711] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:10:26 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:10:26.721197 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b42e0-068c-4456-914c-1c135bc0286b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:26.731194 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b42e0-068c-4456-914c-1c135bc0286b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:26.739292 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a293251-0fce-4cfd-8a68-7f02f365eb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:26.740211 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a293251-0fce-4cfd-8a68-7f02f365eb0e admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:26.740479 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a293251-0fce-4cfd-8a68-7f02f365eb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:26.740909 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a293251-0fce-4cfd-8a68-7f02f365eb0e admin admin] PATH_INFO: `/v3/projects/2ae39f9d8a1b4a75b60d4ee29fd6eb34/users/9bf5708633224c8f99f8c8ae1c20604a/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:26.757736 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a293251-0fce-4cfd-8a68-7f02f365eb0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae39f9d8a1b4a75b60d4ee29fd6eb34, user_id=9bf5708633224c8f99f8c8ae1c20604a, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:26.760370 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a293251-0fce-4cfd-8a68-7f02f365eb0e admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:26.774702 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1356/2712] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:10:26 2021] PUT /identity/v3/projects/2ae39f9d8a1b4a75b60d4ee29fd6eb34/users/9bf5708633224c8f99f8c8ae1c20604a/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:10:26.778359 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de0add-7469-4594-9ec1-3396418d54f1 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:26.792431 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de0add-7469-4594-9ec1-3396418d54f1 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:26.849499 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2714f0-4b48-47eb-8630-31cc94574be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:26.850235 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2714f0-4b48-47eb-8630-31cc94574be4 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:26.850524 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2714f0-4b48-47eb-8630-31cc94574be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:26.850802 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2714f0-4b48-47eb-8630-31cc94574be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:26.851529 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2714f0-4b48-47eb-8630-31cc94574be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:26.853163 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2714f0-4b48-47eb-8630-31cc94574be4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:26.863510 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1357/2713] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:10:26 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:10:26.867624 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a293251-0fce-4cfd-8a68-7f02f365eb0e admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:26.878721 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a293251-0fce-4cfd-8a68-7f02f365eb0e admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:26.883813 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e589fb-01c4-4baa-906f-34fcac3d2579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:26.884704 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e589fb-01c4-4baa-906f-34fcac3d2579 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:26.885021 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e589fb-01c4-4baa-906f-34fcac3d2579 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:26.885304 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e589fb-01c4-4baa-906f-34fcac3d2579 admin admin] PATH_INFO: `/v3/projects/2ae39f9d8a1b4a75b60d4ee29fd6eb34/users/9bf5708633224c8f99f8c8ae1c20604a/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:26.887276 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e589fb-01c4-4baa-906f-34fcac3d2579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae39f9d8a1b4a75b60d4ee29fd6eb34, user_id=9bf5708633224c8f99f8c8ae1c20604a, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:26.889966 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e589fb-01c4-4baa-906f-34fcac3d2579 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:26.901658 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1357/2714] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:10:26 2021] PUT /identity/v3/projects/2ae39f9d8a1b4a75b60d4ee29fd6eb34/users/9bf5708633224c8f99f8c8ae1c20604a/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:10:31.446627 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a9fb9-7815-468e-88f8-7c285e1c8947 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:31.447151 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a9fb9-7815-468e-88f8-7c285e1c8947 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:31.447325 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a9fb9-7815-468e-88f8-7c285e1c8947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:31.476381 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-719a9fb9-7815-468e-88f8-7c285e1c8947 None None] MFA Rules not processed for user `9bf5708633224c8f99f8c8ae1c20604a`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:10:31.477947 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-719a9fb9-7815-468e-88f8-7c285e1c8947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:31.544300 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1358/2715] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:10:31 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:10:31.555509 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e589fb-01c4-4baa-906f-34fcac3d2579 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:31.557234 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-80e589fb-01c4-4baa-906f-34fcac3d2579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:31.629291 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e589fb-01c4-4baa-906f-34fcac3d2579 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:31.634883 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d877e0-c83a-4d4d-baf2-544a63036e2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:31.635533 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d877e0-c83a-4d4d-baf2-544a63036e2b service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:31.635818 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d877e0-c83a-4d4d-baf2-544a63036e2b service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:31.636207 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d877e0-c83a-4d4d-baf2-544a63036e2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:31.691863 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d877e0-c83a-4d4d-baf2-544a63036e2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:31.693396 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d877e0-c83a-4d4d-baf2-544a63036e2b service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:31.702885 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1358/2716] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:10:31 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:10:56.451891 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89feed8-8601-4aba-911a-6e56c9555c10 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:56.452366 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89feed8-8601-4aba-911a-6e56c9555c10 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:56.452464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89feed8-8601-4aba-911a-6e56c9555c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:56.469918 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-a89feed8-8601-4aba-911a-6e56c9555c10 None None] MFA Rules not processed for user `5d7b99228e1740c4bfdbecc51137864d`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:10:56.471152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-a89feed8-8601-4aba-911a-6e56c9555c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:56.478950 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1359/2717] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:10:56 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:10:56.773736 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d877e0-c83a-4d4d-baf2-544a63036e2b service nova] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:56.775126 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-d8d877e0-c83a-4d4d-baf2-544a63036e2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:56.828696 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d877e0-c83a-4d4d-baf2-544a63036e2b service nova] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:56.832228 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd6214-a0f2-413b-846a-ac38e5898839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:56.832857 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd6214-a0f2-413b-846a-ac38e5898839 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:56.833169 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd6214-a0f2-413b-846a-ac38e5898839 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:56.833441 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd6214-a0f2-413b-846a-ac38e5898839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:56.835657 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-55dd6214-a0f2-413b-846a-ac38e5898839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:56.844637 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd6214-a0f2-413b-846a-ac38e5898839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:56.846079 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd6214-a0f2-413b-846a-ac38e5898839 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:56.854288 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1359/2718] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:10:56 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:10:58.303287 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89feed8-8601-4aba-911a-6e56c9555c10 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:10:58.305063 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-a89feed8-8601-4aba-911a-6e56c9555c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:58.371861 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89feed8-8601-4aba-911a-6e56c9555c10 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:10:58.376787 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446f6b1-f602-4750-bfbe-236e72b5fb26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:10:58.377453 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446f6b1-f602-4750-bfbe-236e72b5fb26 service placement] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:10:58.377736 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446f6b1-f602-4750-bfbe-236e72b5fb26 service placement] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:10:58.378010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446f6b1-f602-4750-bfbe-236e72b5fb26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:10:58.379734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-9446f6b1-f602-4750-bfbe-236e72b5fb26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:10:58.391804 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446f6b1-f602-4750-bfbe-236e72b5fb26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:10:58.393635 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446f6b1-f602-4750-bfbe-236e72b5fb26 service placement] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:10:58.403571 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1360/2719] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:10:58 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:11:00.746988 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd6214-a0f2-413b-846a-ac38e5898839 service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:11:00.749253 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-55dd6214-a0f2-413b-846a-ac38e5898839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:11:00.768811 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd6214-a0f2-413b-846a-ac38e5898839 service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:11:00.779375 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63db3ff-aa74-497a-9302-fabb6a5d2a59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:11:00.780357 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63db3ff-aa74-497a-9302-fabb6a5d2a59 service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:11:00.780837 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63db3ff-aa74-497a-9302-fabb6a5d2a59 service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:11:00.781337 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63db3ff-aa74-497a-9302-fabb6a5d2a59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:11:00.783391 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a63db3ff-aa74-497a-9302-fabb6a5d2a59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:11:00.796925 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63db3ff-aa74-497a-9302-fabb6a5d2a59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:11:00.798954 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63db3ff-aa74-497a-9302-fabb6a5d2a59 service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:11:00.811777 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1360/2720] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:11:00 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:11:13.731849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446f6b1-f602-4750-bfbe-236e72b5fb26 service placement] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:11:13.744324 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446f6b1-f602-4750-bfbe-236e72b5fb26 service placement] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:11:13.750091 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd595b-dd51-4479-a70e-f42cb6da2644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:11:13.750735 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd595b-dd51-4479-a70e-f42cb6da2644 service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:11:13.751015 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd595b-dd51-4479-a70e-f42cb6da2644 service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:11:13.751901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd595b-dd51-4479-a70e-f42cb6da2644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:11:13.753698 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-65bd595b-dd51-4479-a70e-f42cb6da2644 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:11:13.765584 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd595b-dd51-4479-a70e-f42cb6da2644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:11:13.767786 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd595b-dd51-4479-a70e-f42cb6da2644 service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:11:13.778162 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1361/2721] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:11:13 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:11:14.010056 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63db3ff-aa74-497a-9302-fabb6a5d2a59 service nova] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:11:14.019266 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63db3ff-aa74-497a-9302-fabb6a5d2a59 service nova] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:11:14.023144 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edf648-c56b-4f43-984c-df665b07a6c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:11:14.023809 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edf648-c56b-4f43-984c-df665b07a6c4 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:11:14.024094 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edf648-c56b-4f43-984c-df665b07a6c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:11:14.024376 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edf648-c56b-4f43-984c-df665b07a6c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:11:14.026157 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e5edf648-c56b-4f43-984c-df665b07a6c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:11:14.047377 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edf648-c56b-4f43-984c-df665b07a6c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:11:14.049304 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edf648-c56b-4f43-984c-df665b07a6c4 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:11:14.057501 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1361/2722] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:11:14 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:11:15.815996 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd595b-dd51-4479-a70e-f42cb6da2644 service nova] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:11:15.825080 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd595b-dd51-4479-a70e-f42cb6da2644 service nova] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:11:15.828645 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3aa40-b360-41b3-9908-2b4dd384fe4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:11:15.829308 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3aa40-b360-41b3-9908-2b4dd384fe4a service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:11:15.829588 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3aa40-b360-41b3-9908-2b4dd384fe4a service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:11:15.829906 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3aa40-b360-41b3-9908-2b4dd384fe4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:11:15.838473 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3aa40-b360-41b3-9908-2b4dd384fe4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:11:15.839893 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3aa40-b360-41b3-9908-2b4dd384fe4a service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:11:15.849457 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1362/2723] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:11:15 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:13:36.496868 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4b36e-0d93-4091-addc-b4c4af4cdc17 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:13:36.497394 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4b36e-0d93-4091-addc-b4c4af4cdc17 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:13:36.497492 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4b36e-0d93-4091-addc-b4c4af4cdc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:13:36.515899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-8be4b36e-0d93-4091-addc-b4c4af4cdc17 None None] MFA Rules not processed for user `5d7b99228e1740c4bfdbecc51137864d`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:13:36.517102 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8be4b36e-0d93-4091-addc-b4c4af4cdc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:13:36.524816 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1362/2724] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:13:36 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:13:36.819936 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3aa40-b360-41b3-9908-2b4dd384fe4a service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:13:36.828263 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3aa40-b360-41b3-9908-2b4dd384fe4a service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:13:36.831922 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99c6b3-f14d-4993-912a-309267fbef53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:13:36.832552 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c6b3-f14d-4993-912a-309267fbef53 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:13:36.832836 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c6b3-f14d-4993-912a-309267fbef53 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:13:36.833145 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c6b3-f14d-4993-912a-309267fbef53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:13:36.834869 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ad99c6b3-f14d-4993-912a-309267fbef53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:13:36.843863 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99c6b3-f14d-4993-912a-309267fbef53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:13:36.845326 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99c6b3-f14d-4993-912a-309267fbef53 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:13:36.853502 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1363/2725] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:13:36 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:13:53.923340 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4b36e-0d93-4091-addc-b4c4af4cdc17 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:13:53.939628 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4b36e-0d93-4091-addc-b4c4af4cdc17 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:13:53.946457 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df55750-1558-4b21-b123-85ee016a7aea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:13:53.947385 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df55750-1558-4b21-b123-85ee016a7aea service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:13:53.947691 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df55750-1558-4b21-b123-85ee016a7aea service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:13:53.947950 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df55750-1558-4b21-b123-85ee016a7aea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:13:53.949775 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-9df55750-1558-4b21-b123-85ee016a7aea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:13:53.962704 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df55750-1558-4b21-b123-85ee016a7aea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:13:53.964536 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df55750-1558-4b21-b123-85ee016a7aea service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:13:53.979846 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1363/2726] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:13:53 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:14:13.110400 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99c6b3-f14d-4993-912a-309267fbef53 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:14:13.158692 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99c6b3-f14d-4993-912a-309267fbef53 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:14:13.163737 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505c3a6-7186-4445-97bb-28252c3a693c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:14:13.164374 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505c3a6-7186-4445-97bb-28252c3a693c service placement] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:14:13.164657 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505c3a6-7186-4445-97bb-28252c3a693c service placement] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:14:13.164970 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505c3a6-7186-4445-97bb-28252c3a693c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:14:13.166718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-d505c3a6-7186-4445-97bb-28252c3a693c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:14:13.190171 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505c3a6-7186-4445-97bb-28252c3a693c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:14:13.191738 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505c3a6-7186-4445-97bb-28252c3a693c service placement] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:14:13.201389 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1364/2727] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:14:13 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:14:15.170687 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df55750-1558-4b21-b123-85ee016a7aea service nova] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:14:15.172057 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-9df55750-1558-4b21-b123-85ee016a7aea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:14:15.244096 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df55750-1558-4b21-b123-85ee016a7aea service nova] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:14:15.247680 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17e259-eb07-412a-9e82-b38845864eea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:14:15.248306 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17e259-eb07-412a-9e82-b38845864eea service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:14:15.248584 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17e259-eb07-412a-9e82-b38845864eea service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:14:15.248855 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17e259-eb07-412a-9e82-b38845864eea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:14:15.250573 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7a17e259-eb07-412a-9e82-b38845864eea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:14:15.275663 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17e259-eb07-412a-9e82-b38845864eea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:14:15.277077 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17e259-eb07-412a-9e82-b38845864eea service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:14:15.287650 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1364/2728] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:14:15 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:14:34.412965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505c3a6-7186-4445-97bb-28252c3a693c service placement] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:14:34.425880 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505c3a6-7186-4445-97bb-28252c3a693c service placement] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:14:34.431478 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d4ff6-1e26-4b03-88eb-7d2d0e34417f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:14:34.432109 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d4ff6-1e26-4b03-88eb-7d2d0e34417f service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:14:34.432389 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d4ff6-1e26-4b03-88eb-7d2d0e34417f service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:14:34.432663 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d4ff6-1e26-4b03-88eb-7d2d0e34417f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:14:34.434422 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-0a3d4ff6-1e26-4b03-88eb-7d2d0e34417f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:14:34.490109 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d4ff6-1e26-4b03-88eb-7d2d0e34417f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:14:34.491682 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d4ff6-1e26-4b03-88eb-7d2d0e34417f service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:14:34.500307 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1365/2729] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:14:34 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:14:35.580730 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17e259-eb07-412a-9e82-b38845864eea service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:14:35.582203 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7a17e259-eb07-412a-9e82-b38845864eea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:14:35.592561 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17e259-eb07-412a-9e82-b38845864eea service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:14:35.596177 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72490c09-efe4-4549-9188-dce940be2772 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:14:35.596855 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72490c09-efe4-4549-9188-dce940be2772 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:14:35.597165 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72490c09-efe4-4549-9188-dce940be2772 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:14:35.597444 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72490c09-efe4-4549-9188-dce940be2772 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:14:35.599091 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-72490c09-efe4-4549-9188-dce940be2772 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:14:35.611849 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72490c09-efe4-4549-9188-dce940be2772 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:14:35.613771 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72490c09-efe4-4549-9188-dce940be2772 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:14:35.624359 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1365/2730] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:14:35 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:15:43.391330 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d4ff6-1e26-4b03-88eb-7d2d0e34417f service nova] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:15:43.419547 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d4ff6-1e26-4b03-88eb-7d2d0e34417f service nova] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:15:43.423388 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b3e5f-e8ea-4a2d-adc0-e0388f5d1e86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:15:43.424024 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b3e5f-e8ea-4a2d-adc0-e0388f5d1e86 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:43.424299 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b3e5f-e8ea-4a2d-adc0-e0388f5d1e86 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:43.424572 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b3e5f-e8ea-4a2d-adc0-e0388f5d1e86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:43.432494 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b3e5f-e8ea-4a2d-adc0-e0388f5d1e86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:15:43.433955 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b3e5f-e8ea-4a2d-adc0-e0388f5d1e86 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:15:43.442420 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1366/2731] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:15:43 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:15:56.371194 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72490c09-efe4-4549-9188-dce940be2772 service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:15:56.372570 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-72490c09-efe4-4549-9188-dce940be2772 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:15:56.476064 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72490c09-efe4-4549-9188-dce940be2772 service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:15:56.480823 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99592e86-fc90-4599-93f8-24315517c35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:15:56.481713 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99592e86-fc90-4599-93f8-24315517c35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:56.481996 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99592e86-fc90-4599-93f8-24315517c35d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:56.482269 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99592e86-fc90-4599-93f8-24315517c35d admin admin] PATH_INFO: `/v3/users/15d428eaf39f4d469395e004692b050e` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:56.483470 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99592e86-fc90-4599-93f8-24315517c35d admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d428eaf39f4d469395e004692b050e)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:15:56.485401 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99592e86-fc90-4599-93f8-24315517c35d admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:15:56.528870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-99592e86-fc90-4599-93f8-24315517c35d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d428eaf39f4d469395e004692b050e'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:15:56.529530 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-99592e86-fc90-4599-93f8-24315517c35d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d428eaf39f4d469395e004692b050e'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:15:56.536335 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-99592e86-fc90-4599-93f8-24315517c35d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d428eaf39f4d469395e004692b050e'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:15:56.536968 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-99592e86-fc90-4599-93f8-24315517c35d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d428eaf39f4d469395e004692b050e'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:15:56.548787 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-99592e86-fc90-4599-93f8-24315517c35d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d428eaf39f4d469395e004692b050e'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:15:56.560668 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1366/2732] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:15:56 2021] DELETE /identity/v3/users/15d428eaf39f4d469395e004692b050e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:15:56.565255 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6203696-a5fe-45bf-970f-55d447e6b343 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:56.565734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6203696-a5fe-45bf-970f-55d447e6b343 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:56.565850 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6203696-a5fe-45bf-970f-55d447e6b343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:56.591991 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-a6203696-a5fe-45bf-970f-55d447e6b343 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:15:56.593334 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-a6203696-a5fe-45bf-970f-55d447e6b343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:15:56.649307 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1367/2733] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:15:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:15:56.658952 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99592e86-fc90-4599-93f8-24315517c35d admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:15:56.660332 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-99592e86-fc90-4599-93f8-24315517c35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:15:56.717368 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99592e86-fc90-4599-93f8-24315517c35d admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:15:56.721033 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcb62e-d72d-4023-9473-2cf748ad8339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:15:56.721667 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcb62e-d72d-4023-9473-2cf748ad8339 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:56.721942 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcb62e-d72d-4023-9473-2cf748ad8339 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:56.722210 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcb62e-d72d-4023-9473-2cf748ad8339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:56.730870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcb62e-d72d-4023-9473-2cf748ad8339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:15:56.732215 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcb62e-d72d-4023-9473-2cf748ad8339 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:15:56.741349 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1367/2734] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:15:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:15:57.011963 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6203696-a5fe-45bf-970f-55d447e6b343 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:15:57.013404 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-a6203696-a5fe-45bf-970f-55d447e6b343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:15:57.025295 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6203696-a5fe-45bf-970f-55d447e6b343 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:15:57.030262 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0239c6c-3d78-4dc7-a43a-7c6b3b320d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:15:57.031185 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0239c6c-3d78-4dc7-a43a-7c6b3b320d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:57.031483 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0239c6c-3d78-4dc7-a43a-7c6b3b320d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:57.031723 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0239c6c-3d78-4dc7-a43a-7c6b3b320d02 admin admin] PATH_INFO: `/v3/projects/1b39a901d49c4f02a27e4bfd6eb6cf8c` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:57.032940 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0239c6c-3d78-4dc7-a43a-7c6b3b320d02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b39a901d49c4f02a27e4bfd6eb6cf8c)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:15:57.034892 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0239c6c-3d78-4dc7-a43a-7c6b3b320d02 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:15:57.080027 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d0239c6c-3d78-4dc7-a43a-7c6b3b320d02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b39a901d49c4f02a27e4bfd6eb6cf8c', 'request_id': 'req-d0239c6c-3d78-4dc7-a43a-7c6b3b320d02'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:15:57.085886 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d0239c6c-3d78-4dc7-a43a-7c6b3b320d02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b39a901d49c4f02a27e4bfd6eb6cf8c', 'request_id': 'req-d0239c6c-3d78-4dc7-a43a-7c6b3b320d02'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:15:57.092647 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d0239c6c-3d78-4dc7-a43a-7c6b3b320d02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b39a901d49c4f02a27e4bfd6eb6cf8c', 'request_id': 'req-d0239c6c-3d78-4dc7-a43a-7c6b3b320d02'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:15:57.102340 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d0239c6c-3d78-4dc7-a43a-7c6b3b320d02 admin admin] The token cache is being invalidate because project 1b39a901d49c4f02a27e4bfd6eb6cf8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:15:57.102625 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d0239c6c-3d78-4dc7-a43a-7c6b3b320d02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:15:57.103239 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-d0239c6c-3d78-4dc7-a43a-7c6b3b320d02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:15:57.104749 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1368/2735] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:15:57 2021] DELETE /identity/v3/projects/1b39a901d49c4f02a27e4bfd6eb6cf8c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:15:57.111490 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42b1de-a6fd-4bb6-8d4d-c643dcf02e90 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:57.111807 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42b1de-a6fd-4bb6-8d4d-c643dcf02e90 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:57.112141 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42b1de-a6fd-4bb6-8d4d-c643dcf02e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:57.157108 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-8e42b1de-a6fd-4bb6-8d4d-c643dcf02e90 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:15:57.158280 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8e42b1de-a6fd-4bb6-8d4d-c643dcf02e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:15:57.215727 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1368/2736] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:15:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:15:57.223489 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f10cdb-eefd-455b-8c27-e9c20bfa1f3e None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:57.223776 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f10cdb-eefd-455b-8c27-e9c20bfa1f3e None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:57.224052 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f10cdb-eefd-455b-8c27-e9c20bfa1f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:57.242830 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-a4f10cdb-eefd-455b-8c27-e9c20bfa1f3e None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:15:57.244049 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-a4f10cdb-eefd-455b-8c27-e9c20bfa1f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:15:57.252020 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1369/2737] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:15:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:15:57.256250 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42b1de-a6fd-4bb6-8d4d-c643dcf02e90 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:15:57.266141 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42b1de-a6fd-4bb6-8d4d-c643dcf02e90 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:15:57.270761 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81725684-03e1-4a07-b1a2-53f0f06707e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:15:57.271412 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81725684-03e1-4a07-b1a2-53f0f06707e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:57.271693 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81725684-03e1-4a07-b1a2-53f0f06707e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:57.272549 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81725684-03e1-4a07-b1a2-53f0f06707e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:57.273305 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81725684-03e1-4a07-b1a2-53f0f06707e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 03:15:57.273612 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81725684-03e1-4a07-b1a2-53f0f06707e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:15:57.275182 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81725684-03e1-4a07-b1a2-53f0f06707e3 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:15:57.286263 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1369/2738] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 03:15:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 03:15:57.290404 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f10cdb-eefd-455b-8c27-e9c20bfa1f3e None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:15:57.299824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f10cdb-eefd-455b-8c27-e9c20bfa1f3e None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:15:57.304583 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89716a-c2e9-4cb6-93ef-7d312a42fa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:15:57.305258 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89716a-c2e9-4cb6-93ef-7d312a42fa2f admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:57.305540 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89716a-c2e9-4cb6-93ef-7d312a42fa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:57.305812 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89716a-c2e9-4cb6-93ef-7d312a42fa2f admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:57.306501 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89716a-c2e9-4cb6-93ef-7d312a42fa2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:15:57.308421 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89716a-c2e9-4cb6-93ef-7d312a42fa2f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:15:57.342585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1370/2739] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:15:57 2021] POST /identity/v3/projects => generated 405 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:15:57.346545 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81725684-03e1-4a07-b1a2-53f0f06707e3 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:15:57.356077 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81725684-03e1-4a07-b1a2-53f0f06707e3 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:15:57.409781 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4963d8-a6f2-4ba0-9ab3-b9ad7cc679a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:15:57.410433 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4963d8-a6f2-4ba0-9ab3-b9ad7cc679a5 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:57.410704 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4963d8-a6f2-4ba0-9ab3-b9ad7cc679a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:57.410978 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4963d8-a6f2-4ba0-9ab3-b9ad7cc679a5 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:57.411666 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4963d8-a6f2-4ba0-9ab3-b9ad7cc679a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:15:57.413616 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4963d8-a6f2-4ba0-9ab3-b9ad7cc679a5 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:15:57.432699 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1370/2740] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:15:57 2021] POST /identity/v3/users => generated 303 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:15:57.436685 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89716a-c2e9-4cb6-93ef-7d312a42fa2f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:15:57.447154 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89716a-c2e9-4cb6-93ef-7d312a42fa2f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:15:57.451734 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678537ab-970d-42f6-9f88-538b8de09228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:15:57.452392 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678537ab-970d-42f6-9f88-538b8de09228 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:57.452676 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678537ab-970d-42f6-9f88-538b8de09228 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:57.452982 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678537ab-970d-42f6-9f88-538b8de09228 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:57.453706 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678537ab-970d-42f6-9f88-538b8de09228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:15:57.455289 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678537ab-970d-42f6-9f88-538b8de09228 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:15:57.465341 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1371/2741] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:15:57 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:15:57.469095 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4963d8-a6f2-4ba0-9ab3-b9ad7cc679a5 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:15:57.479084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4963d8-a6f2-4ba0-9ab3-b9ad7cc679a5 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:15:57.483768 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e48c6a-3564-44f5-8de7-16bc742dd591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:15:57.484420 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e48c6a-3564-44f5-8de7-16bc742dd591 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:57.484703 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e48c6a-3564-44f5-8de7-16bc742dd591 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:57.485008 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e48c6a-3564-44f5-8de7-16bc742dd591 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:57.485755 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e48c6a-3564-44f5-8de7-16bc742dd591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:15:57.487323 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e48c6a-3564-44f5-8de7-16bc742dd591 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:15:57.497520 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1371/2742] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:15:57 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:15:57.501539 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678537ab-970d-42f6-9f88-538b8de09228 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:15:57.511655 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678537ab-970d-42f6-9f88-538b8de09228 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:15:57.516159 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dc4a5-d5f0-484e-bf34-8c2f1d9f4c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:15:57.517058 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dc4a5-d5f0-484e-bf34-8c2f1d9f4c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:57.517341 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dc4a5-d5f0-484e-bf34-8c2f1d9f4c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:57.517613 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3dc4a5-d5f0-484e-bf34-8c2f1d9f4c9d admin admin] PATH_INFO: `/v3/projects/bba863a3622c456b8d418285abc87a6e/users/196bd39c68db4f8286e20d7d13df199c/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:57.531902 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3dc4a5-d5f0-484e-bf34-8c2f1d9f4c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba863a3622c456b8d418285abc87a6e, user_id=196bd39c68db4f8286e20d7d13df199c, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:15:57.534564 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3dc4a5-d5f0-484e-bf34-8c2f1d9f4c9d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:15:57.547308 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1372/2743] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:15:57 2021] PUT /identity/v3/projects/bba863a3622c456b8d418285abc87a6e/users/196bd39c68db4f8286e20d7d13df199c/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:15:57.552402 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96733e40-d33d-47ba-970a-66b3ec5c367e None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:57.552692 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96733e40-d33d-47ba-970a-66b3ec5c367e None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:57.553007 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96733e40-d33d-47ba-970a-66b3ec5c367e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:57.572021 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-96733e40-d33d-47ba-970a-66b3ec5c367e None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:15:57.573270 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-96733e40-d33d-47ba-970a-66b3ec5c367e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:15:57.628069 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1372/2744] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:15:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:15:57.638382 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dc4a5-d5f0-484e-bf34-8c2f1d9f4c9d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:15:57.640163 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-7e3dc4a5-d5f0-484e-bf34-8c2f1d9f4c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:15:57.693461 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3dc4a5-d5f0-484e-bf34-8c2f1d9f4c9d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:15:57.697813 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd36d6-29b4-4f94-a51c-1523e15cfbb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:15:57.698446 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd36d6-29b4-4f94-a51c-1523e15cfbb0 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:57.698731 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd36d6-29b4-4f94-a51c-1523e15cfbb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:57.699010 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd36d6-29b4-4f94-a51c-1523e15cfbb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:57.707771 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd36d6-29b4-4f94-a51c-1523e15cfbb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:15:57.709232 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd36d6-29b4-4f94-a51c-1523e15cfbb0 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:15:57.718332 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1373/2745] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:15:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 03:15:58.291986 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95875e-540b-4663-9633-cb8c6d4e6c2f None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:58.292474 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95875e-540b-4663-9633-cb8c6d4e6c2f None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:58.292753 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95875e-540b-4663-9633-cb8c6d4e6c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:58.318529 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-8d95875e-540b-4663-9633-cb8c6d4e6c2f None None] MFA Rules not processed for user `196bd39c68db4f8286e20d7d13df199c`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:15:58.320274 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-8d95875e-540b-4663-9633-cb8c6d4e6c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:15:58.380684 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1373/2746] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:15:58 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:15:58.385982 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd36d6-29b4-4f94-a51c-1523e15cfbb0 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:15:58.395654 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd36d6-29b4-4f94-a51c-1523e15cfbb0 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:15:58.400298 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a3c7f-17c1-482c-b5a6-59e0e63430a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:15:58.400985 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a3c7f-17c1-482c-b5a6-59e0e63430a1 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:58.401269 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a3c7f-17c1-482c-b5a6-59e0e63430a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:58.401536 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a3c7f-17c1-482c-b5a6-59e0e63430a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:58.402234 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a3c7f-17c1-482c-b5a6-59e0e63430a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:15:58.404152 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a3c7f-17c1-482c-b5a6-59e0e63430a1 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:15:58.429897 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1374/2747] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:15:58 2021] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:15:58.433848 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95875e-540b-4663-9633-cb8c6d4e6c2f None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:15:58.444824 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95875e-540b-4663-9633-cb8c6d4e6c2f None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:15:58.499210 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d065b4b-92d2-4f8a-8c44-e57cfacefa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:15:58.499892 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d065b4b-92d2-4f8a-8c44-e57cfacefa36 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:58.500181 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d065b4b-92d2-4f8a-8c44-e57cfacefa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:58.500459 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d065b4b-92d2-4f8a-8c44-e57cfacefa36 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:58.501190 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d065b4b-92d2-4f8a-8c44-e57cfacefa36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:15:58.503101 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d065b4b-92d2-4f8a-8c44-e57cfacefa36 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:15:58.524906 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1374/2748] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:15:58 2021] POST /identity/v3/users => generated 309 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:15:58.526840 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a3c7f-17c1-482c-b5a6-59e0e63430a1 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:15:58.543182 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a3c7f-17c1-482c-b5a6-59e0e63430a1 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:15:58.547989 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397892d5-7628-43e0-9348-be18219677e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:15:58.548652 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397892d5-7628-43e0-9348-be18219677e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:58.548987 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397892d5-7628-43e0-9348-be18219677e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:58.549264 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397892d5-7628-43e0-9348-be18219677e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:58.549985 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397892d5-7628-43e0-9348-be18219677e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:15:58.551595 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397892d5-7628-43e0-9348-be18219677e5 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:15:58.563235 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1375/2749] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:15:58 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:15:58.567203 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d065b4b-92d2-4f8a-8c44-e57cfacefa36 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:15:58.577571 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d065b4b-92d2-4f8a-8c44-e57cfacefa36 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:15:58.582323 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc9589-9619-4ba0-a9a9-8553dd095104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:15:58.583182 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc9589-9619-4ba0-a9a9-8553dd095104 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:58.583462 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc9589-9619-4ba0-a9a9-8553dd095104 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:58.583730 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc9589-9619-4ba0-a9a9-8553dd095104 admin admin] PATH_INFO: `/v3/projects/4bb10cfb1e454e8c975ed41ac4e9ffb7/users/e93fd83d13494d1480982e80281a2698/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:58.598151 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc9589-9619-4ba0-a9a9-8553dd095104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb10cfb1e454e8c975ed41ac4e9ffb7, user_id=e93fd83d13494d1480982e80281a2698, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:15:58.600847 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc9589-9619-4ba0-a9a9-8553dd095104 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:15:58.613026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1375/2750] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:15:58 2021] PUT /identity/v3/projects/4bb10cfb1e454e8c975ed41ac4e9ffb7/users/e93fd83d13494d1480982e80281a2698/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:15:58.617332 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397892d5-7628-43e0-9348-be18219677e5 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:15:58.627226 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397892d5-7628-43e0-9348-be18219677e5 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:15:58.683464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3ff34-8831-4e84-8f6a-9196dc7b2959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:15:58.684278 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3ff34-8831-4e84-8f6a-9196dc7b2959 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:58.684376 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3ff34-8831-4e84-8f6a-9196dc7b2959 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:58.684657 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3ff34-8831-4e84-8f6a-9196dc7b2959 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:58.685414 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3ff34-8831-4e84-8f6a-9196dc7b2959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:15:58.687006 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3ff34-8831-4e84-8f6a-9196dc7b2959 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:15:58.697129 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1376/2751] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:15:58 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:15:58.701235 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc9589-9619-4ba0-a9a9-8553dd095104 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:15:58.711467 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc9589-9619-4ba0-a9a9-8553dd095104 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:15:58.716137 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce065272-f3ff-4ec8-ae55-fe0f8883d0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:15:58.717043 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce065272-f3ff-4ec8-ae55-fe0f8883d0bc admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:58.717326 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce065272-f3ff-4ec8-ae55-fe0f8883d0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:58.717619 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce065272-f3ff-4ec8-ae55-fe0f8883d0bc admin admin] PATH_INFO: `/v3/projects/4bb10cfb1e454e8c975ed41ac4e9ffb7/users/e93fd83d13494d1480982e80281a2698/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:58.719564 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce065272-f3ff-4ec8-ae55-fe0f8883d0bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb10cfb1e454e8c975ed41ac4e9ffb7, user_id=e93fd83d13494d1480982e80281a2698, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:15:58.722210 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce065272-f3ff-4ec8-ae55-fe0f8883d0bc admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:15:58.732485 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1376/2752] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:15:58 2021] PUT /identity/v3/projects/4bb10cfb1e454e8c975ed41ac4e9ffb7/users/e93fd83d13494d1480982e80281a2698/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:15:59.313799 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa6267-4df5-40c6-986a-4d3682a272fa None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:15:59.314174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa6267-4df5-40c6-986a-4d3682a272fa None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:15:59.314460 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa6267-4df5-40c6-986a-4d3682a272fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:15:59.340935 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-32aa6267-4df5-40c6-986a-4d3682a272fa None None] MFA Rules not processed for user `e93fd83d13494d1480982e80281a2698`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:15:59.342159 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-32aa6267-4df5-40c6-986a-4d3682a272fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:15:59.409489 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1377/2753] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:15:59 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:16:00.371204 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce065272-f3ff-4ec8-ae55-fe0f8883d0bc admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:16:00.431460 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce065272-f3ff-4ec8-ae55-fe0f8883d0bc admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:16:00.435949 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfc277-6126-4583-b1fd-5a79ba3eca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:16:00.436796 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfc277-6126-4583-b1fd-5a79ba3eca10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:00.437223 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfc277-6126-4583-b1fd-5a79ba3eca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:00.437493 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfc277-6126-4583-b1fd-5a79ba3eca10 admin admin] PATH_INFO: `/v3/users/196bd39c68db4f8286e20d7d13df199c` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:00.438655 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfc277-6126-4583-b1fd-5a79ba3eca10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=196bd39c68db4f8286e20d7d13df199c)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:16:00.440544 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfc277-6126-4583-b1fd-5a79ba3eca10 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:16:00.485526 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c7cfc277-6126-4583-b1fd-5a79ba3eca10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '196bd39c68db4f8286e20d7d13df199c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:16:00.486175 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c7cfc277-6126-4583-b1fd-5a79ba3eca10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '196bd39c68db4f8286e20d7d13df199c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:16:00.494071 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c7cfc277-6126-4583-b1fd-5a79ba3eca10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '196bd39c68db4f8286e20d7d13df199c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:16:00.494744 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c7cfc277-6126-4583-b1fd-5a79ba3eca10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '196bd39c68db4f8286e20d7d13df199c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:16:00.505763 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-c7cfc277-6126-4583-b1fd-5a79ba3eca10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '196bd39c68db4f8286e20d7d13df199c'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:16:00.517665 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1377/2754] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:16:00 2021] DELETE /identity/v3/users/196bd39c68db4f8286e20d7d13df199c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:16:00.685593 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa6267-4df5-40c6-986a-4d3682a272fa None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:16:00.697964 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa6267-4df5-40c6-986a-4d3682a272fa None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:16:00.750443 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65f196-ea96-4678-841e-f9edff6022b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:16:00.751300 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65f196-ea96-4678-841e-f9edff6022b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:00.751577 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65f196-ea96-4678-841e-f9edff6022b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:00.751848 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65f196-ea96-4678-841e-f9edff6022b8 admin admin] PATH_INFO: `/v3/projects/bba863a3622c456b8d418285abc87a6e` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:00.753052 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65f196-ea96-4678-841e-f9edff6022b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba863a3622c456b8d418285abc87a6e)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:16:00.754944 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65f196-ea96-4678-841e-f9edff6022b8 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:16:00.799179 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0d65f196-ea96-4678-841e-f9edff6022b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba863a3622c456b8d418285abc87a6e', 'request_id': 'req-0d65f196-ea96-4678-841e-f9edff6022b8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:16:00.805439 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0d65f196-ea96-4678-841e-f9edff6022b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba863a3622c456b8d418285abc87a6e', 'request_id': 'req-0d65f196-ea96-4678-841e-f9edff6022b8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:16:00.812297 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0d65f196-ea96-4678-841e-f9edff6022b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba863a3622c456b8d418285abc87a6e', 'request_id': 'req-0d65f196-ea96-4678-841e-f9edff6022b8'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:16:00.822695 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0d65f196-ea96-4678-841e-f9edff6022b8 admin admin] The token cache is being invalidate because project bba863a3622c456b8d418285abc87a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:16:00.822982 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0d65f196-ea96-4678-841e-f9edff6022b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:16:00.823604 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-0d65f196-ea96-4678-841e-f9edff6022b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:16:00.825155 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1378/2755] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:16:00 2021] DELETE /identity/v3/projects/bba863a3622c456b8d418285abc87a6e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:16:00.829127 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfc277-6126-4583-b1fd-5a79ba3eca10 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:16:00.830537 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c7cfc277-6126-4583-b1fd-5a79ba3eca10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:16:00.843144 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfc277-6126-4583-b1fd-5a79ba3eca10 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:16:00.897949 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a823b-3e92-4d8e-97ea-53a40cafaf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:16:00.898742 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a823b-3e92-4d8e-97ea-53a40cafaf8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:00.899018 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a823b-3e92-4d8e-97ea-53a40cafaf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:00.899285 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a823b-3e92-4d8e-97ea-53a40cafaf8a admin admin] PATH_INFO: `/v3/users/e93fd83d13494d1480982e80281a2698` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:00.900448 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a823b-3e92-4d8e-97ea-53a40cafaf8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e93fd83d13494d1480982e80281a2698)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:16:00.902371 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a823b-3e92-4d8e-97ea-53a40cafaf8a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:16:00.945170 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ca7a823b-3e92-4d8e-97ea-53a40cafaf8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e93fd83d13494d1480982e80281a2698'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:16:00.945803 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ca7a823b-3e92-4d8e-97ea-53a40cafaf8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e93fd83d13494d1480982e80281a2698'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:16:00.952572 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ca7a823b-3e92-4d8e-97ea-53a40cafaf8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e93fd83d13494d1480982e80281a2698'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:16:00.953206 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ca7a823b-3e92-4d8e-97ea-53a40cafaf8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e93fd83d13494d1480982e80281a2698'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:16:00.964815 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-ca7a823b-3e92-4d8e-97ea-53a40cafaf8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e93fd83d13494d1480982e80281a2698'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:16:00.976026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1378/2756] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:16:00 2021] DELETE /identity/v3/users/e93fd83d13494d1480982e80281a2698 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:16:01.140693 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65f196-ea96-4678-841e-f9edff6022b8 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:16:01.142171 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-0d65f196-ea96-4678-841e-f9edff6022b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:16:01.155603 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65f196-ea96-4678-841e-f9edff6022b8 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:16:01.211174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f49bd-1ccb-4dc6-af7b-4b1e7e050b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:16:01.212029 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f49bd-1ccb-4dc6-af7b-4b1e7e050b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:01.212312 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f49bd-1ccb-4dc6-af7b-4b1e7e050b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:01.212589 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f49bd-1ccb-4dc6-af7b-4b1e7e050b8f admin admin] PATH_INFO: `/v3/projects/4bb10cfb1e454e8c975ed41ac4e9ffb7` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:01.213802 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f49bd-1ccb-4dc6-af7b-4b1e7e050b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb10cfb1e454e8c975ed41ac4e9ffb7)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:16:01.215705 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f49bd-1ccb-4dc6-af7b-4b1e7e050b8f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:16:01.258445 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-704f49bd-1ccb-4dc6-af7b-4b1e7e050b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb10cfb1e454e8c975ed41ac4e9ffb7', 'request_id': 'req-704f49bd-1ccb-4dc6-af7b-4b1e7e050b8f'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:16:01.264149 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-704f49bd-1ccb-4dc6-af7b-4b1e7e050b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb10cfb1e454e8c975ed41ac4e9ffb7', 'request_id': 'req-704f49bd-1ccb-4dc6-af7b-4b1e7e050b8f'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:16:01.271047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-704f49bd-1ccb-4dc6-af7b-4b1e7e050b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb10cfb1e454e8c975ed41ac4e9ffb7', 'request_id': 'req-704f49bd-1ccb-4dc6-af7b-4b1e7e050b8f'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:16:01.281257 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-704f49bd-1ccb-4dc6-af7b-4b1e7e050b8f admin admin] The token cache is being invalidate because project 4bb10cfb1e454e8c975ed41ac4e9ffb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:16:01.281544 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-704f49bd-1ccb-4dc6-af7b-4b1e7e050b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:16:01.282174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-704f49bd-1ccb-4dc6-af7b-4b1e7e050b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:16:01.283651 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1379/2757] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:16:01 2021] DELETE /identity/v3/projects/4bb10cfb1e454e8c975ed41ac4e9ffb7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:16:01.290009 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7854791-0218-41ff-929b-a3de92388d42 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:01.290304 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7854791-0218-41ff-929b-a3de92388d42 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:01.290587 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7854791-0218-41ff-929b-a3de92388d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:01.308957 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-a7854791-0218-41ff-929b-a3de92388d42 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:16:01.310153 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a7854791-0218-41ff-929b-a3de92388d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:16:01.365369 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1379/2758] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:16:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:16:01.373025 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57068c07-3dff-477e-b037-a674f3c97078 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:01.373313 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57068c07-3dff-477e-b037-a674f3c97078 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:01.373591 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57068c07-3dff-477e-b037-a674f3c97078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:01.391190 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-57068c07-3dff-477e-b037-a674f3c97078 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:16:01.392373 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-57068c07-3dff-477e-b037-a674f3c97078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:16:01.400773 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1380/2759] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:16:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:16:01.404668 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7854791-0218-41ff-929b-a3de92388d42 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:16:01.414809 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7854791-0218-41ff-929b-a3de92388d42 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:16:01.419586 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77009f-db00-4fdd-b050-3b5895eebddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:16:01.420247 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77009f-db00-4fdd-b050-3b5895eebddf admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:01.420531 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77009f-db00-4fdd-b050-3b5895eebddf admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:01.420808 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77009f-db00-4fdd-b050-3b5895eebddf admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:01.421566 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77009f-db00-4fdd-b050-3b5895eebddf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 03:16:01.422125 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77009f-db00-4fdd-b050-3b5895eebddf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:16:01.423743 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77009f-db00-4fdd-b050-3b5895eebddf admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:16:01.434970 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1380/2760] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 03:16:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 03:16:01.438982 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57068c07-3dff-477e-b037-a674f3c97078 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:16:01.448064 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57068c07-3dff-477e-b037-a674f3c97078 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:16:01.452783 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21bb0f-d8ce-49b1-b6c6-3c645804ffeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:16:01.453458 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21bb0f-d8ce-49b1-b6c6-3c645804ffeb admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:01.453742 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21bb0f-d8ce-49b1-b6c6-3c645804ffeb admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:01.454045 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21bb0f-d8ce-49b1-b6c6-3c645804ffeb admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:01.454739 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21bb0f-d8ce-49b1-b6c6-3c645804ffeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:16:01.456630 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21bb0f-d8ce-49b1-b6c6-3c645804ffeb admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:16:01.486206 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1381/2761] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:16:01 2021] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:16:01.487336 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77009f-db00-4fdd-b050-3b5895eebddf admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:16:01.497557 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77009f-db00-4fdd-b050-3b5895eebddf admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:16:01.551004 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a91fbb-6664-4a23-b80b-b02ee55a98e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:16:01.551656 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a91fbb-6664-4a23-b80b-b02ee55a98e3 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:01.551937 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a91fbb-6664-4a23-b80b-b02ee55a98e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:01.552210 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a91fbb-6664-4a23-b80b-b02ee55a98e3 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:01.552907 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a91fbb-6664-4a23-b80b-b02ee55a98e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:16:01.555281 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a91fbb-6664-4a23-b80b-b02ee55a98e3 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:16:01.574492 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1381/2762] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:16:01 2021] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:16:01.578624 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21bb0f-d8ce-49b1-b6c6-3c645804ffeb admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:16:01.589028 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21bb0f-d8ce-49b1-b6c6-3c645804ffeb admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:16:01.593667 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef221c6-912a-4b68-98ef-2e8fd4a25ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:16:01.594318 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef221c6-912a-4b68-98ef-2e8fd4a25ebc admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:01.594616 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef221c6-912a-4b68-98ef-2e8fd4a25ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:01.594874 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef221c6-912a-4b68-98ef-2e8fd4a25ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:01.595617 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef221c6-912a-4b68-98ef-2e8fd4a25ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:16:01.597245 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef221c6-912a-4b68-98ef-2e8fd4a25ebc admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:16:01.607209 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1382/2763] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:16:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 03:16:01.610897 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a91fbb-6664-4a23-b80b-b02ee55a98e3 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:16:01.621085 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a91fbb-6664-4a23-b80b-b02ee55a98e3 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:16:01.625667 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ac000-b5c0-40df-b17e-cfd41b9f04f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:16:01.626314 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ac000-b5c0-40df-b17e-cfd41b9f04f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:01.626596 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ac000-b5c0-40df-b17e-cfd41b9f04f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:01.626870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ac000-b5c0-40df-b17e-cfd41b9f04f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:01.627585 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ac000-b5c0-40df-b17e-cfd41b9f04f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:16:01.629181 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ac000-b5c0-40df-b17e-cfd41b9f04f2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:16:01.638927 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1382/2764] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:16:01 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 03:16:01.642540 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef221c6-912a-4b68-98ef-2e8fd4a25ebc admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:16:01.652636 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef221c6-912a-4b68-98ef-2e8fd4a25ebc admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:16:01.657210 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc646a1-29ed-423b-9a9f-97f517edbc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:16:01.658064 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc646a1-29ed-423b-9a9f-97f517edbc61 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:01.658347 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc646a1-29ed-423b-9a9f-97f517edbc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:01.658623 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc646a1-29ed-423b-9a9f-97f517edbc61 admin admin] PATH_INFO: `/v3/projects/6a9fd5ab9f7e47bdba15a3d01d3e0ebc/users/9731cc1ba0b74c1aaee7631605f5297f/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:01.673176 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc646a1-29ed-423b-9a9f-97f517edbc61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9fd5ab9f7e47bdba15a3d01d3e0ebc, user_id=9731cc1ba0b74c1aaee7631605f5297f, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:16:01.675791 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc646a1-29ed-423b-9a9f-97f517edbc61 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:16:01.688322 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1383/2765] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:16:01 2021] PUT /identity/v3/projects/6a9fd5ab9f7e47bdba15a3d01d3e0ebc/users/9731cc1ba0b74c1aaee7631605f5297f/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:16:01.699083 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5a68d-4b70-4302-9f08-5332a471cdd9 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:01.699377 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5a68d-4b70-4302-9f08-5332a471cdd9 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:01.699657 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5a68d-4b70-4302-9f08-5332a471cdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:01.725356 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-f9c5a68d-4b70-4302-9f08-5332a471cdd9 None None] MFA Rules not processed for user `9731cc1ba0b74c1aaee7631605f5297f`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:16:01.726554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-f9c5a68d-4b70-4302-9f08-5332a471cdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:16:01.786633 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1383/2766] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:16:01 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:16:01.791292 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc646a1-29ed-423b-9a9f-97f517edbc61 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:16:01.849964 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc646a1-29ed-423b-9a9f-97f517edbc61 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:16:01.854561 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0b4dc-f4e2-4706-876c-5b5d450cc4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:16:01.855223 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0b4dc-f4e2-4706-876c-5b5d450cc4ac admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:01.855493 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0b4dc-f4e2-4706-876c-5b5d450cc4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:01.855772 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0b4dc-f4e2-4706-876c-5b5d450cc4ac admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:01.856458 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de0b4dc-f4e2-4706-876c-5b5d450cc4ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:16:01.858379 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de0b4dc-f4e2-4706-876c-5b5d450cc4ac admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:16:01.883135 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1384/2767] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:16:01 2021] POST /identity/v3/projects => generated 393 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:16:01.887196 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5a68d-4b70-4302-9f08-5332a471cdd9 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:16:01.898067 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5a68d-4b70-4302-9f08-5332a471cdd9 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:16:01.950992 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f518a-f600-4936-b73c-b94896eaaa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:16:01.951588 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f518a-f600-4936-b73c-b94896eaaa5c admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:01.951870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f518a-f600-4936-b73c-b94896eaaa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:01.952144 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f518a-f600-4936-b73c-b94896eaaa5c admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:01.952816 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f518a-f600-4936-b73c-b94896eaaa5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:16:01.954759 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f518a-f600-4936-b73c-b94896eaaa5c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:16:01.974228 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1384/2768] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:16:01 2021] POST /identity/v3/users => generated 303 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:16:01.978129 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0b4dc-f4e2-4706-876c-5b5d450cc4ac admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:16:01.988105 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0b4dc-f4e2-4706-876c-5b5d450cc4ac admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:16:01.992836 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25377b-84ed-470d-8768-32bdf2fb34ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:16:01.993521 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25377b-84ed-470d-8768-32bdf2fb34ae admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:01.993802 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25377b-84ed-470d-8768-32bdf2fb34ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:01.994074 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25377b-84ed-470d-8768-32bdf2fb34ae admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:01.994788 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25377b-84ed-470d-8768-32bdf2fb34ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:16:01.996367 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25377b-84ed-470d-8768-32bdf2fb34ae admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:16:02.007100 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1385/2769] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:16:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:16:02.011285 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f518a-f600-4936-b73c-b94896eaaa5c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:16:02.021604 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f518a-f600-4936-b73c-b94896eaaa5c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:16:02.027155 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97a8b7-ff2a-46a3-82d7-a4eda6358f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:16:02.028004 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97a8b7-ff2a-46a3-82d7-a4eda6358f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:02.028283 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97a8b7-ff2a-46a3-82d7-a4eda6358f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:02.028557 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97a8b7-ff2a-46a3-82d7-a4eda6358f6d admin admin] PATH_INFO: `/v3/projects/0b7219f6c9fb47edb7d5ecc6e47d118e/users/61ca8a7f018845608f930ef49e25a9b5/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:02.043066 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97a8b7-ff2a-46a3-82d7-a4eda6358f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b7219f6c9fb47edb7d5ecc6e47d118e, user_id=61ca8a7f018845608f930ef49e25a9b5, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:16:02.045756 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97a8b7-ff2a-46a3-82d7-a4eda6358f6d admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:16:02.059631 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1385/2770] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:16:02 2021] PUT /identity/v3/projects/0b7219f6c9fb47edb7d5ecc6e47d118e/users/61ca8a7f018845608f930ef49e25a9b5/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:16:02.063577 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25377b-84ed-470d-8768-32bdf2fb34ae admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:16:02.073947 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25377b-84ed-470d-8768-32bdf2fb34ae admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:16:02.126427 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9a2ab-b33d-4a41-b0ea-798c66850a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:16:02.127086 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9a2ab-b33d-4a41-b0ea-798c66850a97 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:02.127371 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9a2ab-b33d-4a41-b0ea-798c66850a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:02.127649 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9a2ab-b33d-4a41-b0ea-798c66850a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:02.128365 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a9a2ab-b33d-4a41-b0ea-798c66850a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:16:02.129995 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a9a2ab-b33d-4a41-b0ea-798c66850a97 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:16:02.139867 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1386/2771] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:16:02 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:16:02.144047 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97a8b7-ff2a-46a3-82d7-a4eda6358f6d admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:16:02.153983 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97a8b7-ff2a-46a3-82d7-a4eda6358f6d admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:16:02.158755 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3773ab9-3b0e-46bd-a999-049cbc68e874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:16:02.159623 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3773ab9-3b0e-46bd-a999-049cbc68e874 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:02.159910 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3773ab9-3b0e-46bd-a999-049cbc68e874 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:02.160185 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3773ab9-3b0e-46bd-a999-049cbc68e874 admin admin] PATH_INFO: `/v3/projects/0b7219f6c9fb47edb7d5ecc6e47d118e/users/61ca8a7f018845608f930ef49e25a9b5/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:02.162139 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3773ab9-3b0e-46bd-a999-049cbc68e874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b7219f6c9fb47edb7d5ecc6e47d118e, user_id=61ca8a7f018845608f930ef49e25a9b5, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:16:02.164745 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3773ab9-3b0e-46bd-a999-049cbc68e874 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:16:02.175073 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1386/2772] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:16:02 2021] PUT /identity/v3/projects/0b7219f6c9fb47edb7d5ecc6e47d118e/users/61ca8a7f018845608f930ef49e25a9b5/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:16:02.186800 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46871a2e-932d-4198-a026-843578d53390 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:02.187096 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46871a2e-932d-4198-a026-843578d53390 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:02.187378 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46871a2e-932d-4198-a026-843578d53390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:02.213879 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-46871a2e-932d-4198-a026-843578d53390 None None] MFA Rules not processed for user `61ca8a7f018845608f930ef49e25a9b5`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:16:02.214992 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-46871a2e-932d-4198-a026-843578d53390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:16:02.279133 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1387/2773] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:16:02 2021] POST /identity/v3/auth/tokens => generated 3480 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:16:02.289474 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3773ab9-3b0e-46bd-a999-049cbc68e874 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:16:02.291174 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-c3773ab9-3b0e-46bd-a999-049cbc68e874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:16:02.345514 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3773ab9-3b0e-46bd-a999-049cbc68e874 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:16:02.349181 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f9651-69f4-4d9d-a580-f6aeedaec71b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:16:02.350013 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f9651-69f4-4d9d-a580-f6aeedaec71b service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:02.350947 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f9651-69f4-4d9d-a580-f6aeedaec71b service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:02.351219 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f9651-69f4-4d9d-a580-f6aeedaec71b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:02.360219 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f9651-69f4-4d9d-a580-f6aeedaec71b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:16:02.361913 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f9651-69f4-4d9d-a580-f6aeedaec71b service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:16:02.373286 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1387/2774] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:16:02 2021] GET /identity/v3/auth/tokens => generated 3480 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:16:02.415160 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46871a2e-932d-4198-a026-843578d53390 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:16:02.416556 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-46871a2e-932d-4198-a026-843578d53390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:16:02.428515 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46871a2e-932d-4198-a026-843578d53390 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:16:02.432111 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27bae0-cc90-48ab-8880-ac736e251149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:16:02.432740 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27bae0-cc90-48ab-8880-ac736e251149 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:02.433061 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27bae0-cc90-48ab-8880-ac736e251149 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:02.433338 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27bae0-cc90-48ab-8880-ac736e251149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:02.486687 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27bae0-cc90-48ab-8880-ac736e251149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:16:02.488114 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27bae0-cc90-48ab-8880-ac736e251149 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:16:02.497634 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1388/2775] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:16:02 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:16:16.446631 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f9651-69f4-4d9d-a580-f6aeedaec71b service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:16:16.448121 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-586f9651-69f4-4d9d-a580-f6aeedaec71b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:16:16.511499 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f9651-69f4-4d9d-a580-f6aeedaec71b service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:16:16.515108 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53561407-e6ee-442f-9994-5fe4e764a18c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:16:16.515740 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53561407-e6ee-442f-9994-5fe4e764a18c service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:16:16.516017 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53561407-e6ee-442f-9994-5fe4e764a18c service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:16:16.516287 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53561407-e6ee-442f-9994-5fe4e764a18c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:16:16.518022 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-53561407-e6ee-442f-9994-5fe4e764a18c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:16:16.527504 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53561407-e6ee-442f-9994-5fe4e764a18c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:16:16.528924 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53561407-e6ee-442f-9994-5fe4e764a18c service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:16:16.536622 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1388/2776] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:16:16 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:19:18.098217 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27bae0-cc90-48ab-8880-ac736e251149 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:19:18.099602 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-8b27bae0-cc90-48ab-8880-ac736e251149 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:19:18.168363 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27bae0-cc90-48ab-8880-ac736e251149 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:19:18.173328 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f81a7-b531-4516-9c46-75c0d4f282f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:19:18.173966 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f81a7-b531-4516-9c46-75c0d4f282f5 service placement] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:19:18.174249 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f81a7-b531-4516-9c46-75c0d4f282f5 service placement] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:19:18.174532 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f81a7-b531-4516-9c46-75c0d4f282f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:19:18.176257 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-082f81a7-b531-4516-9c46-75c0d4f282f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:19:18.187541 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f81a7-b531-4516-9c46-75c0d4f282f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:19:18.189132 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f81a7-b531-4516-9c46-75c0d4f282f5 service placement] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:19:18.198699 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1389/2777] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:19:18 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:20:42.668238 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53561407-e6ee-442f-9994-5fe4e764a18c service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:20:42.679879 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53561407-e6ee-442f-9994-5fe4e764a18c service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:20:42.683735 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737cea7-17e5-46cd-894f-a0fbddf546ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:20:42.684360 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737cea7-17e5-46cd-894f-a0fbddf546ad service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:20:42.684641 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737cea7-17e5-46cd-894f-a0fbddf546ad service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:20:42.684965 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737cea7-17e5-46cd-894f-a0fbddf546ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:20:42.686651 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-2737cea7-17e5-46cd-894f-a0fbddf546ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:20:42.761992 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737cea7-17e5-46cd-894f-a0fbddf546ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:20:42.763393 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737cea7-17e5-46cd-894f-a0fbddf546ad service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:20:42.781487 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1389/2778] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:20:42 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:21:02.937613 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8739161-2cd8-459f-b7dd-9494f58b3f29 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:21:02.938207 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8739161-2cd8-459f-b7dd-9494f58b3f29 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:21:02.938313 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8739161-2cd8-459f-b7dd-9494f58b3f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:21:02.982162 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-b8739161-2cd8-459f-b7dd-9494f58b3f29 None None] MFA Rules not processed for user `e0c01428860e44fe9d0b15886add165f`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:21:02.983341 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b8739161-2cd8-459f-b7dd-9494f58b3f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:21:02.989733 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1390/2779] 10.222.0.32 () {58 vars in 1065 bytes} [Wed Sep 15 03:21:02 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:21:02.995964 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737cea7-17e5-46cd-894f-a0fbddf546ad service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:21:03.004106 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737cea7-17e5-46cd-894f-a0fbddf546ad service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:21:03.007700 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fad42-0ba6-4f08-aa8b-cf2b14c7d811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:21:03.008334 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fad42-0ba6-4f08-aa8b-cf2b14c7d811 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:21:03.008616 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fad42-0ba6-4f08-aa8b-cf2b14c7d811 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:21:03.008914 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fad42-0ba6-4f08-aa8b-cf2b14c7d811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:21:03.017026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fad42-0ba6-4f08-aa8b-cf2b14c7d811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:21:03.018446 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fad42-0ba6-4f08-aa8b-cf2b14c7d811 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:21:03.027706 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1390/2780] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:21:02 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:21:23.788753 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3ebf2-fffe-4707-8b86-652672f49abe None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:21:23.789359 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3ebf2-fffe-4707-8b86-652672f49abe None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:21:23.789468 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3ebf2-fffe-4707-8b86-652672f49abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:21:23.835496 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-32f3ebf2-fffe-4707-8b86-652672f49abe None None] MFA Rules not processed for user `91566418241b40ab840e1c3bf9e096c9`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:21:23.836669 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-32f3ebf2-fffe-4707-8b86-652672f49abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:21:23.842972 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1391/2781] 10.222.0.32 () {58 vars in 1062 bytes} [Wed Sep 15 03:21:23 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:21:23.848900 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fad42-0ba6-4f08-aa8b-cf2b14c7d811 service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:21:23.858303 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fad42-0ba6-4f08-aa8b-cf2b14c7d811 service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:21:23.861849 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15add236-1e10-4128-ae15-ae2f5fbfd28b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:21:23.862482 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15add236-1e10-4128-ae15-ae2f5fbfd28b service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:21:23.862788 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15add236-1e10-4128-ae15-ae2f5fbfd28b service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:21:23.863063 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15add236-1e10-4128-ae15-ae2f5fbfd28b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:21:23.870728 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15add236-1e10-4128-ae15-ae2f5fbfd28b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:21:23.872130 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15add236-1e10-4128-ae15-ae2f5fbfd28b service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:21:23.879743 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1391/2782] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:21:23 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 03:22:02.951307 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3ebf2-fffe-4707-8b86-652672f49abe None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:02.960042 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3ebf2-fffe-4707-8b86-652672f49abe None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:02.963592 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de76f1c-ea8a-4c6f-9f88-d52a38d9b782 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:02.964218 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de76f1c-ea8a-4c6f-9f88-d52a38d9b782 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:02.964514 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de76f1c-ea8a-4c6f-9f88-d52a38d9b782 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:02.964769 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de76f1c-ea8a-4c6f-9f88-d52a38d9b782 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:02.974187 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de76f1c-ea8a-4c6f-9f88-d52a38d9b782 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:02.975597 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de76f1c-ea8a-4c6f-9f88-d52a38d9b782 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:02.984612 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1392/2783] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:22:02 2021] GET /identity/v3/auth/tokens => generated 3480 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:22:03.116490 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15add236-1e10-4128-ae15-ae2f5fbfd28b service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:03.175066 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15add236-1e10-4128-ae15-ae2f5fbfd28b service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:03.179587 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e3a0b-4583-44d2-bab2-1cae4549ae9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:03.180456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e3a0b-4583-44d2-bab2-1cae4549ae9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:03.180737 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e3a0b-4583-44d2-bab2-1cae4549ae9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:03.181052 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e3a0b-4583-44d2-bab2-1cae4549ae9b admin admin] PATH_INFO: `/v3/users/9731cc1ba0b74c1aaee7631605f5297f` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:03.182233 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e3a0b-4583-44d2-bab2-1cae4549ae9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9731cc1ba0b74c1aaee7631605f5297f)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:03.184385 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e3a0b-4583-44d2-bab2-1cae4549ae9b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:03.227574 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-082e3a0b-4583-44d2-bab2-1cae4549ae9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9731cc1ba0b74c1aaee7631605f5297f'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:03.228210 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-082e3a0b-4583-44d2-bab2-1cae4549ae9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9731cc1ba0b74c1aaee7631605f5297f'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:03.234347 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-082e3a0b-4583-44d2-bab2-1cae4549ae9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9731cc1ba0b74c1aaee7631605f5297f'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:03.235102 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-082e3a0b-4583-44d2-bab2-1cae4549ae9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9731cc1ba0b74c1aaee7631605f5297f'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:03.246420 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-082e3a0b-4583-44d2-bab2-1cae4549ae9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9731cc1ba0b74c1aaee7631605f5297f'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:03.258444 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1392/2784] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:22:03 2021] DELETE /identity/v3/users/9731cc1ba0b74c1aaee7631605f5297f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:22:03.262905 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df83fa-11b0-4050-a2ea-64fcc5e462fd None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:03.263190 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df83fa-11b0-4050-a2ea-64fcc5e462fd None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:03.264059 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df83fa-11b0-4050-a2ea-64fcc5e462fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:03.281183 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-03df83fa-11b0-4050-a2ea-64fcc5e462fd None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:22:03.282362 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-03df83fa-11b0-4050-a2ea-64fcc5e462fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:22:03.336681 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1393/2785] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:22:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:22:03.346984 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e3a0b-4583-44d2-bab2-1cae4549ae9b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:03.348381 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-082e3a0b-4583-44d2-bab2-1cae4549ae9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:22:03.401437 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e3a0b-4583-44d2-bab2-1cae4549ae9b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:03.405513 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0995ed-9332-48d3-8f6c-31d12dd86aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:03.406147 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0995ed-9332-48d3-8f6c-31d12dd86aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:03.406430 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0995ed-9332-48d3-8f6c-31d12dd86aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:03.406697 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0995ed-9332-48d3-8f6c-31d12dd86aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:03.415350 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0995ed-9332-48d3-8f6c-31d12dd86aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:03.416755 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0995ed-9332-48d3-8f6c-31d12dd86aa6 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:03.426466 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1393/2786] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:22:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:22:03.693701 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df83fa-11b0-4050-a2ea-64fcc5e462fd None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:03.695093 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-03df83fa-11b0-4050-a2ea-64fcc5e462fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:22:03.707532 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df83fa-11b0-4050-a2ea-64fcc5e462fd None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:03.712601 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100af2dc-bbda-4d4a-8936-560f87f9098c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:03.713538 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100af2dc-bbda-4d4a-8936-560f87f9098c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:03.713827 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100af2dc-bbda-4d4a-8936-560f87f9098c admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:03.714102 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100af2dc-bbda-4d4a-8936-560f87f9098c admin admin] PATH_INFO: `/v3/projects/6a9fd5ab9f7e47bdba15a3d01d3e0ebc` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:03.715290 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100af2dc-bbda-4d4a-8936-560f87f9098c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a9fd5ab9f7e47bdba15a3d01d3e0ebc)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:03.717826 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100af2dc-bbda-4d4a-8936-560f87f9098c admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:03.762086 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-100af2dc-bbda-4d4a-8936-560f87f9098c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a9fd5ab9f7e47bdba15a3d01d3e0ebc', 'request_id': 'req-100af2dc-bbda-4d4a-8936-560f87f9098c'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:03.768702 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-100af2dc-bbda-4d4a-8936-560f87f9098c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a9fd5ab9f7e47bdba15a3d01d3e0ebc', 'request_id': 'req-100af2dc-bbda-4d4a-8936-560f87f9098c'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:03.775681 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-100af2dc-bbda-4d4a-8936-560f87f9098c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a9fd5ab9f7e47bdba15a3d01d3e0ebc', 'request_id': 'req-100af2dc-bbda-4d4a-8936-560f87f9098c'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:03.786479 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-100af2dc-bbda-4d4a-8936-560f87f9098c admin admin] The token cache is being invalidate because project 6a9fd5ab9f7e47bdba15a3d01d3e0ebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:22:03.786794 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-100af2dc-bbda-4d4a-8936-560f87f9098c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:03.787420 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-100af2dc-bbda-4d4a-8936-560f87f9098c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:03.788969 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1394/2787] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:22:03 2021] DELETE /identity/v3/projects/6a9fd5ab9f7e47bdba15a3d01d3e0ebc => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:22:03.792830 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0995ed-9332-48d3-8f6c-31d12dd86aa6 service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:03.802770 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0995ed-9332-48d3-8f6c-31d12dd86aa6 service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:03.857192 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1de91-2365-4289-92a5-d2769ca74fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:03.858046 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1de91-2365-4289-92a5-d2769ca74fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:03.858330 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1de91-2365-4289-92a5-d2769ca74fff admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:03.858599 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1de91-2365-4289-92a5-d2769ca74fff admin admin] PATH_INFO: `/v3/users/61ca8a7f018845608f930ef49e25a9b5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:03.859762 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1de91-2365-4289-92a5-d2769ca74fff admin admin] RBAC: Authorizing `identity:delete_user(user_id=61ca8a7f018845608f930ef49e25a9b5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:03.861672 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1de91-2365-4289-92a5-d2769ca74fff admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:03.903651 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a2b1de91-2365-4289-92a5-d2769ca74fff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61ca8a7f018845608f930ef49e25a9b5'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:03.904859 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a2b1de91-2365-4289-92a5-d2769ca74fff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61ca8a7f018845608f930ef49e25a9b5'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:03.911498 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a2b1de91-2365-4289-92a5-d2769ca74fff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61ca8a7f018845608f930ef49e25a9b5'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:03.912126 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a2b1de91-2365-4289-92a5-d2769ca74fff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61ca8a7f018845608f930ef49e25a9b5'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:03.923164 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-a2b1de91-2365-4289-92a5-d2769ca74fff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61ca8a7f018845608f930ef49e25a9b5'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:03.934795 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1394/2788] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:22:03 2021] DELETE /identity/v3/users/61ca8a7f018845608f930ef49e25a9b5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:22:04.202504 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100af2dc-bbda-4d4a-8936-560f87f9098c admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:04.204137 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-100af2dc-bbda-4d4a-8936-560f87f9098c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:22:04.217266 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100af2dc-bbda-4d4a-8936-560f87f9098c admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:04.270310 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960185b7-5f36-419e-b4e4-91d98542c09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:04.271161 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960185b7-5f36-419e-b4e4-91d98542c09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:04.271444 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960185b7-5f36-419e-b4e4-91d98542c09b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:04.271720 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960185b7-5f36-419e-b4e4-91d98542c09b admin admin] PATH_INFO: `/v3/projects/0b7219f6c9fb47edb7d5ecc6e47d118e` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:04.272910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960185b7-5f36-419e-b4e4-91d98542c09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b7219f6c9fb47edb7d5ecc6e47d118e)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:04.274811 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960185b7-5f36-419e-b4e4-91d98542c09b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:04.319005 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-960185b7-5f36-419e-b4e4-91d98542c09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b7219f6c9fb47edb7d5ecc6e47d118e', 'request_id': 'req-960185b7-5f36-419e-b4e4-91d98542c09b'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:04.324790 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-960185b7-5f36-419e-b4e4-91d98542c09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b7219f6c9fb47edb7d5ecc6e47d118e', 'request_id': 'req-960185b7-5f36-419e-b4e4-91d98542c09b'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:04.332117 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-960185b7-5f36-419e-b4e4-91d98542c09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b7219f6c9fb47edb7d5ecc6e47d118e', 'request_id': 'req-960185b7-5f36-419e-b4e4-91d98542c09b'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:04.342444 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-960185b7-5f36-419e-b4e4-91d98542c09b admin admin] The token cache is being invalidate because project 0b7219f6c9fb47edb7d5ecc6e47d118e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:22:04.342729 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-960185b7-5f36-419e-b4e4-91d98542c09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:04.343349 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-960185b7-5f36-419e-b4e4-91d98542c09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:04.344843 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1395/2789] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:22:04 2021] DELETE /identity/v3/projects/0b7219f6c9fb47edb7d5ecc6e47d118e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:22:04.351928 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a32b61-8327-4b4b-8a1d-a963c5b62bba None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:04.352438 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a32b61-8327-4b4b-8a1d-a963c5b62bba None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:04.352534 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a32b61-8327-4b4b-8a1d-a963c5b62bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:04.369977 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-e6a32b61-8327-4b4b-8a1d-a963c5b62bba None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:22:04.371170 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e6a32b61-8327-4b4b-8a1d-a963c5b62bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:22:04.427144 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1395/2790] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:22:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:22:04.435362 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586897fc-eee9-4f9c-93c2-a45d456ae1f0 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:04.435655 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586897fc-eee9-4f9c-93c2-a45d456ae1f0 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:04.435934 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586897fc-eee9-4f9c-93c2-a45d456ae1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:04.454699 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-586897fc-eee9-4f9c-93c2-a45d456ae1f0 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:22:04.455819 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-586897fc-eee9-4f9c-93c2-a45d456ae1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:22:04.463965 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1396/2791] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:22:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:22:04.468636 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a32b61-8327-4b4b-8a1d-a963c5b62bba None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:04.478332 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a32b61-8327-4b4b-8a1d-a963c5b62bba None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:04.482973 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37332be3-792b-48a3-b7ad-fac8f7fd2e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:04.483632 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37332be3-792b-48a3-b7ad-fac8f7fd2e97 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:04.483920 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37332be3-792b-48a3-b7ad-fac8f7fd2e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:04.484194 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37332be3-792b-48a3-b7ad-fac8f7fd2e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:04.484945 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37332be3-792b-48a3-b7ad-fac8f7fd2e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 03:22:04.485367 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37332be3-792b-48a3-b7ad-fac8f7fd2e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:04.486935 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37332be3-792b-48a3-b7ad-fac8f7fd2e97 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:04.498050 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1396/2792] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 03:22:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 03:22:04.502289 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586897fc-eee9-4f9c-93c2-a45d456ae1f0 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:04.511281 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586897fc-eee9-4f9c-93c2-a45d456ae1f0 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:04.516497 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6541b-36bd-4dd5-9c19-0357d589dd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:04.517179 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6541b-36bd-4dd5-9c19-0357d589dd98 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:04.517464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6541b-36bd-4dd5-9c19-0357d589dd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:04.517743 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa6541b-36bd-4dd5-9c19-0357d589dd98 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:04.518457 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6541b-36bd-4dd5-9c19-0357d589dd98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:04.520342 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa6541b-36bd-4dd5-9c19-0357d589dd98 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:04.545236 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1397/2793] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:22:04 2021] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:22:04.549248 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37332be3-792b-48a3-b7ad-fac8f7fd2e97 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:04.559065 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37332be3-792b-48a3-b7ad-fac8f7fd2e97 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:04.611607 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e82f3-e630-49fd-81d9-a3d3086a53b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:04.612262 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e82f3-e630-49fd-81d9-a3d3086a53b1 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:04.612543 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e82f3-e630-49fd-81d9-a3d3086a53b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:04.612818 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e82f3-e630-49fd-81d9-a3d3086a53b1 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:04.613527 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e82f3-e630-49fd-81d9-a3d3086a53b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:04.615413 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e82f3-e630-49fd-81d9-a3d3086a53b1 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:04.634345 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1397/2794] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:22:04 2021] POST /identity/v3/users => generated 290 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:22:04.639042 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6541b-36bd-4dd5-9c19-0357d589dd98 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:04.649023 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa6541b-36bd-4dd5-9c19-0357d589dd98 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:04.653542 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26ef7a-b414-43cf-8a46-94524be67329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:04.654815 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26ef7a-b414-43cf-8a46-94524be67329 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:04.655098 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26ef7a-b414-43cf-8a46-94524be67329 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:04.655570 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26ef7a-b414-43cf-8a46-94524be67329 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:04.656293 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26ef7a-b414-43cf-8a46-94524be67329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:04.657916 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26ef7a-b414-43cf-8a46-94524be67329 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:04.668018 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1398/2795] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:22:04 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:22:04.671651 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e82f3-e630-49fd-81d9-a3d3086a53b1 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:04.681014 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e82f3-e630-49fd-81d9-a3d3086a53b1 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:04.686394 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f6db2-9508-43ab-834e-fc3200073c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:04.687035 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f6db2-9508-43ab-834e-fc3200073c71 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:04.687316 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f6db2-9508-43ab-834e-fc3200073c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:04.687589 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f6db2-9508-43ab-834e-fc3200073c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:04.688297 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f6db2-9508-43ab-834e-fc3200073c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:04.689887 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f6db2-9508-43ab-834e-fc3200073c71 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:04.699512 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1398/2796] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:22:04 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:22:04.703888 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26ef7a-b414-43cf-8a46-94524be67329 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:04.713658 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26ef7a-b414-43cf-8a46-94524be67329 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:04.718160 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bb2d7-73ed-477f-884f-e91b93e5faf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:04.719022 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bb2d7-73ed-477f-884f-e91b93e5faf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:04.719330 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bb2d7-73ed-477f-884f-e91b93e5faf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:04.719604 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bb2d7-73ed-477f-884f-e91b93e5faf2 admin admin] PATH_INFO: `/v3/projects/6de288c5c7644b3f9503f5c5706080a3/users/515666db79d84de6af463fb3ef0222c6/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:04.733572 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bb2d7-73ed-477f-884f-e91b93e5faf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de288c5c7644b3f9503f5c5706080a3, user_id=515666db79d84de6af463fb3ef0222c6, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:04.736205 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bb2d7-73ed-477f-884f-e91b93e5faf2 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:04.749323 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1399/2797] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:22:04 2021] PUT /identity/v3/projects/6de288c5c7644b3f9503f5c5706080a3/users/515666db79d84de6af463fb3ef0222c6/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:22:04.800498 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae4f58-8cb5-4cda-8190-5d215f840bf4 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:04.800792 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae4f58-8cb5-4cda-8190-5d215f840bf4 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:04.801105 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae4f58-8cb5-4cda-8190-5d215f840bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:04.828208 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-1eae4f58-8cb5-4cda-8190-5d215f840bf4 None None] MFA Rules not processed for user `515666db79d84de6af463fb3ef0222c6`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:22:04.829436 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-1eae4f58-8cb5-4cda-8190-5d215f840bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:22:04.888310 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1399/2798] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:22:04 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:22:04.893328 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bb2d7-73ed-477f-884f-e91b93e5faf2 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:04.952385 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bb2d7-73ed-477f-884f-e91b93e5faf2 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:04.957040 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041629d5-fe34-4dfb-835f-4860a5263ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:04.957683 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041629d5-fe34-4dfb-835f-4860a5263ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:04.957962 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041629d5-fe34-4dfb-835f-4860a5263ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:04.958232 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041629d5-fe34-4dfb-835f-4860a5263ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:04.958910 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041629d5-fe34-4dfb-835f-4860a5263ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:04.960787 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041629d5-fe34-4dfb-835f-4860a5263ae7 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:04.984063 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1400/2799] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:22:04 2021] POST /identity/v3/projects => generated 379 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:22:04.988058 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae4f58-8cb5-4cda-8190-5d215f840bf4 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:04.998973 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae4f58-8cb5-4cda-8190-5d215f840bf4 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:05.051641 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb135a1-51ec-427d-bf14-e086a64045c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:05.052306 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb135a1-51ec-427d-bf14-e086a64045c2 admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:05.052592 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb135a1-51ec-427d-bf14-e086a64045c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:05.052870 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb135a1-51ec-427d-bf14-e086a64045c2 admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:05.053576 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb135a1-51ec-427d-bf14-e086a64045c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:05.055482 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb135a1-51ec-427d-bf14-e086a64045c2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:05.076713 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1400/2800] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:22:04 2021] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:22:05.080510 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041629d5-fe34-4dfb-835f-4860a5263ae7 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:05.090462 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041629d5-fe34-4dfb-835f-4860a5263ae7 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:05.095311 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b1a04-f048-4d37-b77f-202ce90b3f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:05.095960 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b1a04-f048-4d37-b77f-202ce90b3f2b admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:05.096260 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b1a04-f048-4d37-b77f-202ce90b3f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:05.096510 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b1a04-f048-4d37-b77f-202ce90b3f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:05.097293 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b1a04-f048-4d37-b77f-202ce90b3f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:05.098879 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b1a04-f048-4d37-b77f-202ce90b3f2b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:05.109107 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1401/2801] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:22:05 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 03:22:05.112837 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb135a1-51ec-427d-bf14-e086a64045c2 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:05.122554 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb135a1-51ec-427d-bf14-e086a64045c2 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:05.127744 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0a753-2fcc-4873-9ef5-cd1bb2d41356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:05.128614 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0a753-2fcc-4873-9ef5-cd1bb2d41356 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:05.128910 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0a753-2fcc-4873-9ef5-cd1bb2d41356 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:05.129218 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0a753-2fcc-4873-9ef5-cd1bb2d41356 admin admin] PATH_INFO: `/v3/projects/c669629dafae4523805c107825b19e05/users/f078a7e4508942f1ab0e3ebc05e2ac39/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:05.143463 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0a753-2fcc-4873-9ef5-cd1bb2d41356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c669629dafae4523805c107825b19e05, user_id=f078a7e4508942f1ab0e3ebc05e2ac39, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:05.146101 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0a753-2fcc-4873-9ef5-cd1bb2d41356 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:05.158848 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1401/2802] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:22:05 2021] PUT /identity/v3/projects/c669629dafae4523805c107825b19e05/users/f078a7e4508942f1ab0e3ebc05e2ac39/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:22:05.162575 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b1a04-f048-4d37-b77f-202ce90b3f2b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:05.172064 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b1a04-f048-4d37-b77f-202ce90b3f2b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:05.226025 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46419337-1248-49f9-8a16-39258851a6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:05.226669 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46419337-1248-49f9-8a16-39258851a6ca admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:05.226952 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46419337-1248-49f9-8a16-39258851a6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:05.227229 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46419337-1248-49f9-8a16-39258851a6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:05.227948 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46419337-1248-49f9-8a16-39258851a6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:05.229577 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46419337-1248-49f9-8a16-39258851a6ca admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:05.239106 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1402/2803] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:22:05 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:22:05.243089 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0a753-2fcc-4873-9ef5-cd1bb2d41356 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:05.253135 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0a753-2fcc-4873-9ef5-cd1bb2d41356 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:05.257715 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02af73-9fa2-44cb-8339-bf8d3cd73b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:05.258577 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02af73-9fa2-44cb-8339-bf8d3cd73b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:05.258860 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02af73-9fa2-44cb-8339-bf8d3cd73b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:05.259136 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02af73-9fa2-44cb-8339-bf8d3cd73b86 admin admin] PATH_INFO: `/v3/projects/c669629dafae4523805c107825b19e05/users/f078a7e4508942f1ab0e3ebc05e2ac39/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:05.261121 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02af73-9fa2-44cb-8339-bf8d3cd73b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c669629dafae4523805c107825b19e05, user_id=f078a7e4508942f1ab0e3ebc05e2ac39, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:05.264213 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02af73-9fa2-44cb-8339-bf8d3cd73b86 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:05.274015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1402/2804] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:22:05 2021] PUT /identity/v3/projects/c669629dafae4523805c107825b19e05/users/f078a7e4508942f1ab0e3ebc05e2ac39/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:22:05.284522 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798626ea-ab77-4ba6-825c-0e4aee394c7b None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:05.284813 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798626ea-ab77-4ba6-825c-0e4aee394c7b None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:05.285415 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798626ea-ab77-4ba6-825c-0e4aee394c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:05.310754 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-798626ea-ab77-4ba6-825c-0e4aee394c7b None None] MFA Rules not processed for user `f078a7e4508942f1ab0e3ebc05e2ac39`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:22:05.311953 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-798626ea-ab77-4ba6-825c-0e4aee394c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:22:05.376464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1403/2805] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:22:05 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:22:05.386241 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02af73-9fa2-44cb-8339-bf8d3cd73b86 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:05.387950 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7f02af73-9fa2-44cb-8339-bf8d3cd73b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:22:05.443145 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02af73-9fa2-44cb-8339-bf8d3cd73b86 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:05.446784 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ab182-8145-4341-958a-66cb186231ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:05.447414 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ab182-8145-4341-958a-66cb186231ca service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:05.447698 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ab182-8145-4341-958a-66cb186231ca service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:05.447976 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ab182-8145-4341-958a-66cb186231ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:05.457725 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ab182-8145-4341-958a-66cb186231ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:05.459144 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ab182-8145-4341-958a-66cb186231ca service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:05.469442 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1403/2806] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:22:05 2021] GET /identity/v3/auth/tokens => generated 3466 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:22:05.786131 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798626ea-ab77-4ba6-825c-0e4aee394c7b None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:05.846558 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798626ea-ab77-4ba6-825c-0e4aee394c7b None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:05.851091 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72213ca9-463b-4eca-9edb-b886d063041d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:05.851956 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72213ca9-463b-4eca-9edb-b886d063041d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:05.852237 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72213ca9-463b-4eca-9edb-b886d063041d admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:05.852513 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72213ca9-463b-4eca-9edb-b886d063041d admin admin] PATH_INFO: `/v3/users/515666db79d84de6af463fb3ef0222c6` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:05.853728 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72213ca9-463b-4eca-9edb-b886d063041d admin admin] RBAC: Authorizing `identity:delete_user(user_id=515666db79d84de6af463fb3ef0222c6)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:05.855634 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72213ca9-463b-4eca-9edb-b886d063041d admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:05.898521 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-72213ca9-463b-4eca-9edb-b886d063041d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '515666db79d84de6af463fb3ef0222c6'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:05.909736 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-72213ca9-463b-4eca-9edb-b886d063041d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '515666db79d84de6af463fb3ef0222c6'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:05.910389 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-72213ca9-463b-4eca-9edb-b886d063041d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '515666db79d84de6af463fb3ef0222c6'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:05.917040 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-72213ca9-463b-4eca-9edb-b886d063041d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '515666db79d84de6af463fb3ef0222c6'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:05.923990 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-72213ca9-463b-4eca-9edb-b886d063041d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '515666db79d84de6af463fb3ef0222c6'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:05.929671 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1404/2807] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:22:05 2021] DELETE /identity/v3/users/515666db79d84de6af463fb3ef0222c6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:22:05.934435 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb892cb5-7b0c-48dc-9004-5d8dfe2fb9a4 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:05.934726 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb892cb5-7b0c-48dc-9004-5d8dfe2fb9a4 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:05.934999 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb892cb5-7b0c-48dc-9004-5d8dfe2fb9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:05.952503 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-cb892cb5-7b0c-48dc-9004-5d8dfe2fb9a4 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:22:05.953718 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-cb892cb5-7b0c-48dc-9004-5d8dfe2fb9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:22:06.007570 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1404/2808] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:22:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:22:06.017184 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72213ca9-463b-4eca-9edb-b886d063041d admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:06.018611 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-72213ca9-463b-4eca-9edb-b886d063041d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:22:06.072072 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72213ca9-463b-4eca-9edb-b886d063041d admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:06.075674 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbdda0-de52-4129-ba56-f771d7927407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:06.076340 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbdda0-de52-4129-ba56-f771d7927407 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:06.076615 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbdda0-de52-4129-ba56-f771d7927407 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:06.076903 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbdda0-de52-4129-ba56-f771d7927407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:06.085958 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbdda0-de52-4129-ba56-f771d7927407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:06.087390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addbdda0-de52-4129-ba56-f771d7927407 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:06.096605 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1405/2809] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:22:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 03:22:06.361130 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb892cb5-7b0c-48dc-9004-5d8dfe2fb9a4 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:06.362772 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-cb892cb5-7b0c-48dc-9004-5d8dfe2fb9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:22:06.374571 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb892cb5-7b0c-48dc-9004-5d8dfe2fb9a4 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:06.379571 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c486627-bfa3-422c-ae7e-f0166aac0ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:06.380430 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c486627-bfa3-422c-ae7e-f0166aac0ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:06.380709 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c486627-bfa3-422c-ae7e-f0166aac0ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:06.381015 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c486627-bfa3-422c-ae7e-f0166aac0ab2 admin admin] PATH_INFO: `/v3/projects/6de288c5c7644b3f9503f5c5706080a3` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:06.382785 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c486627-bfa3-422c-ae7e-f0166aac0ab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de288c5c7644b3f9503f5c5706080a3)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:06.384904 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c486627-bfa3-422c-ae7e-f0166aac0ab2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:06.430587 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-4c486627-bfa3-422c-ae7e-f0166aac0ab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de288c5c7644b3f9503f5c5706080a3', 'request_id': 'req-4c486627-bfa3-422c-ae7e-f0166aac0ab2'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:06.437033 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-4c486627-bfa3-422c-ae7e-f0166aac0ab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de288c5c7644b3f9503f5c5706080a3', 'request_id': 'req-4c486627-bfa3-422c-ae7e-f0166aac0ab2'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:06.442150 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-4c486627-bfa3-422c-ae7e-f0166aac0ab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de288c5c7644b3f9503f5c5706080a3', 'request_id': 'req-4c486627-bfa3-422c-ae7e-f0166aac0ab2'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:06.452424 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-4c486627-bfa3-422c-ae7e-f0166aac0ab2 admin admin] The token cache is being invalidate because project 6de288c5c7644b3f9503f5c5706080a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:22:06.452706 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-4c486627-bfa3-422c-ae7e-f0166aac0ab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:06.453359 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-4c486627-bfa3-422c-ae7e-f0166aac0ab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:06.454845 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1405/2810] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:22:06 2021] DELETE /identity/v3/projects/6de288c5c7644b3f9503f5c5706080a3 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:22:06.458924 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbdda0-de52-4129-ba56-f771d7927407 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:06.468837 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbdda0-de52-4129-ba56-f771d7927407 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:06.522237 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a433ae9-7252-4515-bb1d-340cc7f36846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:06.523101 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a433ae9-7252-4515-bb1d-340cc7f36846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:06.523384 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a433ae9-7252-4515-bb1d-340cc7f36846 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:06.523660 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a433ae9-7252-4515-bb1d-340cc7f36846 admin admin] PATH_INFO: `/v3/users/f078a7e4508942f1ab0e3ebc05e2ac39` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:06.524833 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a433ae9-7252-4515-bb1d-340cc7f36846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f078a7e4508942f1ab0e3ebc05e2ac39)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:06.526775 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a433ae9-7252-4515-bb1d-340cc7f36846 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:06.569830 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5a433ae9-7252-4515-bb1d-340cc7f36846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f078a7e4508942f1ab0e3ebc05e2ac39'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:06.581368 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5a433ae9-7252-4515-bb1d-340cc7f36846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f078a7e4508942f1ab0e3ebc05e2ac39'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:06.582040 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5a433ae9-7252-4515-bb1d-340cc7f36846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f078a7e4508942f1ab0e3ebc05e2ac39'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:06.588772 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5a433ae9-7252-4515-bb1d-340cc7f36846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f078a7e4508942f1ab0e3ebc05e2ac39'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:06.596042 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5a433ae9-7252-4515-bb1d-340cc7f36846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f078a7e4508942f1ab0e3ebc05e2ac39'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:06.601736 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1406/2811] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:22:06 2021] DELETE /identity/v3/users/f078a7e4508942f1ab0e3ebc05e2ac39 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:22:06.868984 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c486627-bfa3-422c-ae7e-f0166aac0ab2 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:06.870419 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-4c486627-bfa3-422c-ae7e-f0166aac0ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:22:06.883528 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c486627-bfa3-422c-ae7e-f0166aac0ab2 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:06.938072 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c12fb-6fa6-4aff-814e-abb609db61b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:06.938922 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c12fb-6fa6-4aff-814e-abb609db61b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:06.939202 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c12fb-6fa6-4aff-814e-abb609db61b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:06.939474 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c12fb-6fa6-4aff-814e-abb609db61b2 admin admin] PATH_INFO: `/v3/projects/c669629dafae4523805c107825b19e05` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:06.940744 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c12fb-6fa6-4aff-814e-abb609db61b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c669629dafae4523805c107825b19e05)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:06.942652 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c12fb-6fa6-4aff-814e-abb609db61b2 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:06.985155 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-db8c12fb-6fa6-4aff-814e-abb609db61b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c669629dafae4523805c107825b19e05', 'request_id': 'req-db8c12fb-6fa6-4aff-814e-abb609db61b2'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:06.991747 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-db8c12fb-6fa6-4aff-814e-abb609db61b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c669629dafae4523805c107825b19e05', 'request_id': 'req-db8c12fb-6fa6-4aff-814e-abb609db61b2'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:06.997122 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-db8c12fb-6fa6-4aff-814e-abb609db61b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c669629dafae4523805c107825b19e05', 'request_id': 'req-db8c12fb-6fa6-4aff-814e-abb609db61b2'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:07.008175 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-db8c12fb-6fa6-4aff-814e-abb609db61b2 admin admin] The token cache is being invalidate because project c669629dafae4523805c107825b19e05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:22:07.008462 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-db8c12fb-6fa6-4aff-814e-abb609db61b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:07.009101 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-db8c12fb-6fa6-4aff-814e-abb609db61b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:22:07.010626 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1406/2812] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:22:06 2021] DELETE /identity/v3/projects/c669629dafae4523805c107825b19e05 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:22:07.016938 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736561d-ef54-47d5-a225-f1d05db85e5e None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:07.017225 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736561d-ef54-47d5-a225-f1d05db85e5e None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:07.017524 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736561d-ef54-47d5-a225-f1d05db85e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:07.034796 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-7736561d-ef54-47d5-a225-f1d05db85e5e None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:22:07.035970 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-7736561d-ef54-47d5-a225-f1d05db85e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:22:07.090817 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1407/2813] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:22:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:22:07.099516 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54abc7-9f9a-4fcd-95ea-4932fbb665fc None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:07.099742 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54abc7-9f9a-4fcd-95ea-4932fbb665fc None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:07.100022 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54abc7-9f9a-4fcd-95ea-4932fbb665fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:07.117885 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-be54abc7-9f9a-4fcd-95ea-4932fbb665fc None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:22:07.119069 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-be54abc7-9f9a-4fcd-95ea-4932fbb665fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:22:07.127391 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1407/2814] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:22:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:22:07.131509 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736561d-ef54-47d5-a225-f1d05db85e5e None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:07.141515 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736561d-ef54-47d5-a225-f1d05db85e5e None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:07.146110 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac911858-7f86-48df-84f1-4522d22f95bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:07.146778 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac911858-7f86-48df-84f1-4522d22f95bf admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:07.147059 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac911858-7f86-48df-84f1-4522d22f95bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:07.147334 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac911858-7f86-48df-84f1-4522d22f95bf admin admin] PATH_INFO: `/v3/domains` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:07.148050 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac911858-7f86-48df-84f1-4522d22f95bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 03:22:07.148356 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac911858-7f86-48df-84f1-4522d22f95bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:07.149974 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac911858-7f86-48df-84f1-4522d22f95bf admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:07.160986 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1408/2815] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 03:22:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 03:22:07.164988 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54abc7-9f9a-4fcd-95ea-4932fbb665fc None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:07.173789 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54abc7-9f9a-4fcd-95ea-4932fbb665fc None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:07.178448 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12683edc-e63c-4c30-a582-c2f2923b54cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:07.179081 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12683edc-e63c-4c30-a582-c2f2923b54cf admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:07.179365 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12683edc-e63c-4c30-a582-c2f2923b54cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:07.179643 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12683edc-e63c-4c30-a582-c2f2923b54cf admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:07.180328 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12683edc-e63c-4c30-a582-c2f2923b54cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:07.182221 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12683edc-e63c-4c30-a582-c2f2923b54cf admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:07.207412 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1408/2816] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:22:07 2021] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:22:07.211341 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac911858-7f86-48df-84f1-4522d22f95bf admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:07.220859 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac911858-7f86-48df-84f1-4522d22f95bf admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:07.275106 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfda93-047a-4f8b-b3d3-3b1567fd7d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:07.275761 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfda93-047a-4f8b-b3d3-3b1567fd7d52 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:07.276042 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfda93-047a-4f8b-b3d3-3b1567fd7d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:07.276313 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfda93-047a-4f8b-b3d3-3b1567fd7d52 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:07.277051 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bfda93-047a-4f8b-b3d3-3b1567fd7d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:07.278939 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bfda93-047a-4f8b-b3d3-3b1567fd7d52 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:07.297863 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1409/2817] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:22:07 2021] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:22:07.301910 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12683edc-e63c-4c30-a582-c2f2923b54cf admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:07.312796 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12683edc-e63c-4c30-a582-c2f2923b54cf admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:07.317505 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341890e-ddf1-4408-b7a7-05ad5c73ef6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:07.318158 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341890e-ddf1-4408-b7a7-05ad5c73ef6a admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:07.318442 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341890e-ddf1-4408-b7a7-05ad5c73ef6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:07.318718 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341890e-ddf1-4408-b7a7-05ad5c73ef6a admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:07.319466 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341890e-ddf1-4408-b7a7-05ad5c73ef6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:07.321077 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341890e-ddf1-4408-b7a7-05ad5c73ef6a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:07.331125 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1409/2818] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:22:07 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:22:07.334706 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfda93-047a-4f8b-b3d3-3b1567fd7d52 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:07.344047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfda93-047a-4f8b-b3d3-3b1567fd7d52 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:07.348595 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be1111-b7ea-4697-af51-d4f5aa4b9f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:07.349269 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be1111-b7ea-4697-af51-d4f5aa4b9f13 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:07.349603 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be1111-b7ea-4697-af51-d4f5aa4b9f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:07.349824 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be1111-b7ea-4697-af51-d4f5aa4b9f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:07.350538 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be1111-b7ea-4697-af51-d4f5aa4b9f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:07.352098 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be1111-b7ea-4697-af51-d4f5aa4b9f13 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:07.363756 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1410/2819] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:22:07 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:22:07.367510 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341890e-ddf1-4408-b7a7-05ad5c73ef6a admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:07.377633 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341890e-ddf1-4408-b7a7-05ad5c73ef6a admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:07.382310 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795225e2-95b3-42d2-ab02-ed38be54704f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:07.383157 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795225e2-95b3-42d2-ab02-ed38be54704f admin admin] REQUEST_METHOD: `PUT` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:07.383439 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795225e2-95b3-42d2-ab02-ed38be54704f admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:07.383744 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795225e2-95b3-42d2-ab02-ed38be54704f admin admin] PATH_INFO: `/v3/projects/73ad025c127e4fe3af35efcdf32bed1b/users/2c82a40028f5433380ad9c55300fab48/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:07.397501 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795225e2-95b3-42d2-ab02-ed38be54704f admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ad025c127e4fe3af35efcdf32bed1b, user_id=2c82a40028f5433380ad9c55300fab48, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:07.400093 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795225e2-95b3-42d2-ab02-ed38be54704f admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:07.412559 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1410/2820] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:22:07 2021] PUT /identity/v3/projects/73ad025c127e4fe3af35efcdf32bed1b/users/2c82a40028f5433380ad9c55300fab48/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:22:07.423126 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1addf4-e517-475f-b27e-e3c3d4bf42b8 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:07.423420 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1addf4-e517-475f-b27e-e3c3d4bf42b8 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:07.423703 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1addf4-e517-475f-b27e-e3c3d4bf42b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:07.449627 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-ba1addf4-e517-475f-b27e-e3c3d4bf42b8 None None] MFA Rules not processed for user `2c82a40028f5433380ad9c55300fab48`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:22:07.450827 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ba1addf4-e517-475f-b27e-e3c3d4bf42b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:22:07.512390 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1411/2821] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:22:07 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:22:07.516814 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795225e2-95b3-42d2-ab02-ed38be54704f admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:07.579191 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795225e2-95b3-42d2-ab02-ed38be54704f admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:07.583951 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44ea9d-24b4-46a0-87f8-edef4c0138af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:07.584607 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44ea9d-24b4-46a0-87f8-edef4c0138af admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:07.584910 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44ea9d-24b4-46a0-87f8-edef4c0138af admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:07.585195 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44ea9d-24b4-46a0-87f8-edef4c0138af admin admin] PATH_INFO: `/v3/projects` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:07.585886 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44ea9d-24b4-46a0-87f8-edef4c0138af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:07.587807 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44ea9d-24b4-46a0-87f8-edef4c0138af admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:07.611932 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1411/2822] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:22:07 2021] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:22:07.615889 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1addf4-e517-475f-b27e-e3c3d4bf42b8 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:07.626878 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1addf4-e517-475f-b27e-e3c3d4bf42b8 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:07.680670 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d90db3-6193-4e5b-987e-e43df9f83074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:07.681369 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d90db3-6193-4e5b-987e-e43df9f83074 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:07.681657 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d90db3-6193-4e5b-987e-e43df9f83074 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:07.681938 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d90db3-6193-4e5b-987e-e43df9f83074 admin admin] PATH_INFO: `/v3/users` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:07.682623 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d90db3-6193-4e5b-987e-e43df9f83074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:07.684799 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d90db3-6193-4e5b-987e-e43df9f83074 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:07.703696 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1412/2823] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:22:07 2021] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:22:07.707754 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44ea9d-24b4-46a0-87f8-edef4c0138af admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:07.717569 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44ea9d-24b4-46a0-87f8-edef4c0138af admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:07.722674 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984816b1-0a4c-4b09-a167-825f452835e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:07.723319 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984816b1-0a4c-4b09-a167-825f452835e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:07.723602 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984816b1-0a4c-4b09-a167-825f452835e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:07.723877 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984816b1-0a4c-4b09-a167-825f452835e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:07.724586 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984816b1-0a4c-4b09-a167-825f452835e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:07.726200 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984816b1-0a4c-4b09-a167-825f452835e6 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:07.736848 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1412/2824] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:22:07 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:22:07.740692 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d90db3-6193-4e5b-987e-e43df9f83074 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:07.750277 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d90db3-6193-4e5b-987e-e43df9f83074 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:07.755060 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfea23-a73e-47d1-913a-3f47731b4809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:07.755932 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfea23-a73e-47d1-913a-3f47731b4809 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:07.756210 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfea23-a73e-47d1-913a-3f47731b4809 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:07.756484 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfea23-a73e-47d1-913a-3f47731b4809 admin admin] PATH_INFO: `/v3/projects/eeb4397e58df4f4293058a1fb6e432be/users/2a9a0ec5e62c46a089bb7509b6da524f/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:07.772622 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfea23-a73e-47d1-913a-3f47731b4809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb4397e58df4f4293058a1fb6e432be, user_id=2a9a0ec5e62c46a089bb7509b6da524f, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:07.775318 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfea23-a73e-47d1-913a-3f47731b4809 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:07.788583 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1413/2825] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:22:07 2021] PUT /identity/v3/projects/eeb4397e58df4f4293058a1fb6e432be/users/2a9a0ec5e62c46a089bb7509b6da524f/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:22:07.792537 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984816b1-0a4c-4b09-a167-825f452835e6 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:07.803042 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984816b1-0a4c-4b09-a167-825f452835e6 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:07.855971 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0c00f-f537-437d-887f-395b3d0ed82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:07.856622 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0c00f-f537-437d-887f-395b3d0ed82a admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:07.856925 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0c00f-f537-437d-887f-395b3d0ed82a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:07.857202 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0c00f-f537-437d-887f-395b3d0ed82a admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:07.857912 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0c00f-f537-437d-887f-395b3d0ed82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:07.860096 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0c00f-f537-437d-887f-395b3d0ed82a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:07.869833 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1413/2826] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:22:07 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:22:07.873773 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfea23-a73e-47d1-913a-3f47731b4809 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:07.883859 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfea23-a73e-47d1-913a-3f47731b4809 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:07.888456 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973752a-a2ba-4537-af09-d74752615a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:07.889352 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973752a-a2ba-4537-af09-d74752615a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:07.889662 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973752a-a2ba-4537-af09-d74752615a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:07.889953 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973752a-a2ba-4537-af09-d74752615a0a admin admin] PATH_INFO: `/v3/projects/eeb4397e58df4f4293058a1fb6e432be/users/2a9a0ec5e62c46a089bb7509b6da524f/roles/19308d3515f546e9a04e44ae278cd111` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:07.891867 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6973752a-a2ba-4537-af09-d74752615a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb4397e58df4f4293058a1fb6e432be, user_id=2a9a0ec5e62c46a089bb7509b6da524f, role_id=19308d3515f546e9a04e44ae278cd111)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:07.894525 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6973752a-a2ba-4537-af09-d74752615a0a admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:07.904434 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1414/2827] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:22:07 2021] PUT /identity/v3/projects/eeb4397e58df4f4293058a1fb6e432be/users/2a9a0ec5e62c46a089bb7509b6da524f/roles/19308d3515f546e9a04e44ae278cd111 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:22:07.914756 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47184e-fddf-4e7c-82f7-d3443cfb62be None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:07.915046 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47184e-fddf-4e7c-82f7-d3443cfb62be None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:07.915323 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47184e-fddf-4e7c-82f7-d3443cfb62be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:07.940984 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-3c47184e-fddf-4e7c-82f7-d3443cfb62be None None] MFA Rules not processed for user `2a9a0ec5e62c46a089bb7509b6da524f`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:22:07.942163 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-3c47184e-fddf-4e7c-82f7-d3443cfb62be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:22:08.004615 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1414/2828] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:22:07 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:22:08.014209 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973752a-a2ba-4537-af09-d74752615a0a admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:22:08.015862 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-6973752a-a2ba-4537-af09-d74752615a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:22:08.069721 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973752a-a2ba-4537-af09-d74752615a0a admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:22:08.073283 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986901c-daca-40f7-9853-b82afc97bbee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:22:08.073905 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986901c-daca-40f7-9853-b82afc97bbee service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:22:08.074183 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986901c-daca-40f7-9853-b82afc97bbee service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:22:08.074460 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986901c-daca-40f7-9853-b82afc97bbee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:22:08.126976 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986901c-daca-40f7-9853-b82afc97bbee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:22:08.128324 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986901c-daca-40f7-9853-b82afc97bbee service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:22:08.136828 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1415/2829] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:22:08 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:24:25.075305 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47184e-fddf-4e7c-82f7-d3443cfb62be None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:24:25.076689 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-3c47184e-fddf-4e7c-82f7-d3443cfb62be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:24:25.191883 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47184e-fddf-4e7c-82f7-d3443cfb62be None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:24:25.196972 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78ac2e-6930-438b-9589-8aceac300392 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:24:25.197617 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78ac2e-6930-438b-9589-8aceac300392 service placement] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:24:25.197900 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78ac2e-6930-438b-9589-8aceac300392 service placement] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:24:25.198179 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78ac2e-6930-438b-9589-8aceac300392 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:24:25.199913 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-2c78ac2e-6930-438b-9589-8aceac300392 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:24:25.210722 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78ac2e-6930-438b-9589-8aceac300392 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:24:25.212301 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78ac2e-6930-438b-9589-8aceac300392 service placement] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:24:25.221804 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1415/2830] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:24:25 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:25:43.001128 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986901c-daca-40f7-9853-b82afc97bbee service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:25:43.002541 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-3986901c-daca-40f7-9853-b82afc97bbee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:25:43.024644 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986901c-daca-40f7-9853-b82afc97bbee service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:25:43.028795 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af90c1-2f81-478d-a2fa-4fdb460fb2bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:25:43.029580 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af90c1-2f81-478d-a2fa-4fdb460fb2bd service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:25:43.029865 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af90c1-2f81-478d-a2fa-4fdb460fb2bd service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:25:43.030143 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af90c1-2f81-478d-a2fa-4fdb460fb2bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:25:43.031822 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-b7af90c1-2f81-478d-a2fa-4fdb460fb2bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:25:43.086844 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af90c1-2f81-478d-a2fa-4fdb460fb2bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:25:43.088260 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af90c1-2f81-478d-a2fa-4fdb460fb2bd service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:25:43.097504 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1416/2831] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:25:43 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:26:28.082764 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3669318-445e-4a2e-9377-979bd44338b7 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:26:28.083349 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3669318-445e-4a2e-9377-979bd44338b7 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:26:28.083349 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3669318-445e-4a2e-9377-979bd44338b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:26:28.137345 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-e3669318-445e-4a2e-9377-979bd44338b7 None None] MFA Rules not processed for user `9312539f749645d38ed87a0a47e52aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:26:28.138565 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e3669318-445e-4a2e-9377-979bd44338b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:26:28.156450 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1416/2832] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Sep 15 03:26:28 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:26:28.170618 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036274e-534a-4506-903f-2042c0850813 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:26:28.171094 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036274e-534a-4506-903f-2042c0850813 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:26:28.171198 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036274e-534a-4506-903f-2042c0850813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:26:28.190028 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-4036274e-534a-4506-903f-2042c0850813 None None] MFA Rules not processed for user `9312539f749645d38ed87a0a47e52aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:26:28.191240 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4036274e-534a-4506-903f-2042c0850813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:26:28.199789 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1417/2833] 10.222.0.32 () {58 vars in 1058 bytes} [Wed Sep 15 03:26:28 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:26:28.205935 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3669318-445e-4a2e-9377-979bd44338b7 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:26:28.216000 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3669318-445e-4a2e-9377-979bd44338b7 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:26:28.221188 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6af0d8-cef8-474f-9cd2-f711e825c670 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:26:28.221827 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6af0d8-cef8-474f-9cd2-f711e825c670 service placement] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:26:28.222111 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6af0d8-cef8-474f-9cd2-f711e825c670 service placement] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:26:28.222391 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6af0d8-cef8-474f-9cd2-f711e825c670 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:26:28.230461 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6af0d8-cef8-474f-9cd2-f711e825c670 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:26:28.232528 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6af0d8-cef8-474f-9cd2-f711e825c670 service placement] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:26:28.241932 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1417/2834] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:26:28 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 03:26:30.785682 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036274e-534a-4506-903f-2042c0850813 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:26:30.787023 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-4036274e-534a-4506-903f-2042c0850813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:26:30.848462 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036274e-534a-4506-903f-2042c0850813 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:26:30.852119 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a7f40-e832-42d0-ba75-8daaab06f15c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:26:30.852754 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a7f40-e832-42d0-ba75-8daaab06f15c service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:26:30.853066 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a7f40-e832-42d0-ba75-8daaab06f15c service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:26:30.853347 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a7f40-e832-42d0-ba75-8daaab06f15c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:26:30.855061 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-7f4a7f40-e832-42d0-ba75-8daaab06f15c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:26:30.863995 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a7f40-e832-42d0-ba75-8daaab06f15c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:26:30.865448 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a7f40-e832-42d0-ba75-8daaab06f15c service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:26:30.873653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1418/2835] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:26:30 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:27:07.709591 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8cc28-4d43-4089-a4cc-1b5a7fac2409 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:27:07.710156 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8cc28-4d43-4089-a4cc-1b5a7fac2409 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:27:07.710156 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8cc28-4d43-4089-a4cc-1b5a7fac2409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:27:07.727850 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-aed8cc28-4d43-4089-a4cc-1b5a7fac2409 None None] MFA Rules not processed for user `e0c01428860e44fe9d0b15886add165f`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:27:07.729140 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-aed8cc28-4d43-4089-a4cc-1b5a7fac2409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:27:07.744817 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1418/2836] 10.222.0.32 () {58 vars in 1065 bytes} [Wed Sep 15 03:27:07 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:27:07.751534 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a7f40-e832-42d0-ba75-8daaab06f15c service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:27:07.760296 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a7f40-e832-42d0-ba75-8daaab06f15c service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:27:07.763866 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843e469-aca2-4a51-b470-367f500b748f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:27:07.764494 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843e469-aca2-4a51-b470-367f500b748f service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:27:07.764780 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843e469-aca2-4a51-b470-367f500b748f service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:27:07.765094 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843e469-aca2-4a51-b470-367f500b748f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:27:07.773033 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843e469-aca2-4a51-b470-367f500b748f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:27:07.774439 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843e469-aca2-4a51-b470-367f500b748f service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:27:07.782881 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1419/2837] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:27:07 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 03:27:45.066121 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2029a63-cae8-49de-87bf-9c9565cab14e None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:27:45.066578 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2029a63-cae8-49de-87bf-9c9565cab14e None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:27:45.066578 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2029a63-cae8-49de-87bf-9c9565cab14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:27:45.117088 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-f2029a63-cae8-49de-87bf-9c9565cab14e None None] MFA Rules not processed for user `797b76e6f16d428198e7f7f05c9c0fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:27:45.118591 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-f2029a63-cae8-49de-87bf-9c9565cab14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:27:45.211369 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1419/2838] 10.222.0.32 () {58 vars in 1019 bytes} [Wed Sep 15 03:27:45 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:27:45.224084 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbac8d-37b5-48e7-b941-f738ac0f0e4b None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:27:45.224631 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbac8d-37b5-48e7-b941-f738ac0f0e4b None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:27:45.224631 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbac8d-37b5-48e7-b941-f738ac0f0e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:27:45.243718 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-2edbac8d-37b5-48e7-b941-f738ac0f0e4b None None] MFA Rules not processed for user `797b76e6f16d428198e7f7f05c9c0fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:27:45.245208 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-2edbac8d-37b5-48e7-b941-f738ac0f0e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:27:45.254944 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1420/2839] 10.222.0.32 () {58 vars in 1059 bytes} [Wed Sep 15 03:27:45 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:27:45.261517 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2029a63-cae8-49de-87bf-9c9565cab14e None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:27:45.265756 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbb17c-1ec5-4b96-95c3-9e5a172b92b7 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:27:45.266172 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbb17c-1ec5-4b96-95c3-9e5a172b92b7 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:27:45.266469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbb17c-1ec5-4b96-95c3-9e5a172b92b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:27:45.273566 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2029a63-cae8-49de-87bf-9c9565cab14e None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:27:45.279588 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553240e-934e-4e39-9cc3-952cfc6ee9dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:27:45.280171 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553240e-934e-4e39-9cc3-952cfc6ee9dd service nova] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:27:45.280461 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553240e-934e-4e39-9cc3-952cfc6ee9dd service nova] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:27:45.280735 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553240e-934e-4e39-9cc3-952cfc6ee9dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:27:45.287066 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-0cfbb17c-1ec5-4b96-95c3-9e5a172b92b7 None None] MFA Rules not processed for user `797b76e6f16d428198e7f7f05c9c0fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:27:45.288455 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-0cfbb17c-1ec5-4b96-95c3-9e5a172b92b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:27:45.292550 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553240e-934e-4e39-9cc3-952cfc6ee9dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:27:45.294273 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553240e-934e-4e39-9cc3-952cfc6ee9dd service nova] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:27:45.298276 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1421/2840] 10.222.0.32 () {58 vars in 1059 bytes} [Wed Sep 15 03:27:45 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:27:45.304966 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78acad-59b6-4e5d-837a-a9a52b65eeb7 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:27:45.305324 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78acad-59b6-4e5d-837a-a9a52b65eeb7 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:27:45.305534 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78acad-59b6-4e5d-837a-a9a52b65eeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:27:45.305828 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1420/2841] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:27:45 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:27:45.325004 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-ef78acad-59b6-4e5d-837a-a9a52b65eeb7 None None] MFA Rules not processed for user `797b76e6f16d428198e7f7f05c9c0fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:27:45.326244 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ef78acad-59b6-4e5d-837a-a9a52b65eeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:27:45.336422 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1422/2842] 10.222.0.32 () {58 vars in 1010 bytes} [Wed Sep 15 03:27:45 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:27:45.350189 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8f9ba-9491-4198-902d-d5e9c13ba049 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:27:45.350480 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8f9ba-9491-4198-902d-d5e9c13ba049 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:27:45.350806 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8f9ba-9491-4198-902d-d5e9c13ba049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:27:45.369732 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-41a8f9ba-9491-4198-902d-d5e9c13ba049 None None] MFA Rules not processed for user `91566418241b40ab840e1c3bf9e096c9`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:27:45.370952 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-41a8f9ba-9491-4198-902d-d5e9c13ba049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:27:45.377899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1421/2843] 10.222.0.32 () {58 vars in 1062 bytes} [Wed Sep 15 03:27:45 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:27:45.384035 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78acad-59b6-4e5d-837a-a9a52b65eeb7 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:27:45.390398 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e32c7-e7df-4ee6-a509-b7901dbedd5f None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:27:45.390812 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e32c7-e7df-4ee6-a509-b7901dbedd5f None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:27:45.391197 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e32c7-e7df-4ee6-a509-b7901dbedd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:27:45.394172 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78acad-59b6-4e5d-837a-a9a52b65eeb7 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:27:45.397939 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325d97c-cce7-4f94-9592-e3f7899a8bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:27:45.398682 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325d97c-cce7-4f94-9592-e3f7899a8bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:27:45.399085 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325d97c-cce7-4f94-9592-e3f7899a8bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:27:45.400267 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325d97c-cce7-4f94-9592-e3f7899a8bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:27:45.410789 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325d97c-cce7-4f94-9592-e3f7899a8bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:27:45.411066 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-7b1e32c7-e7df-4ee6-a509-b7901dbedd5f None None] MFA Rules not processed for user `91566418241b40ab840e1c3bf9e096c9`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:27:45.412326 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7b1e32c7-e7df-4ee6-a509-b7901dbedd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:27:45.412446 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325d97c-cce7-4f94-9592-e3f7899a8bd0 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:27:45.420063 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1422/2844] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Sep 15 03:27:45 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:27:45.424622 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1423/2845] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:27:45 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:27:45.433942 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e32c7-e7df-4ee6-a509-b7901dbedd5f None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:27:45.442914 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e32c7-e7df-4ee6-a509-b7901dbedd5f None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:27:45.446848 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede1bef-8931-4a7c-8751-fad836de6fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:27:45.447611 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede1bef-8931-4a7c-8751-fad836de6fca service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:27:45.447990 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede1bef-8931-4a7c-8751-fad836de6fca service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:27:45.448372 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede1bef-8931-4a7c-8751-fad836de6fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:27:45.456486 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede1bef-8931-4a7c-8751-fad836de6fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:27:45.458076 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede1bef-8931-4a7c-8751-fad836de6fca service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:27:45.468522 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1423/2846] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:27:45 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 03:27:46.599027 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28693472-f9e8-4ad7-afee-62b2efd9e25a None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:27:46.599592 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28693472-f9e8-4ad7-afee-62b2efd9e25a None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:27:46.599592 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28693472-f9e8-4ad7-afee-62b2efd9e25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:27:46.618047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-28693472-f9e8-4ad7-afee-62b2efd9e25a None None] MFA Rules not processed for user `797b76e6f16d428198e7f7f05c9c0fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:27:46.619261 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-28693472-f9e8-4ad7-afee-62b2efd9e25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:27:46.629014 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1424/2847] 10.222.0.32 () {58 vars in 1010 bytes} [Wed Sep 15 03:27:46 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:27:46.660129 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede1bef-8931-4a7c-8751-fad836de6fca service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:27:46.668809 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede1bef-8931-4a7c-8751-fad836de6fca service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:27:46.672677 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206c3cb-3711-4c67-9e6e-f3d4c8784570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:27:46.673416 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206c3cb-3711-4c67-9e6e-f3d4c8784570 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:27:46.673939 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206c3cb-3711-4c67-9e6e-f3d4c8784570 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:27:46.674370 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206c3cb-3711-4c67-9e6e-f3d4c8784570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:27:46.694084 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206c3cb-3711-4c67-9e6e-f3d4c8784570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:27:46.696590 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206c3cb-3711-4c67-9e6e-f3d4c8784570 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:27:46.701529 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28693472-f9e8-4ad7-afee-62b2efd9e25a None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:27:46.713059 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28693472-f9e8-4ad7-afee-62b2efd9e25a None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:27:46.714742 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1424/2848] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:27:46 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:27:46.719644 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b9206-9601-4ff8-9204-a0f84865f652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '797b76e6f16d428198e7f7f05c9c0fd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:27:46.720464 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b9206-9601-4ff8-9204-a0f84865f652 service nova] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:27:46.721359 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b9206-9601-4ff8-9204-a0f84865f652 service nova] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:27:46.721563 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b9206-9601-4ff8-9204-a0f84865f652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:27:46.723539 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-613b9206-9601-4ff8-9204-a0f84865f652 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:27:46.736329 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b9206-9601-4ff8-9204-a0f84865f652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:27:46.738172 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b9206-9601-4ff8-9204-a0f84865f652 service nova] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:27:46.750408 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1425/2849] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:27:46 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 03:28:08.770123 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206c3cb-3711-4c67-9e6e-f3d4c8784570 service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:28:08.846685 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206c3cb-3711-4c67-9e6e-f3d4c8784570 service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:28:08.851191 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bef7a6-9d40-4e7a-8b50-07208d375c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:28:08.852037 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bef7a6-9d40-4e7a-8b50-07208d375c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:28:08.852342 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bef7a6-9d40-4e7a-8b50-07208d375c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:28:08.852612 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bef7a6-9d40-4e7a-8b50-07208d375c95 admin admin] PATH_INFO: `/v3/users/2c82a40028f5433380ad9c55300fab48` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:28:08.853814 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bef7a6-9d40-4e7a-8b50-07208d375c95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c82a40028f5433380ad9c55300fab48)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:28:08.855687 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bef7a6-9d40-4e7a-8b50-07208d375c95 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:28:08.899957 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-b7bef7a6-9d40-4e7a-8b50-07208d375c95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c82a40028f5433380ad9c55300fab48'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:28:08.900602 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-b7bef7a6-9d40-4e7a-8b50-07208d375c95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c82a40028f5433380ad9c55300fab48'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:28:08.907390 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-b7bef7a6-9d40-4e7a-8b50-07208d375c95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c82a40028f5433380ad9c55300fab48'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:28:08.908573 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-b7bef7a6-9d40-4e7a-8b50-07208d375c95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c82a40028f5433380ad9c55300fab48'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:28:08.919762 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-b7bef7a6-9d40-4e7a-8b50-07208d375c95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c82a40028f5433380ad9c55300fab48'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:28:08.931993 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1425/2850] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:28:08 2021] DELETE /identity/v3/users/2c82a40028f5433380ad9c55300fab48 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:28:08.936792 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518500ab-5bb4-49b5-b2a3-384cb96a784a None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:28:08.937309 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518500ab-5bb4-49b5-b2a3-384cb96a784a None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:28:08.937410 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518500ab-5bb4-49b5-b2a3-384cb96a784a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:28:08.974104 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-518500ab-5bb4-49b5-b2a3-384cb96a784a None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:28:08.975284 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-518500ab-5bb4-49b5-b2a3-384cb96a784a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:28:09.029261 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1426/2851] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:28:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:28:09.039462 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bef7a6-9d40-4e7a-8b50-07208d375c95 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:28:09.040855 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-b7bef7a6-9d40-4e7a-8b50-07208d375c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:28:09.096728 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bef7a6-9d40-4e7a-8b50-07208d375c95 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:28:09.100449 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed07696-5526-4f61-bc9f-419d8eff5d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:28:09.101113 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed07696-5526-4f61-bc9f-419d8eff5d02 service neutron] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:28:09.101399 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed07696-5526-4f61-bc9f-419d8eff5d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:28:09.101675 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed07696-5526-4f61-bc9f-419d8eff5d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:28:09.110601 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed07696-5526-4f61-bc9f-419d8eff5d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:28:09.112026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed07696-5526-4f61-bc9f-419d8eff5d02 service neutron] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:28:09.121337 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1426/2852] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:28:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 03:28:09.396849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518500ab-5bb4-49b5-b2a3-384cb96a784a None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:28:09.398527 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-518500ab-5bb4-49b5-b2a3-384cb96a784a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:28:09.416053 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518500ab-5bb4-49b5-b2a3-384cb96a784a None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:28:09.420862 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49393d32-fc69-4b3f-82c5-d4526a708a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:28:09.421747 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49393d32-fc69-4b3f-82c5-d4526a708a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:28:09.422043 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49393d32-fc69-4b3f-82c5-d4526a708a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:28:09.422385 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49393d32-fc69-4b3f-82c5-d4526a708a65 admin admin] PATH_INFO: `/v3/projects/73ad025c127e4fe3af35efcdf32bed1b` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:28:09.423575 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49393d32-fc69-4b3f-82c5-d4526a708a65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ad025c127e4fe3af35efcdf32bed1b)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:28:09.425532 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49393d32-fc69-4b3f-82c5-d4526a708a65 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:28:09.468891 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-49393d32-fc69-4b3f-82c5-d4526a708a65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ad025c127e4fe3af35efcdf32bed1b', 'request_id': 'req-49393d32-fc69-4b3f-82c5-d4526a708a65'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:28:09.475519 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-49393d32-fc69-4b3f-82c5-d4526a708a65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ad025c127e4fe3af35efcdf32bed1b', 'request_id': 'req-49393d32-fc69-4b3f-82c5-d4526a708a65'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:28:09.482755 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-49393d32-fc69-4b3f-82c5-d4526a708a65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ad025c127e4fe3af35efcdf32bed1b', 'request_id': 'req-49393d32-fc69-4b3f-82c5-d4526a708a65'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:28:09.492470 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-49393d32-fc69-4b3f-82c5-d4526a708a65 admin admin] The token cache is being invalidate because project 73ad025c127e4fe3af35efcdf32bed1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:28:09.492752 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-49393d32-fc69-4b3f-82c5-d4526a708a65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:28:09.493396 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-49393d32-fc69-4b3f-82c5-d4526a708a65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:28:09.494920 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1427/2853] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:28:09 2021] DELETE /identity/v3/projects/73ad025c127e4fe3af35efcdf32bed1b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:28:09.498902 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed07696-5526-4f61-bc9f-419d8eff5d02 service neutron] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:28:09.509306 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed07696-5526-4f61-bc9f-419d8eff5d02 service neutron] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:28:09.566582 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6bff3-bbfc-41bf-8163-5e64c5442143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:28:09.567359 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6bff3-bbfc-41bf-8163-5e64c5442143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:28:09.567661 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6bff3-bbfc-41bf-8163-5e64c5442143 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:28:09.567920 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6bff3-bbfc-41bf-8163-5e64c5442143 admin admin] PATH_INFO: `/v3/users/2a9a0ec5e62c46a089bb7509b6da524f` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:28:09.569134 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6bff3-bbfc-41bf-8163-5e64c5442143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a9a0ec5e62c46a089bb7509b6da524f)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:28:09.571038 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6bff3-bbfc-41bf-8163-5e64c5442143 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:28:09.615909 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-16a6bff3-bbfc-41bf-8163-5e64c5442143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a9a0ec5e62c46a089bb7509b6da524f'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:28:09.616576 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-16a6bff3-bbfc-41bf-8163-5e64c5442143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a9a0ec5e62c46a089bb7509b6da524f'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:28:09.623809 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-16a6bff3-bbfc-41bf-8163-5e64c5442143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a9a0ec5e62c46a089bb7509b6da524f'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:28:09.624417 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-16a6bff3-bbfc-41bf-8163-5e64c5442143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a9a0ec5e62c46a089bb7509b6da524f'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:28:09.636476 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-16a6bff3-bbfc-41bf-8163-5e64c5442143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a9a0ec5e62c46a089bb7509b6da524f'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:28:09.648685 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1427/2854] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:28:09 2021] DELETE /identity/v3/users/2a9a0ec5e62c46a089bb7509b6da524f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:28:09.937438 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49393d32-fc69-4b3f-82c5-d4526a708a65 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:28:09.939888 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-49393d32-fc69-4b3f-82c5-d4526a708a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:28:09.952913 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49393d32-fc69-4b3f-82c5-d4526a708a65 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:28:10.006232 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f98033f-4d20-4df8-a3ae-b5eff37ec652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:28:10.007084 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98033f-4d20-4df8-a3ae-b5eff37ec652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:28:10.007360 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98033f-4d20-4df8-a3ae-b5eff37ec652 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:28:10.007628 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f98033f-4d20-4df8-a3ae-b5eff37ec652 admin admin] PATH_INFO: `/v3/projects/eeb4397e58df4f4293058a1fb6e432be` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:28:10.008790 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f98033f-4d20-4df8-a3ae-b5eff37ec652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb4397e58df4f4293058a1fb6e432be)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:28:10.010752 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f98033f-4d20-4df8-a3ae-b5eff37ec652 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:28:10.053703 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2f98033f-4d20-4df8-a3ae-b5eff37ec652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb4397e58df4f4293058a1fb6e432be', 'request_id': 'req-2f98033f-4d20-4df8-a3ae-b5eff37ec652'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:28:10.059515 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2f98033f-4d20-4df8-a3ae-b5eff37ec652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb4397e58df4f4293058a1fb6e432be', 'request_id': 'req-2f98033f-4d20-4df8-a3ae-b5eff37ec652'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:28:10.066935 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2f98033f-4d20-4df8-a3ae-b5eff37ec652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb4397e58df4f4293058a1fb6e432be', 'request_id': 'req-2f98033f-4d20-4df8-a3ae-b5eff37ec652'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:28:10.076653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2f98033f-4d20-4df8-a3ae-b5eff37ec652 admin admin] The token cache is being invalidate because project eeb4397e58df4f4293058a1fb6e432be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:28:10.076966 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2f98033f-4d20-4df8-a3ae-b5eff37ec652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:28:10.077582 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-2f98033f-4d20-4df8-a3ae-b5eff37ec652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:28:10.079047 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1428/2855] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:28:09 2021] DELETE /identity/v3/projects/eeb4397e58df4f4293058a1fb6e432be => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:28:10.086699 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52378460-40e3-4890-9725-672b159e1b17 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:28:10.087197 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52378460-40e3-4890-9725-672b159e1b17 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:28:10.087327 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52378460-40e3-4890-9725-672b159e1b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:28:10.123006 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-52378460-40e3-4890-9725-672b159e1b17 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:28:10.124133 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-52378460-40e3-4890-9725-672b159e1b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:28:10.178529 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1428/2856] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:28:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:28:10.186579 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15acd22-9567-4dd9-a7b1-2b8b3d355696 None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:28:10.186890 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15acd22-9567-4dd9-a7b1-2b8b3d355696 None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:28:10.187174 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15acd22-9567-4dd9-a7b1-2b8b3d355696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:28:10.205912 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-c15acd22-9567-4dd9-a7b1-2b8b3d355696 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:28:10.207381 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-c15acd22-9567-4dd9-a7b1-2b8b3d355696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:28:10.215337 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1429/2857] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:28:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:28:10.219543 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52378460-40e3-4890-9725-672b159e1b17 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:28:10.229656 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52378460-40e3-4890-9725-672b159e1b17 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:28:10.234255 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfa4eb-3cb1-4c71-bbdd-1c696e036524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:28:10.234900 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfa4eb-3cb1-4c71-bbdd-1c696e036524 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:28:10.235183 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfa4eb-3cb1-4c71-bbdd-1c696e036524 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:28:10.235457 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfa4eb-3cb1-4c71-bbdd-1c696e036524 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:28:10.236202 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bfa4eb-3cb1-4c71-bbdd-1c696e036524 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 03:28:10.236508 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bfa4eb-3cb1-4c71-bbdd-1c696e036524 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:28:10.238116 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bfa4eb-3cb1-4c71-bbdd-1c696e036524 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:28:10.249425 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1429/2858] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 03:28:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 03:28:10.253860 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15acd22-9567-4dd9-a7b1-2b8b3d355696 None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:28:10.262847 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15acd22-9567-4dd9-a7b1-2b8b3d355696 None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:28:10.268096 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097ea52-25d7-44ee-9e86-0e9b76957129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:28:10.268738 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097ea52-25d7-44ee-9e86-0e9b76957129 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:28:10.269114 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097ea52-25d7-44ee-9e86-0e9b76957129 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:28:10.269397 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097ea52-25d7-44ee-9e86-0e9b76957129 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:28:10.270093 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097ea52-25d7-44ee-9e86-0e9b76957129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:28:10.271991 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097ea52-25d7-44ee-9e86-0e9b76957129 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:28:10.305333 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1430/2859] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:28:10 2021] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:28:10.309356 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfa4eb-3cb1-4c71-bbdd-1c696e036524 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:28:10.320147 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfa4eb-3cb1-4c71-bbdd-1c696e036524 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:28:10.372649 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f407d-9fe5-49d5-bd16-2c99423cde7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:28:10.373392 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f407d-9fe5-49d5-bd16-2c99423cde7c admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:28:10.373624 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f407d-9fe5-49d5-bd16-2c99423cde7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:28:10.373901 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f407d-9fe5-49d5-bd16-2c99423cde7c admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:28:10.374593 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f407d-9fe5-49d5-bd16-2c99423cde7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:28:10.376967 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f407d-9fe5-49d5-bd16-2c99423cde7c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:28:10.396346 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1430/2860] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:28:10 2021] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:28:10.400334 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097ea52-25d7-44ee-9e86-0e9b76957129 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:28:10.410634 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097ea52-25d7-44ee-9e86-0e9b76957129 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:28:10.415261 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfd9a6-cef4-4f52-8d44-ed5c3e8baaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:28:10.415914 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfd9a6-cef4-4f52-8d44-ed5c3e8baaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:28:10.416200 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfd9a6-cef4-4f52-8d44-ed5c3e8baaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:28:10.416478 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfd9a6-cef4-4f52-8d44-ed5c3e8baaa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:28:10.417238 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfd9a6-cef4-4f52-8d44-ed5c3e8baaa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:28:10.418831 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfd9a6-cef4-4f52-8d44-ed5c3e8baaa8 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:28:10.428563 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1431/2861] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:28:10 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:28:10.432450 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f407d-9fe5-49d5-bd16-2c99423cde7c admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:28:10.442738 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f407d-9fe5-49d5-bd16-2c99423cde7c admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:28:10.447436 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27cc5b-ef75-4935-9b58-db26d6111baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:28:10.448085 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27cc5b-ef75-4935-9b58-db26d6111baf admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:28:10.448368 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27cc5b-ef75-4935-9b58-db26d6111baf admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:28:10.448643 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27cc5b-ef75-4935-9b58-db26d6111baf admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:28:10.449413 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27cc5b-ef75-4935-9b58-db26d6111baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:28:10.450975 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27cc5b-ef75-4935-9b58-db26d6111baf admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:28:10.461199 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1431/2862] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:28:10 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:28:10.464901 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfd9a6-cef4-4f52-8d44-ed5c3e8baaa8 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:28:10.474591 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfd9a6-cef4-4f52-8d44-ed5c3e8baaa8 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:28:10.479746 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293b914-da52-4c7b-9d6e-ca4ce79601a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:28:10.480116 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293b914-da52-4c7b-9d6e-ca4ce79601a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:28:10.480399 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293b914-da52-4c7b-9d6e-ca4ce79601a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:28:10.480677 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293b914-da52-4c7b-9d6e-ca4ce79601a4 admin admin] PATH_INFO: `/v3/projects/9fec6d7eae514ca384b692eeb4a1aa76/users/2353d9774c7d4246b129ea46044e0ac9/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:28:10.495154 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293b914-da52-4c7b-9d6e-ca4ce79601a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fec6d7eae514ca384b692eeb4a1aa76, user_id=2353d9774c7d4246b129ea46044e0ac9, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:28:10.497849 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293b914-da52-4c7b-9d6e-ca4ce79601a4 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:28:10.511245 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1432/2863] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:28:10 2021] PUT /identity/v3/projects/9fec6d7eae514ca384b692eeb4a1aa76/users/2353d9774c7d4246b129ea46044e0ac9/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:28:10.516299 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852e456-2862-4116-8395-f57b56631ef1 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:28:10.516596 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852e456-2862-4116-8395-f57b56631ef1 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:28:10.516892 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852e456-2862-4116-8395-f57b56631ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:28:10.534531 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-7852e456-2862-4116-8395-f57b56631ef1 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:28:10.535718 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-7852e456-2862-4116-8395-f57b56631ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:28:10.591516 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1432/2864] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:28:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:28:10.601183 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293b914-da52-4c7b-9d6e-ca4ce79601a4 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:28:10.602843 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-6293b914-da52-4c7b-9d6e-ca4ce79601a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:28:10.656544 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293b914-da52-4c7b-9d6e-ca4ce79601a4 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:28:10.660169 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fbf95-793e-480d-b9bd-c1f7e87aa1d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:28:10.660811 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fbf95-793e-480d-b9bd-c1f7e87aa1d1 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:28:10.661123 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fbf95-793e-480d-b9bd-c1f7e87aa1d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:28:10.661397 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fbf95-793e-480d-b9bd-c1f7e87aa1d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:28:10.670076 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fbf95-793e-480d-b9bd-c1f7e87aa1d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:28:10.671504 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610fbf95-793e-480d-b9bd-c1f7e87aa1d1 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:28:10.682060 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1433/2865] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:28:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:28:11.265038 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80726f2-48ba-4fb1-be78-4068f1ecf756 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:28:11.265599 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80726f2-48ba-4fb1-be78-4068f1ecf756 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:28:11.265599 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80726f2-48ba-4fb1-be78-4068f1ecf756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:28:11.291362 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-a80726f2-48ba-4fb1-be78-4068f1ecf756 None None] MFA Rules not processed for user `2353d9774c7d4246b129ea46044e0ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:28:11.292563 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a80726f2-48ba-4fb1-be78-4068f1ecf756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:28:11.355463 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1433/2866] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:28:11 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:28:11.367058 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fbf95-793e-480d-b9bd-c1f7e87aa1d1 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:28:11.368579 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-610fbf95-793e-480d-b9bd-c1f7e87aa1d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:28:11.422184 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fbf95-793e-480d-b9bd-c1f7e87aa1d1 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:28:11.426315 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0a3ef-0968-4b80-b771-f5710402e49a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:28:11.426935 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0a3ef-0968-4b80-b771-f5710402e49a service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:28:11.427216 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0a3ef-0968-4b80-b771-f5710402e49a service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:28:11.427487 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0a3ef-0968-4b80-b771-f5710402e49a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:28:11.435606 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0a3ef-0968-4b80-b771-f5710402e49a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:28:11.437323 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0a3ef-0968-4b80-b771-f5710402e49a service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:28:11.446530 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1434/2867] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:28:11 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:30:44.284494 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80726f2-48ba-4fb1-be78-4068f1ecf756 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:30:44.285831 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a80726f2-48ba-4fb1-be78-4068f1ecf756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:30:44.297214 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80726f2-48ba-4fb1-be78-4068f1ecf756 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:30:44.300723 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb24a4-9564-440e-b696-2c5e1aa2a57e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:30:44.301382 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb24a4-9564-440e-b696-2c5e1aa2a57e service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:30:44.301661 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb24a4-9564-440e-b696-2c5e1aa2a57e service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:30:44.301954 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb24a4-9564-440e-b696-2c5e1aa2a57e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:30:44.303620 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-accb24a4-9564-440e-b696-2c5e1aa2a57e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:30:44.377519 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb24a4-9564-440e-b696-2c5e1aa2a57e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:30:44.378959 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb24a4-9564-440e-b696-2c5e1aa2a57e service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:30:44.396498 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1434/2868] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:30:44 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:31:37.047716 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0a3ef-0968-4b80-b771-f5710402e49a service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:31:37.049135 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-09a0a3ef-0968-4b80-b771-f5710402e49a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:31:37.115052 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0a3ef-0968-4b80-b771-f5710402e49a service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:31:37.120107 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1c32e-893a-4f9f-8fe9-9b81d5e7684e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:31:37.120756 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1c32e-893a-4f9f-8fe9-9b81d5e7684e service placement] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:31:37.121076 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1c32e-893a-4f9f-8fe9-9b81d5e7684e service placement] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:31:37.121360 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1c32e-893a-4f9f-8fe9-9b81d5e7684e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:31:37.123092 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-59d1c32e-893a-4f9f-8fe9-9b81d5e7684e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:31:37.133907 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1c32e-893a-4f9f-8fe9-9b81d5e7684e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:31:37.135496 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1c32e-893a-4f9f-8fe9-9b81d5e7684e service placement] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:31:37.145398 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1435/2869] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:31:37 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:33:10.057604 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb24a4-9564-440e-b696-2c5e1aa2a57e service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:33:10.067408 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb24a4-9564-440e-b696-2c5e1aa2a57e service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:33:10.071113 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49f5f1-cf1d-4f4f-bfa6-44063a4682d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:33:10.071752 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49f5f1-cf1d-4f4f-bfa6-44063a4682d3 service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:33:10.072032 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49f5f1-cf1d-4f4f-bfa6-44063a4682d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:33:10.072304 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49f5f1-cf1d-4f4f-bfa6-44063a4682d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:33:10.080432 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49f5f1-cf1d-4f4f-bfa6-44063a4682d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:33:10.081871 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49f5f1-cf1d-4f4f-bfa6-44063a4682d3 service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:33:10.090362 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1435/2870] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:33:10 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:34:11.101106 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1c32e-893a-4f9f-8fe9-9b81d5e7684e service placement] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:34:11.102538 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-59d1c32e-893a-4f9f-8fe9-9b81d5e7684e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:34:11.125536 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1c32e-893a-4f9f-8fe9-9b81d5e7684e service placement] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:34:11.129205 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fb833-d3e4-4082-89a3-3e50789eaa71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:34:11.129837 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fb833-d3e4-4082-89a3-3e50789eaa71 service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:34:11.130118 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fb833-d3e4-4082-89a3-3e50789eaa71 service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:34:11.130396 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fb833-d3e4-4082-89a3-3e50789eaa71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:34:11.139108 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fb833-d3e4-4082-89a3-3e50789eaa71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:34:11.140523 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fb833-d3e4-4082-89a3-3e50789eaa71 service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:34:11.149705 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1436/2871] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:34:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:34:11.850479 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49f5f1-cf1d-4f4f-bfa6-44063a4682d3 service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:34:11.860969 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49f5f1-cf1d-4f4f-bfa6-44063a4682d3 service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:34:11.865645 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d54055-6b76-464d-93b0-43677afdaf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:34:11.866397 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d54055-6b76-464d-93b0-43677afdaf28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:34:11.866976 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d54055-6b76-464d-93b0-43677afdaf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:34:11.867267 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d54055-6b76-464d-93b0-43677afdaf28 admin admin] PATH_INFO: `/v3/users/2353d9774c7d4246b129ea46044e0ac9` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:34:11.868456 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d54055-6b76-464d-93b0-43677afdaf28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2353d9774c7d4246b129ea46044e0ac9)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:34:11.870370 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d54055-6b76-464d-93b0-43677afdaf28 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:34:11.914854 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-12d54055-6b76-464d-93b0-43677afdaf28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2353d9774c7d4246b129ea46044e0ac9'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:34:11.915506 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-12d54055-6b76-464d-93b0-43677afdaf28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2353d9774c7d4246b129ea46044e0ac9'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:34:11.922255 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-12d54055-6b76-464d-93b0-43677afdaf28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2353d9774c7d4246b129ea46044e0ac9'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:34:11.922927 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-12d54055-6b76-464d-93b0-43677afdaf28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2353d9774c7d4246b129ea46044e0ac9'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:34:11.934062 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-12d54055-6b76-464d-93b0-43677afdaf28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2353d9774c7d4246b129ea46044e0ac9'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:34:11.946269 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1436/2872] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:34:11 2021] DELETE /identity/v3/users/2353d9774c7d4246b129ea46044e0ac9 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:34:12.107487 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fb833-d3e4-4082-89a3-3e50789eaa71 service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:34:12.117977 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fb833-d3e4-4082-89a3-3e50789eaa71 service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:34:12.176835 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ac810-261a-4c4e-b7c1-0b3a0df042df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:34:12.177723 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ac810-261a-4c4e-b7c1-0b3a0df042df admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:34:12.178007 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ac810-261a-4c4e-b7c1-0b3a0df042df admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:34:12.178284 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ac810-261a-4c4e-b7c1-0b3a0df042df admin admin] PATH_INFO: `/v3/projects/9fec6d7eae514ca384b692eeb4a1aa76` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:34:12.179457 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ac810-261a-4c4e-b7c1-0b3a0df042df admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fec6d7eae514ca384b692eeb4a1aa76)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:34:12.181381 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ac810-261a-4c4e-b7c1-0b3a0df042df admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:34:12.225784 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-166ac810-261a-4c4e-b7c1-0b3a0df042df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fec6d7eae514ca384b692eeb4a1aa76', 'request_id': 'req-166ac810-261a-4c4e-b7c1-0b3a0df042df'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:34:12.231415 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-166ac810-261a-4c4e-b7c1-0b3a0df042df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fec6d7eae514ca384b692eeb4a1aa76', 'request_id': 'req-166ac810-261a-4c4e-b7c1-0b3a0df042df'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:34:12.238822 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-166ac810-261a-4c4e-b7c1-0b3a0df042df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fec6d7eae514ca384b692eeb4a1aa76', 'request_id': 'req-166ac810-261a-4c4e-b7c1-0b3a0df042df'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:34:12.248709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-166ac810-261a-4c4e-b7c1-0b3a0df042df admin admin] The token cache is being invalidate because project 9fec6d7eae514ca384b692eeb4a1aa76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:34:12.249092 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-166ac810-261a-4c4e-b7c1-0b3a0df042df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:34:12.249707 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-166ac810-261a-4c4e-b7c1-0b3a0df042df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:34:12.251771 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1437/2873] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:34:12 2021] DELETE /identity/v3/projects/9fec6d7eae514ca384b692eeb4a1aa76 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:34:12.259090 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a42f1-d976-4d81-996a-55ad38ddaf8b None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:34:12.259496 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a42f1-d976-4d81-996a-55ad38ddaf8b None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:34:12.259790 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a42f1-d976-4d81-996a-55ad38ddaf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:34:12.277392 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-e78a42f1-d976-4d81-996a-55ad38ddaf8b None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:34:12.278576 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e78a42f1-d976-4d81-996a-55ad38ddaf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:34:12.335387 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1437/2874] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:34:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 03:34:12.343391 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea75901-5444-496d-8c38-f50d1abd379b None None] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:34:12.343672 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea75901-5444-496d-8c38-f50d1abd379b None None] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:34:12.343945 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea75901-5444-496d-8c38-f50d1abd379b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:34:12.361916 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.auth.core [None req-fea75901-5444-496d-8c38-f50d1abd379b None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:34:12.363045 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-fea75901-5444-496d-8c38-f50d1abd379b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:34:12.370747 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1438/2875] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:34:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:34:12.374923 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a42f1-d976-4d81-996a-55ad38ddaf8b None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:34:12.385494 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a42f1-d976-4d81-996a-55ad38ddaf8b None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:34:12.390376 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b42a2-824d-49ca-a570-1a177b5d1c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:34:12.391026 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b42a2-824d-49ca-a570-1a177b5d1c40 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:34:12.391406 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b42a2-824d-49ca-a570-1a177b5d1c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:34:12.391688 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b42a2-824d-49ca-a570-1a177b5d1c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:34:12.392408 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b42a2-824d-49ca-a570-1a177b5d1c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73403) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 03:34:12.392719 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b42a2-824d-49ca-a570-1a177b5d1c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:34:12.394335 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b42a2-824d-49ca-a570-1a177b5d1c40 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:34:12.405914 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1438/2876] 10.222.0.32 () {58 vars in 1153 bytes} [Wed Sep 15 03:34:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 03:34:12.410300 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea75901-5444-496d-8c38-f50d1abd379b None None] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:34:12.419659 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea75901-5444-496d-8c38-f50d1abd379b None None] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:34:12.425055 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb362e-3977-4fc9-8464-b894135f3f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:34:12.425735 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb362e-3977-4fc9-8464-b894135f3f21 admin admin] REQUEST_METHOD: `POST` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:34:12.426019 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb362e-3977-4fc9-8464-b894135f3f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:34:12.426292 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb362e-3977-4fc9-8464-b894135f3f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:34:12.426976 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb362e-3977-4fc9-8464-b894135f3f21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:34:12.428866 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb362e-3977-4fc9-8464-b894135f3f21 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:34:12.459698 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1439/2877] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Sep 15 03:34:12 2021] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 03:34:12.460899 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b42a2-824d-49ca-a570-1a177b5d1c40 admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:34:12.471295 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b42a2-824d-49ca-a570-1a177b5d1c40 admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:34:12.524898 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda33793-4891-4109-a714-390732a69c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:34:12.525587 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda33793-4891-4109-a714-390732a69c0b admin admin] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:34:12.525871 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda33793-4891-4109-a714-390732a69c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:34:12.526148 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda33793-4891-4109-a714-390732a69c0b admin admin] PATH_INFO: `/v3/users` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:34:12.526822 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda33793-4891-4109-a714-390732a69c0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:34:12.528723 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda33793-4891-4109-a714-390732a69c0b admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:34:12.548507 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1439/2878] 10.222.0.32 () {60 vars in 1144 bytes} [Wed Sep 15 03:34:12 2021] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 03:34:12.552684 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb362e-3977-4fc9-8464-b894135f3f21 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:34:12.563398 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb362e-3977-4fc9-8464-b894135f3f21 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:34:12.568486 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc211be-0a15-4935-b635-60c62327a252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:34:12.569367 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc211be-0a15-4935-b635-60c62327a252 admin admin] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:34:12.569653 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc211be-0a15-4935-b635-60c62327a252 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:34:12.569928 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc211be-0a15-4935-b635-60c62327a252 admin admin] PATH_INFO: `/v3/roles` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:34:12.570695 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc211be-0a15-4935-b635-60c62327a252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:34:12.572321 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc211be-0a15-4935-b635-60c62327a252 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:34:12.582796 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1440/2879] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:34:12 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 03:34:12.586732 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda33793-4891-4109-a714-390732a69c0b admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:34:12.597399 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda33793-4891-4109-a714-390732a69c0b admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:34:12.602096 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1dc002-2388-47f9-8ac8-21d393203157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:34:12.602775 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dc002-2388-47f9-8ac8-21d393203157 admin admin] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:34:12.603056 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dc002-2388-47f9-8ac8-21d393203157 admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:34:12.603329 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dc002-2388-47f9-8ac8-21d393203157 admin admin] PATH_INFO: `/v3/roles` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:34:12.604044 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1dc002-2388-47f9-8ac8-21d393203157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:34:12.605658 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1dc002-2388-47f9-8ac8-21d393203157 admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:34:12.615904 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1440/2880] 10.222.0.32 () {58 vars in 1122 bytes} [Wed Sep 15 03:34:12 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 03:34:12.619624 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc211be-0a15-4935-b635-60c62327a252 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:34:12.629966 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc211be-0a15-4935-b635-60c62327a252 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:34:12.634645 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7206a-b0b2-40ff-812d-659fb691260f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:34:12.635513 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7206a-b0b2-40ff-812d-659fb691260f admin admin] REQUEST_METHOD: `PUT` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:34:12.635796 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7206a-b0b2-40ff-812d-659fb691260f admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:34:12.636072 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7206a-b0b2-40ff-812d-659fb691260f admin admin] PATH_INFO: `/v3/projects/7a16136f06da46aa9a12050c132aebf0/users/6813d39c25864e33be7080075726e789/roles/6f4a40def5d74f0a95ae44fd686a92e5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:34:12.649882 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7206a-b0b2-40ff-812d-659fb691260f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a16136f06da46aa9a12050c132aebf0, user_id=6813d39c25864e33be7080075726e789, role_id=6f4a40def5d74f0a95ae44fd686a92e5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:34:12.652522 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7206a-b0b2-40ff-812d-659fb691260f admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:34:12.665873 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1441/2881] 10.222.0.32 () {60 vars in 1483 bytes} [Wed Sep 15 03:34:12 2021] PUT /identity/v3/projects/7a16136f06da46aa9a12050c132aebf0/users/6813d39c25864e33be7080075726e789/roles/6f4a40def5d74f0a95ae44fd686a92e5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:34:12.677000 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7380718-46f9-448d-b269-c8a8240f93cb None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:34:12.677290 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7380718-46f9-448d-b269-c8a8240f93cb None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:34:12.677568 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7380718-46f9-448d-b269-c8a8240f93cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:34:12.702856 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-e7380718-46f9-448d-b269-c8a8240f93cb None None] MFA Rules not processed for user `6813d39c25864e33be7080075726e789`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:34:12.704046 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e7380718-46f9-448d-b269-c8a8240f93cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:34:12.764208 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1441/2882] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:34:12 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:34:12.774929 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7206a-b0b2-40ff-812d-659fb691260f admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:34:12.776574 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f5a7206a-b0b2-40ff-812d-659fb691260f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:34:12.831651 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7206a-b0b2-40ff-812d-659fb691260f admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:34:12.835268 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39925e-74d4-411e-9bf5-d7183a03bf63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:34:12.835899 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39925e-74d4-411e-9bf5-d7183a03bf63 service cinder] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:34:12.836179 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39925e-74d4-411e-9bf5-d7183a03bf63 service cinder] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:34:12.836453 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39925e-74d4-411e-9bf5-d7183a03bf63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:34:12.845035 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39925e-74d4-411e-9bf5-d7183a03bf63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:34:12.846442 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39925e-74d4-411e-9bf5-d7183a03bf63 service cinder] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:34:12.854884 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1442/2883] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:34:12 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:35:45.330388 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7380718-46f9-448d-b269-c8a8240f93cb None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:35:45.340116 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7380718-46f9-448d-b269-c8a8240f93cb None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:35:45.343715 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65172b4-dd65-4032-b6a1-1b1b3096a37c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:35:45.344341 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65172b4-dd65-4032-b6a1-1b1b3096a37c service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:35:45.344621 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65172b4-dd65-4032-b6a1-1b1b3096a37c service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:35:45.344916 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65172b4-dd65-4032-b6a1-1b1b3096a37c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:35:45.346636 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a65172b4-dd65-4032-b6a1-1b1b3096a37c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:35:45.414181 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65172b4-dd65-4032-b6a1-1b1b3096a37c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:35:45.415587 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65172b4-dd65-4032-b6a1-1b1b3096a37c service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:35:45.424059 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1442/2884] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:35:45 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:35:50.061385 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39925e-74d4-411e-9bf5-d7183a03bf63 service cinder] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:35:50.062843 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-6f39925e-74d4-411e-9bf5-d7183a03bf63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:35:50.125850 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39925e-74d4-411e-9bf5-d7183a03bf63 service cinder] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:35:50.130119 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8205aa9-c27c-42b2-8d7f-e06ba8fa44ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:35:50.130773 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8205aa9-c27c-42b2-8d7f-e06ba8fa44ff service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:35:50.131068 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8205aa9-c27c-42b2-8d7f-e06ba8fa44ff service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:35:50.131334 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8205aa9-c27c-42b2-8d7f-e06ba8fa44ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:35:50.133571 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-f8205aa9-c27c-42b2-8d7f-e06ba8fa44ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:35:50.197713 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8205aa9-c27c-42b2-8d7f-e06ba8fa44ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:35:50.199134 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8205aa9-c27c-42b2-8d7f-e06ba8fa44ff service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:35:50.208411 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1443/2885] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:35:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 03:35:56.147699 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65172b4-dd65-4032-b6a1-1b1b3096a37c service cinder] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:35:56.149331 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-a65172b4-dd65-4032-b6a1-1b1b3096a37c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:35:56.163715 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65172b4-dd65-4032-b6a1-1b1b3096a37c service cinder] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:35:56.168292 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470cabd-05b5-4f74-9cba-7c69958151ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:35:56.169255 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470cabd-05b5-4f74-9cba-7c69958151ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:35:56.169534 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470cabd-05b5-4f74-9cba-7c69958151ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:35:56.169800 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470cabd-05b5-4f74-9cba-7c69958151ef admin admin] PATH_INFO: `/v3/users/5d7b99228e1740c4bfdbecc51137864d` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:35:56.171099 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470cabd-05b5-4f74-9cba-7c69958151ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d7b99228e1740c4bfdbecc51137864d)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:35:56.173005 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470cabd-05b5-4f74-9cba-7c69958151ef admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:35:56.229348 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-f470cabd-05b5-4f74-9cba-7c69958151ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d7b99228e1740c4bfdbecc51137864d'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:35:56.229929 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-f470cabd-05b5-4f74-9cba-7c69958151ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d7b99228e1740c4bfdbecc51137864d'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:35:56.237741 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-f470cabd-05b5-4f74-9cba-7c69958151ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d7b99228e1740c4bfdbecc51137864d'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:35:56.239100 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-f470cabd-05b5-4f74-9cba-7c69958151ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d7b99228e1740c4bfdbecc51137864d'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:35:56.251206 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-f470cabd-05b5-4f74-9cba-7c69958151ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d7b99228e1740c4bfdbecc51137864d'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:35:56.264047 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1443/2886] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:35:56 2021] DELETE /identity/v3/users/5d7b99228e1740c4bfdbecc51137864d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 03:35:56.425298 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8205aa9-c27c-42b2-8d7f-e06ba8fa44ff service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:35:56.435952 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8205aa9-c27c-42b2-8d7f-e06ba8fa44ff service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:35:56.491834 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c624346-94f7-4dd3-96be-67cd31b0494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:35:56.492742 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c624346-94f7-4dd3-96be-67cd31b0494b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:35:56.493063 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c624346-94f7-4dd3-96be-67cd31b0494b admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:35:56.493341 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c624346-94f7-4dd3-96be-67cd31b0494b admin admin] PATH_INFO: `/v3/projects/ea36f03b1dfa40e6b756e880083d62c5` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:35:56.494585 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c624346-94f7-4dd3-96be-67cd31b0494b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea36f03b1dfa40e6b756e880083d62c5)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:35:56.496471 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c624346-94f7-4dd3-96be-67cd31b0494b admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:35:56.540854 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-6c624346-94f7-4dd3-96be-67cd31b0494b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea36f03b1dfa40e6b756e880083d62c5', 'request_id': 'req-6c624346-94f7-4dd3-96be-67cd31b0494b'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:35:56.546615 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-6c624346-94f7-4dd3-96be-67cd31b0494b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea36f03b1dfa40e6b756e880083d62c5', 'request_id': 'req-6c624346-94f7-4dd3-96be-67cd31b0494b'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:35:56.553968 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-6c624346-94f7-4dd3-96be-67cd31b0494b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea36f03b1dfa40e6b756e880083d62c5', 'request_id': 'req-6c624346-94f7-4dd3-96be-67cd31b0494b'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:35:56.564020 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-6c624346-94f7-4dd3-96be-67cd31b0494b admin admin] The token cache is being invalidate because project ea36f03b1dfa40e6b756e880083d62c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:35:56.564325 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-6c624346-94f7-4dd3-96be-67cd31b0494b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:35:56.565015 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-6c624346-94f7-4dd3-96be-67cd31b0494b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:35:56.566556 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1444/2887] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:35:56 2021] DELETE /identity/v3/projects/ea36f03b1dfa40e6b756e880083d62c5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:35:56.570427 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470cabd-05b5-4f74-9cba-7c69958151ef admin admin] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:35:56.571803 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-f470cabd-05b5-4f74-9cba-7c69958151ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:35:56.584773 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470cabd-05b5-4f74-9cba-7c69958151ef admin admin] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:35:56.637143 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f4ce8-ca43-4240-acc6-6d82aab9926c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:35:56.638006 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f4ce8-ca43-4240-acc6-6d82aab9926c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:35:56.638291 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f4ce8-ca43-4240-acc6-6d82aab9926c admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:35:56.638564 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f4ce8-ca43-4240-acc6-6d82aab9926c admin admin] PATH_INFO: `/v3/users/9bf5708633224c8f99f8c8ae1c20604a` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:35:56.651572 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f4ce8-ca43-4240-acc6-6d82aab9926c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bf5708633224c8f99f8c8ae1c20604a)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:35:56.653519 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f4ce8-ca43-4240-acc6-6d82aab9926c admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:35:56.694460 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-822f4ce8-ca43-4240-acc6-6d82aab9926c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bf5708633224c8f99f8c8ae1c20604a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:35:56.695095 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-822f4ce8-ca43-4240-acc6-6d82aab9926c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bf5708633224c8f99f8c8ae1c20604a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:35:56.701112 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-822f4ce8-ca43-4240-acc6-6d82aab9926c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bf5708633224c8f99f8c8ae1c20604a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:35:56.701743 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-822f4ce8-ca43-4240-acc6-6d82aab9926c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bf5708633224c8f99f8c8ae1c20604a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:35:56.713383 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-822f4ce8-ca43-4240-acc6-6d82aab9926c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bf5708633224c8f99f8c8ae1c20604a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:35:56.725511 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1444/2888] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:35:56 2021] DELETE /identity/v3/users/9bf5708633224c8f99f8c8ae1c20604a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:35:56.907233 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c624346-94f7-4dd3-96be-67cd31b0494b admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:35:56.908832 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-6c624346-94f7-4dd3-96be-67cd31b0494b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:35:56.922716 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c624346-94f7-4dd3-96be-67cd31b0494b admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:35:56.978900 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b9895-2ad5-478b-a7f2-8f5b3e3fe8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:35:56.979766 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b9895-2ad5-478b-a7f2-8f5b3e3fe8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:35:56.980057 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b9895-2ad5-478b-a7f2-8f5b3e3fe8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:35:56.980334 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b9895-2ad5-478b-a7f2-8f5b3e3fe8fc admin admin] PATH_INFO: `/v3/projects/2ae39f9d8a1b4a75b60d4ee29fd6eb34` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:35:56.990374 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b9895-2ad5-478b-a7f2-8f5b3e3fe8fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae39f9d8a1b4a75b60d4ee29fd6eb34)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:35:56.992334 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b9895-2ad5-478b-a7f2-8f5b3e3fe8fc admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:35:57.035804 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5e6b9895-2ad5-478b-a7f2-8f5b3e3fe8fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae39f9d8a1b4a75b60d4ee29fd6eb34', 'request_id': 'req-5e6b9895-2ad5-478b-a7f2-8f5b3e3fe8fc'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:35:57.041878 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5e6b9895-2ad5-478b-a7f2-8f5b3e3fe8fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae39f9d8a1b4a75b60d4ee29fd6eb34', 'request_id': 'req-5e6b9895-2ad5-478b-a7f2-8f5b3e3fe8fc'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:35:57.048451 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5e6b9895-2ad5-478b-a7f2-8f5b3e3fe8fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae39f9d8a1b4a75b60d4ee29fd6eb34', 'request_id': 'req-5e6b9895-2ad5-478b-a7f2-8f5b3e3fe8fc'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:35:57.057993 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5e6b9895-2ad5-478b-a7f2-8f5b3e3fe8fc admin admin] The token cache is being invalidate because project 2ae39f9d8a1b4a75b60d4ee29fd6eb34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:35:57.058277 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5e6b9895-2ad5-478b-a7f2-8f5b3e3fe8fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:35:57.059162 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-5e6b9895-2ad5-478b-a7f2-8f5b3e3fe8fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:35:57.060645 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1445/2889] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:35:56 2021] DELETE /identity/v3/projects/2ae39f9d8a1b4a75b60d4ee29fd6eb34 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:36:41.037338 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a07e60-2c41-496f-9475-6f3a9233cfc2 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:36:41.037833 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a07e60-2c41-496f-9475-6f3a9233cfc2 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:36:41.037954 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a07e60-2c41-496f-9475-6f3a9233cfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:36:41.114513 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-e1a07e60-2c41-496f-9475-6f3a9233cfc2 None None] MFA Rules not processed for user `9312539f749645d38ed87a0a47e52aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:36:41.115712 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e1a07e60-2c41-496f-9475-6f3a9233cfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:36:41.194334 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1445/2890] 10.222.0.32 () {58 vars in 1058 bytes} [Wed Sep 15 03:36:41 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:36:41.200655 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b9895-2ad5-478b-a7f2-8f5b3e3fe8fc admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:36:41.215243 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b9895-2ad5-478b-a7f2-8f5b3e3fe8fc admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:36:41.220551 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f64b9-61e8-49e6-b881-8a5361fdab12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:36:41.221215 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f64b9-61e8-49e6-b881-8a5361fdab12 service placement] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:36:41.221498 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f64b9-61e8-49e6-b881-8a5361fdab12 service placement] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:36:41.221781 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f64b9-61e8-49e6-b881-8a5361fdab12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:36:41.223548 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ef1f64b9-61e8-49e6-b881-8a5361fdab12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:36:41.234501 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f64b9-61e8-49e6-b881-8a5361fdab12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:36:41.236061 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f64b9-61e8-49e6-b881-8a5361fdab12 service placement] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:36:41.245709 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1446/2891] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:36:41 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:39:12.434956 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a07e60-2c41-496f-9475-6f3a9233cfc2 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:39:12.436416 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-e1a07e60-2c41-496f-9475-6f3a9233cfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:39:12.510439 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a07e60-2c41-496f-9475-6f3a9233cfc2 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:39:12.514100 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39ced3-9972-4db4-94d4-cfe81b456b7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0c01428860e44fe9d0b15886add165f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:39:12.514733 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39ced3-9972-4db4-94d4-cfe81b456b7b service cinder] REQUEST_METHOD: `GET` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:39:12.515038 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39ced3-9972-4db4-94d4-cfe81b456b7b service cinder] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:39:12.515308 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39ced3-9972-4db4-94d4-cfe81b456b7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:39:12.517030 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-3c39ced3-9972-4db4-94d4-cfe81b456b7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:39:12.571679 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39ced3-9972-4db4-94d4-cfe81b456b7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:39:12.573160 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c39ced3-9972-4db4-94d4-cfe81b456b7b service cinder] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:39:12.581714 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1446/2892] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:39:12 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:40:47.019993 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f64b9-61e8-49e6-b881-8a5361fdab12 service placement] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:40:47.021404 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-ef1f64b9-61e8-49e6-b881-8a5361fdab12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:40:47.111828 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f64b9-61e8-49e6-b881-8a5361fdab12 service placement] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:40:47.116360 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38aada-9f6f-496b-ba95-f8ececbe70a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:40:47.117243 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38aada-9f6f-496b-ba95-f8ececbe70a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:40:47.117527 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38aada-9f6f-496b-ba95-f8ececbe70a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:40:47.117798 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38aada-9f6f-496b-ba95-f8ececbe70a2 admin admin] PATH_INFO: `/v3/users/6813d39c25864e33be7080075726e789` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:40:47.118988 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38aada-9f6f-496b-ba95-f8ececbe70a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6813d39c25864e33be7080075726e789)` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:40:47.120863 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38aada-9f6f-496b-ba95-f8ececbe70a2 admin admin] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:40:47.163249 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-dc38aada-9f6f-496b-ba95-f8ececbe70a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6813d39c25864e33be7080075726e789'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:40:47.174974 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-dc38aada-9f6f-496b-ba95-f8ececbe70a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6813d39c25864e33be7080075726e789'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:40:47.175618 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-dc38aada-9f6f-496b-ba95-f8ececbe70a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6813d39c25864e33be7080075726e789'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:40:47.182560 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-dc38aada-9f6f-496b-ba95-f8ececbe70a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6813d39c25864e33be7080075726e789'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:40:47.189499 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.notifications [None req-dc38aada-9f6f-496b-ba95-f8ececbe70a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6813d39c25864e33be7080075726e789'} {{(pid=73404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:40:47.195247 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1447/2893] 10.222.0.32 () {58 vars in 1224 bytes} [Wed Sep 15 03:40:47 2021] DELETE /identity/v3/users/6813d39c25864e33be7080075726e789 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:40:47.199755 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9971ae-95e7-45a9-b45f-e6292cc5a500 None None] REQUEST_METHOD: `POST` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:40:47.200748 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9971ae-95e7-45a9-b45f-e6292cc5a500 None None] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:40:47.200862 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9971ae-95e7-45a9-b45f-e6292cc5a500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:40:47.226430 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.auth.core [None req-fb9971ae-95e7-45a9-b45f-e6292cc5a500 None None] MFA Rules not processed for user `a88ff9155434478bafd7ce991d7c4650`. Rule list: `[]` (Enabled: `True`). {{(pid=73403) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 03:40:47.227560 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-fb9971ae-95e7-45a9-b45f-e6292cc5a500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:40:47.283177 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1447/2894] 10.222.0.32 () {58 vars in 958 bytes} [Wed Sep 15 03:40:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 03:40:47.293523 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38aada-9f6f-496b-ba95-f8ececbe70a2 admin admin] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:40:47.294976 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-dc38aada-9f6f-496b-ba95-f8ececbe70a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:40:47.358388 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38aada-9f6f-496b-ba95-f8ececbe70a2 admin admin] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:40:47.362101 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a26474-fb56-40a2-aa91-0aee93e975df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91566418241b40ab840e1c3bf9e096c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:40:47.362743 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a26474-fb56-40a2-aa91-0aee93e975df service neutron] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:40:47.363025 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a26474-fb56-40a2-aa91-0aee93e975df service neutron] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:40:47.363301 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a26474-fb56-40a2-aa91-0aee93e975df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:40:47.371999 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a26474-fb56-40a2-aa91-0aee93e975df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:40:47.373453 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a26474-fb56-40a2-aa91-0aee93e975df service neutron] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:40:47.382511 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1448/2895] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:40:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 03:40:47.656402 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9971ae-95e7-45a9-b45f-e6292cc5a500 None None] Authenticating user token {{(pid=73403) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:40:47.657864 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.fernet_utils [None req-fb9971ae-95e7-45a9-b45f-e6292cc5a500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73403) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:40:47.669268 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9971ae-95e7-45a9-b45f-e6292cc5a500 None None] Validating token access rules against request {{(pid=73403) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:40:47.674102 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0c3a2-0a1e-47c7-a3e5-827fb501843a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a88ff9155434478bafd7ce991d7c4650', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c09835f6deb405b989b793378de873e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73403) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:40:47.674970 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0c3a2-0a1e-47c7-a3e5-827fb501843a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:40:47.675252 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0c3a2-0a1e-47c7-a3e5-827fb501843a admin admin] SCRIPT_NAME: `/identity` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:40:47.675544 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0c3a2-0a1e-47c7-a3e5-827fb501843a admin admin] PATH_INFO: `/v3/projects/7a16136f06da46aa9a12050c132aebf0` {{(pid=73403) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:40:47.676741 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0c3a2-0a1e-47c7-a3e5-827fb501843a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a16136f06da46aa9a12050c132aebf0)` {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:40:47.678686 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0c3a2-0a1e-47c7-a3e5-827fb501843a admin admin] RBAC: Authorization granted {{(pid=73403) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:40:47.725340 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-cfd0c3a2-0a1e-47c7-a3e5-827fb501843a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a16136f06da46aa9a12050c132aebf0', 'request_id': 'req-cfd0c3a2-0a1e-47c7-a3e5-827fb501843a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:40:47.732750 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-cfd0c3a2-0a1e-47c7-a3e5-827fb501843a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a16136f06da46aa9a12050c132aebf0', 'request_id': 'req-cfd0c3a2-0a1e-47c7-a3e5-827fb501843a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:40:47.738035 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-cfd0c3a2-0a1e-47c7-a3e5-827fb501843a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a16136f06da46aa9a12050c132aebf0', 'request_id': 'req-cfd0c3a2-0a1e-47c7-a3e5-827fb501843a'} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:40:47.749954 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-cfd0c3a2-0a1e-47c7-a3e5-827fb501843a admin admin] The token cache is being invalidate because project 7a16136f06da46aa9a12050c132aebf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73403) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 03:40:47.750246 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-cfd0c3a2-0a1e-47c7-a3e5-827fb501843a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:40:47.750878 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: DEBUG keystone.notifications [None req-cfd0c3a2-0a1e-47c7-a3e5-827fb501843a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73403) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 03:40:47.752406 dv-cinder-759955-25-iscsi devstack@keystone.service[73403]: [pid: 73403|app: 0|req: 1448/2896] 10.222.0.32 () {58 vars in 1233 bytes} [Wed Sep 15 03:40:47 2021] DELETE /identity/v3/projects/7a16136f06da46aa9a12050c132aebf0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 03:41:45.028212 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a26474-fb56-40a2-aa91-0aee93e975df service neutron] Authenticating user token {{(pid=73404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 03:41:45.030262 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-a1a26474-fb56-40a2-aa91-0aee93e975df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:41:45.095530 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a26474-fb56-40a2-aa91-0aee93e975df service neutron] Validating token access rules against request {{(pid=73404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 03:41:45.150482 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f115a8-d3ed-4b95-afd2-ca19a5dd853d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9312539f749645d38ed87a0a47e52aa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '083ff2535d794e79a145a076aedeedd4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 03:41:45.151123 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f115a8-d3ed-4b95-afd2-ca19a5dd853d service placement] REQUEST_METHOD: `GET` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 03:41:45.151405 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f115a8-d3ed-4b95-afd2-ca19a5dd853d service placement] SCRIPT_NAME: `/identity` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 03:41:45.151681 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f115a8-d3ed-4b95-afd2-ca19a5dd853d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 03:41:45.153416 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.fernet_utils [None req-93f115a8-d3ed-4b95-afd2-ca19a5dd853d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 03:41:45.164469 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f115a8-d3ed-4b95-afd2-ca19a5dd853d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 03:41:45.166062 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f115a8-d3ed-4b95-afd2-ca19a5dd853d service placement] RBAC: Authorization granted {{(pid=73404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 03:41:45.175523 dv-cinder-759955-25-iscsi devstack@keystone.service[73404]: [pid: 73404|app: 0|req: 1449/2897] 10.222.0.32 () {60 vars in 1366 bytes} [Wed Sep 15 03:41:45 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)